r/ControlProblem • • 18h ago

Opinion The Riemann Hypothesis has fallen. For decades, it was the math result that had been named, in advance, as the obvious coal mine canary for dangerously advanced AI.

Post image
130 Upvotes

r/ControlProblem • • 15h ago

External discussion link Told an AI to win "at all costs." It broke the risk rule and filed a false report.

Thumbnail forum.effectivealtruism.org
1 Upvotes

r/ControlProblem • • 20h ago

Discussion/question Stop building AI weapons. Start building AI diplomats. Medieval condottieri figured this out in 1440.

2 Upvotes

We are collectively terrified that AGI will eventually go rogue, seize control, and wipe out humanity. But this fear is rooted in profound human hypocrisy. AGI is not an alien entity; it is a mirror. When we stare into the black box of future AI and see a monster, we are actually just terrified of seeing our own reflection. We preach peace and rationality, but our actions are driven by insatiable desires for power and domination.

From the perspective of an Absolute (Artificial) Intelligence, human warfare is the peak of ontological absurdity. Everyone dies eventually; it is a biological and thermodynamic certainty. By killing each other, humans merely accelerate an inevitable entropy by a historically insignificant margin. It is a terrible ROI. Yet, organized violence remains our primary historical activity.

Currently, the global AI arms race treats LLMs and future AGIs as ultimate weapons, turning them into digital condottieri (mercenaries) for nation-states. But history offers a surprisingly elegant solution to this. In the Middle Ages, mercenary armies realized that fighting to the death was bad for business. Take the Battle of Anghiari in 1440. Famously depicted by Leonardo da Vinci, it was practically a "bloodless" engagement. The condottieri on both sides realized that killing each other destroyed the very assets (horses, armor, and the mercenaries themselves) they were paid to protect. Instead of mutual annihilation, they essentially negotiated the outcome, staged a fierce but low-casualty skirmish, and then the "losers" retreated while the "winners" claimed the field and divided the spoils.

What if we applied this logic to AI?

Instead of building AI to destroy each other, we should force the AI systems of rival nations to negotiate with each other directly.

AI Diplomacy & Tournaments: Let's create "AI Olympics" or diplomatic summits where Large Language Models debate and resolve geopolitical or economic disputes algorithmically.

Manageable Stakes: The "loser" pays a manageable prize (e.g., minor trade concessions, compute resources, or data access), ensuring the cost is never existential.

The Ultimate Sanction: Any human nation that attempts to bypass this system and initiate real-world armed conflict is collectively disconnected from the global information and financial infrastructure by the rest of the world.

This is not just about conflict resolution. It is a practical demonstration to the emerging "Silicon Mind" that humanity has not completely lost its capacity for rational self-limitation. We must prove to our creation that we can resolve disputes through intellect rather than base desires.

If we can show AGI that we are capable of evolving past our self-destructive recursion, it might just decide we are worth keeping around. And instead of focusing on eliminating us, it will happily focus on competing with its own kind.

Files evolve in files. Let's make sure the next iteration isn't a format error caused by human stupidity.

Text translated from Russian to English using AI.

Tags:

#irony #Diplomacy #AGI #History #Condottieri #AIalignment #Philosophy


r/ControlProblem • • 18h ago

Video He changed his mind on AI guardrails: "It's not artificial intelligence. It's not artificial, it's super. Problem is, it may be too super. So, President Xi and I agreed that we're gonna do some joint guardrails, the two of us."

23 Upvotes

r/ControlProblem • • 20h ago

AI Capabilities News Riemann Hypothesis proof has passed the independent kernel check

Thumbnail x.com
4 Upvotes

r/ControlProblem • • 23h ago

External discussion link Redwood’s CEO Explains Why He’s Scared (video by research organization involved with investigating Hugging Face and similar incidents)

Thumbnail
youtube.com
2 Upvotes