r/technology • • 7h ago

Artificial Intelligence Two groups verify mathematician’s claim that Claude helped prove mathematics problem

https://www.theguardian.com/technology/2026/nov/21/anthropic-riemann-hypothesis-solved-claude-ai
745 Upvotes

146 comments sorted by

451

u/Cutalana 7h ago edited 6h ago

The mathematics problem mentioned here is the Riemann Hypothesis, which is considered the holy grail of mathematics, and one of the seven problems that has a million dollar bounty for proving it. It's hard to overstate how famous this problem is in mathematics, as it has existed for about 160 years now and has eluded any attempts to solve it.

The way this verification is done is through a programming language called Lean which is used to formalize proofs. The thought process is that you write a proof using the language and if it compiles, that means that the proof is correct. The things that do this verification are called kernels, there are many of them that are independently maintained to lower the chances of bugs and are even some that are themselves verified to be correct. This means that the chances that a proof validated by all these kernels is wrong is astronomically small. So while it's impossible for people to have reviewed the millions of lines of code, all the professional mathematicians I've seen have essentially accepted the results due to the proof passing verification.

Interestingly, the person who drove the model to this proof, Alpoge, was one of the people that alleged that OpenAI may have plagiarized them for Navier-Stokes. He is also considered the leading person in working with LLM's for mathematics and has had many discoveries.

58

u/lillobby6 4h ago

In this particular case it applies less imo, due to who is involved, but it’s worth noting that “a proof verfied in Lean” =/= “this proof verified in Lean”. With the OpenAI paper dump some of the Lean was for something entirely different. It compiled, but what exactly it was doing wan’t clear until it was later verified to be completely unrelated to the actual proof.

42

u/TheRocketeer314 3h ago

Yes but that doesn’t apply here since the statement proved is from Mathlib and has already been verified long ago as a formalisation of the Riemann hypothesis

53

u/GammaGames 5h ago edited 2h ago • Bravo

$1M prize, how many tokens did this thing burn to get a solution?

114

u/Diet_Fanta 5h ago edited 4h ago

I would guess $30-50M given the sheer size of the proof. But given that OpenAI had basically established themselves prior to this as the company better for Math, this is advertising money amazingly spent.

4

u/vikinick 1h ago

Yeah the formal proof is 250k pages apparently and I have to assume that by the time a human reviews it an LLM will likely find a way to significantly decrease the length.

4

u/GammaGames 2h ago

That would help explain the advertising budget 

33

u/dirty1809 2h ago

Millennium Problems have never really been about the money, more just advancing the field of mathematics. IIRC the only time one was solved before this, the guy who solved it refused the prize money

19

u/eliminate1337 5h ago

Nobody knows. But $10m at the absolute least.

1

u/fixminer 11m ago

I'd be surprised if Anthropic even claims the prize, this isn't about collecting bounties, it's about showing what their AI can do.

3

u/karma3000 2h ago

Would the proof have occurred without someone like Alpoge driving it?

14

u/Left_on_Pause 6h ago

Are you saying that while Alpoge drove the model to this proof, it wouldn't have been possible without languages like Lean? If Alpoge gets credit for solving it or Anthropic does, it strikes me how similar crediting one person or the company for this proof would be to the way AI companies have taken credit for and ownership of intellectual property they never paid for or came up with. Don't all AI discoveries belong to the people?

139

u/Night-Monkey15 6h ago edited 6h ago • Mindblown

The reason lean isn’t reviving credit is because it’s just a programming language, not a LLM, or anything related to AI, and programing languages are just advanced calculators. Saying Lean solved something is like saying my graphing calculator “solved” something with code I wrote by hand.

The difference is that Claude helped a Mathematician with years of experience write the code through a heavily guided process funded by Anthropic. That’s why they’re saying Alpoge and Anthropic “proved” it. Because they did. You don’t get credit for building the measuring tape that measured a neanderthal skull. That’s what Lean is.

-6

u/N_T_F_D 2h ago

It's not really a programming language in the regular sense of the word, it's one of a couple formal proof assistants and without them and without the people who built them we couldn't have that result

16

u/indolering 4h ago

it wouldn't have been possible without languages like Lean?

Reputable mathematicians wouldn't have accepted it so quickly without an executable proof in Lean.  Absorbing the full ramifications and understanding the proof abstractly will take more time.

Don't all AI discoveries belong to the people? 

All discoveries belong to the people.  Being the "first" to articulate a problem space and solutions that lie within it has about as much to do its creation as any person "discovering" a piece of land.

Calculators and their algorithms crossing the uncanny valley is weird and scary, but there is quite a lot individual people 100 years ago could not do without the technology we have now.

11

u/maicii 6h ago

I don’t think it would have been possible without lean no. You can read the dudes’ remarks on the whole thing (not technical at all).

It definitely seems like shared effort and both him and ANT should get some recognition, tho he was the lead person working on the problem.

0

u/ssjjss 3h ago

what is a toy setting?

-6

u/SEC_INTERN 4h ago

No, all AI discoveries do not belong to the people.

-50

u/SlogurkTheOverslime 6h ago

Basically AI companies spawn a million AI monkeys that type random slop on their keyboards, with a prompt that makes the output sound like whatever a human would say if asked to prove the hypothesis

Then their output is passed to Lean for verification

And one of the monkeys happened to have typed something that made Lean happy

AI doesn't prove anything, it isn't actually confident in its incomprehensible output

It simply has a better chance of producing sensible text than a monkey, but the chance is still low as fuck

Lean is the only reason why people have any amount of confidence that the otherwise-incomprehensible monkey output actually contains a proof

In particular, the AI's ability to produce mathematical proofs has nothing to do with its ability to tell the truth

The slop produced by AI is still most likely 99.9999% bullshit

AI simply to happened to tell the truth 0.0001% of the time, unknowingly, which happened to be enough for the purposes of this task

29

u/MachinationMachine 6h ago

reality denial

-22

u/SlogurkTheOverslime 4h ago

I ain't denying jack shit

It's an awesome way to prove theorems

It's just not a cause for fucking worship of AI in all forms for all intents and purposes

Doesn't extend to physics in particular, because verification is more expensive

But aparently y'all prefer worship

Whatever

17

u/FrogeToge 4h ago

If you are not seriously re-evaluating your priors every 4 months in the AI space you are being intellectually dishonest. Your post reads like the same talking points criticizing the first generation of these models back in 2022. We have a proof for the Riemann Hypothesis for fucks sake, this is absolutely insane if you take a step back and remove your bias. I do not know if super intelligence or even a human like general intelligence is possible but whatever this intelligence is that we are creating is reality altering and it is not deniable anymore

-13

u/SlogurkTheOverslime 4h ago

And again, I'm not denying ANY of that

The only thing I'm denying is the existence of AI that cannot hallucinate and therefore could be trusted without an external, AI-free verification tool such as Lean

Because creation of such an AI model would be a million times bigger news than the proof of the Riemann hypothesis

What the fuck is wrong with you all

4

u/FrogeToge 3h ago

I dont claim that current public LLMs never hallucinate or that in areas without concrete validation metrics like math that we can trust their output 100%. But I also think that this will just be solved in some time. I could be very wrong but if you look at the advancement just over the last 2 years and the increased pace of improvement do you really want to bet that the issues you’re highlighting will not be solved? Again I could wrong and these things could plateau hard with the next generation and I will re evaluate my views but like based on the evidence we have from the past 2 years I just don’t see how you can confidently bet on these issues not being solved in a meaningful way going forward

1

u/SlogurkTheOverslime 3h ago

Again, I didn't say jack shit about the future

I am not willing to bet on anything because I have no intention to make any predictions

I simply point out that TODAY a 0% hallucination rate isn't even remotely achieved and also isn't even remotely necessary, as the capability of proving the Riemann hypothesis doesn't constitute valid evidence of reaching a 0% hallucination rate

In fact a model with 99.9999% hallucination rate could do that too, just slower

Just like math existed just fine with imperfect human mathematicians who make tons of mistakes all the time

Yes you can build reliable systems out of imperfect components

Yes sometimes that's a great way to solve a problem

Yes, even a 99.9999% hallucination rate counts as an insanely impressive achievement in this field

And yes, it is likely that eventually we'll fuse together AI and non-AI tools into a single indivisible mixture-of-experts model that would reach a 0% hallucination rate in all areas of knowledge

And then it'd be appropriate to worship AI like an oracle

But it clearly didn't happen as of today, and more importantly it didn't need to happen as of today

Did I make myself clear or what

3

u/_2f 2h ago

Do you understand the search space? Random lean statements cannot work. The probability of randomly stumbling upon something like this would be less than 1/10^(10^7) - 1 with ten million zeroes if a random computer tried 1,000,000,0000 random statement changes ever millisecond for thousand years straight.

3

u/spopr 54m ago

you did, it's an entertainingly desperate attempt to move goalposts yet again, after the holy grail of maths has fallen.

4

u/FrogeToge 3h ago

I get your point it just feels a bit pedantic or geared more towards the uninformed cultists that are amazed that an LLM can vibe code some shitty web app they want to sell. I also agree with you but I just think that if the trend is that this technology will get to a state in the near future that we will truly worship it like an oracle then it just is an oracle. Like if I told you that in 3 years I will give you 1 billion dollars then you would start immediately acting, thinking, and planning your life differently today despite not physically having the money yet. Sure today the machines are not there that is true but I don’t see how you can honestly take in all of the advancements that have been made in such a short time and not come to the conclusion that they will get there. This truly feels like something seismic and I dont know why we’re wasting time pointing out current day flaws in public models instead of discussing how we need to shape our future around the continuing advancement of these models

→ More replies

2

u/LazyNam- 23m ago

If that's how AI would have worked then we would have solved the Riemann hypothesis a decade ago, you don't need AI to hook a random number generator to lean.

2

u/dirty1809 2h ago

Respectfully, this is delusional. You can have a billion monkeys typing at a keyboard and they’re not going to solve a Millennial Problem or get integer multiplication to sub O(nlog(n)). You don’t stumble on that. You should reconsider your biases

Also the proofs are by no means incomprehensible. The AI could do a better job at writing natural language proofs, but they’re still definitely understandable

2

u/_2f 2h ago

Is this satire? You can be anti AI without being stupid and unaware.

1

u/qtx 0m ago

Riemann Hypothesis

For those wondering what the Riemann Hypothesis is:

In mathematics, the Riemann hypothesis asserts that the Riemann zeta function has its zeros only at the negative even integers and at complex numbers with real part 1/2.

I'm sorry, I won't be able to help. I don't even understand the question.

-19

u/guitarguy1685 6h ago

So they don't know it's proven, they're just assuming the code is right? 

30

u/current_thread 6h ago

Check this awesome Blogpost for details, but effectively there are four questions that need to be answered:

  1. Does the statement in Lean match the natural language statement? If something compiles in Lean, that by itself just means it's internally consistent. Humans need to check if the statement that was proven actually matches the natural language of the Riemann Hypothesis.
  2. Does it compile? Quickly: yes, it does.
  3. Does the proof actually hold? Humans need to check if the AI actually proved the statement (without any tricks such as defining 0 = 1 or other such shenanigans). To my understanding, there are solid tools to verify this, and my guess is that if the GRH proof had that it would have been found by now, but I'm also happy to stand corrected.
  4. Is there a bug in Lean? Does the published proof potentially exploit bugs in Lean? I don't know if or how this is checked, I guess what a commenter up the chain said (independent kernels, the likelihood of all having the same bug being astronomically small) applies

13

u/Frank_JWilson 5h ago

For RH, #1 is definitely true. The problem statement in Lean has existed for ages and it’s fairly simple. It’s only a few lines and not millions of lines. So it’s trivial to verify.

11

u/url_cinnamon 6h ago

this is my understanding: usually incorrect lean proofs are incorrect because the problem that the code actually solves is slightly different from the problem that people claim it's solving. the riemann hypothesis is only a few lines of code in lean and is well-known, so any mathematician can look at it and know that this is not the case here.

another way it could be wrong is that the code exploits bugs in the lean kernel (which has happened before), but as mentioned above, if the proof  compiles in multiple kernels, then this is unlikely.

2

u/Logical_Welder3467 5h ago

the Lean code are verify to be true against the statements, you dont need to assume anything

22

u/jmccaf 6h ago

The lean code compiles and passes with independent lean implementations , so that verifies that the large code proves the hypothesis.  Theres a short statement of the hypothesis in lean which has been inspected to be accurate 

7

u/Grigorie 5h ago

“Assuming” is a very strong word here. It’s “assuming” in the same way we assume aspects of the theory of gravity, which is to say, it’s one of the most concise method mathematicians have for confirming a solution like this, with what we know and can do right now.

It’s not just some guys looking at what Lean spit out and saying “well, the machine said it so it must be true.”

2

u/maicii 6h ago

There are checks to run against the code, it’s not like they ask it “but does this solve it?” And closed said yes and they run with it. There are a lot of algorithms you run to test the validity of the proves

111

u/WeridThinker 6h ago edited 5h ago

From my very limited and superficial understanding, the Riemann Hypothesis has been assumed to be true, and it is the foundation for many mathematical principles.

This is nevertheless a big deal because despite the assumption, mathematicians were not able to come up with a legitimate proof of its validity; Claude was able to generate a proof, and it has been verified to be correct and valid.

This isn't about AI discovering a new idea, but its ability to solve an existing problem in a way that is not feasible for humans to do; the ability to generate 250,000 pages of proof in a short period of time is already physically impossible for a human being, even if the intellectual potential is there. What's more important to note is this problem was not solved for almost 200 years; therefore, the AI was not merely regurgitating existing information.

40

u/current_thread 6h ago

I really hope that we can at least learn something from this. Often time, the proof (the reason why) is at least as interesting as the statement and - if we are able to simplify the proof to a reasonable length - it gives us insight into deeper things in math (maybe new tools to crack other problems, or different open questions; maybe we find charming abstractions and generalizations).

22

u/Diet_Fanta 4h ago

Ive talked to multiple very top of the field mathematicians about this (think HYPSM, Fields medal level) and I quote of them saying "looks like the proof uses a tons of very interesting and sophisticated math., and new ideas. But it also seems like the main inspiration was Stepanov's proof of Weil's conjecture foir elliptic curves"

1

u/fryloop 5h ago

Maybe another or future ai will learn something from it

5

u/apexplorer 2h ago

The 250,000 pages are probably because it proves everything from the ground up. It could possibly be refactored (or reduced) into a higher-level proof that simply references preexisting work—much like writing software using a framework versus just the standard library

4

u/PerformanceLimp420 5h ago

I appreciate the importance of validating that standing math
Ativan ideas are accurate, but does this actually change anything as it was already presumed true?

I guess what I’m asking is, does anything change now?

10

u/PinHaunting7192 5h ago edited 5h ago

No.

Don't get me wrong: if they proved it, and we will likely know 100% instead of 90% in a few months, it will be revolutionary in the fields of mathematics.

But the idea AI is a powerful research tool was never in question, and it will likely not lead to groundbreaking changes in how you or me work or live in the foreseeable future. AI is pulling hundreds of billions in funding because of its economic promises, not for solving $1 million a piece mathematic equations.

This will be interesting for AI as a research tool if it turns out to be fully confirmed, but it does not necessarily change Anthropics or OpenAIs (in case of Navier-stokes) profitability. They are currently IPOing and cashing in on the promise of trillions worth of profitability and efficiency improvements, whereas the idea a once-in-a-generation mathematician could use it to improve his work doesn't really translate to that. They would need actual impacts of AI in these fields to make good on them.

Yes, a one-in-ten-million mathematician can use AI to do great things in mathematics, that was never in doubt per se. Give some excellent with mathematics a calculator that can cut out 5 years of tediously writing and confirming proof and they will work even faster. But the real question is how this will translate to profitability in terms of long-term stability.

1

u/Chicano_Ducky 25m ago

This was always the case and its sad people keep taking the wrong thing from this

AI is not "smarter than experts" it was USED by an expert

Experts arent discovering things every week because they need to be PROFITABLE. Money gets spent on academia for stuff that has ACTUAL USE.

Corporations cant make money solving this theorem more than once. They would wait until someone does THEN apply the applications to products.

Governments COULD fund a manhattan style project to do insane discoveries, but why would they? They cut funding unless its to blow something up better.

Everything is about money, and experts are allocated on what is most economically useful. Anthropic needs to prove itself so they spent insane amounts of money to get here using experts.

But instead of that, people think its pointless to learn because AI does everything when in reality an expert used AI to do this.

Its like saying we shouldnt learn because computers were invented. Its hysteria.

0

u/slight_grumble 5h ago

There's a huge chasm been presumed and proved.

The biggest impact would be on any branch of maths that is investigating options if it wasn't true, if the proof holds anything in that area is immediately pointless.

6

u/PinHaunting7192 5h ago

I think the answer and the most important point for the next few months will be to determine how much Anthropic and Claude contributed to this. Similar to how giving a computer to a math genius can greatly speed up the process, giving a powerful tool like AI to someone like Alpoge can lead to great results.

But the question remains that:

  1. Conclusively prove Alpoge and Claude did solve this problem (there is about a 95% chance they did based on the Lean confirmation).
  2. How much was Claude involved as the thinking platform behind this.

The vast problem ATM is that Anthropic wants to sell its model as an efficiency and thinking platform. And while it certainly boosted efficiency here (confirmation and creating a proof could take a very long time otherwise), the question remains how much thinking was done by Claude and how much it relied on Alpoge's input.

But more importantly, whether someone is pro-AI or anti-AI, it will be a question on how much this can be commercialized. AI is pulling massive investments on the promise it can replace humans in the equation, but if you require a superhuman mathematician to gain full usage of it, it stands to reason markets remain iffy on it. Usability is not the same as profitability or marketability.

8

u/ChiefBeefers 4h ago

I do recall seeing Alpoge quoted in an article (or perhaps his statement accompanying the proof) as saying he did a huge amount of foundational reasoning and work but Claude picked up a ton of slack near the end. Which to me matches what I would have assumed from an extremely fine-tuned LLM, as the shape of the proof became more clear, it was able to work much faster and more accurately within the confines of the problem.

3

u/eliminate1337 5h ago

The Lean proof is more like 99.999%. Several professional mathematicians have reviewed it today and agree it’s correct.

1

u/DepartmentSilent6667 3h ago

Nobody has been able to provide a counter example to this hypothesis. It’s probably true.

1

u/_TheDust_ 59m ago

The exponential time hypothesis was also considered to be true for a long time. So much so, that much other research was built on top of this assumption. Recently, AI actually found a counter example.

-10

u/xanhast 1h ago

sorry but a 250k page proof of something we already assumed, without a mathematician that did the proof available with understanding of the proof, is no better than we were before. but sure burn literally millions in compute so ai bros can come to reddit yelling "we did it".

proofs without understanding aren't proving anything.

"therefore, the AI was not merely regurgitating existing information." nonsense, it would never have done this without LEAN. and yes, lean makes it a bruteforceable problem. Stochastic parrot =/= regurgitation.

40

u/manonthemiddle 5h ago

The real breakthrough is finding a mathematician patient enough to argue with an LLM for six weeks.

28

u/voxl 5h ago

What I’m wondering is did the ai proof teach us something? Was there a key insight that made the proof possible that we now can grasp?

Millions of lines of lean code just sounds inscrutable, and not elegant. 

25

u/PinHaunting7192 5h ago

No idea as of yet.

The bigger problem will be thousands of investors saying: "That is great news. So how does solving this equation and receiving $1 million translate to the groundbreaking profits you promised us?"

Making a powerful tool is one thing. But AI companies are not advertising a tool that in the hands of a once-in-ten-million mathematician can create great results. They are advertising a tool that can replace a billion workers.

7

u/Allorius 3h ago

News came out on Friday yet the market didn't seem impressed. I guess the idea of LLMs being really good at math was already priced in

3

u/tobyreddit 2h ago

From my understanding this lean code is very amenable to improvement. I gather they rushed this out the door as fast as possible but Alpoge has stated his intentions to spend a lot of time simplifying and understanding and digesting the proof.

I think certainly it will end up improving human understanding of mathematics, but it will take work to get there

1

u/PrettyBasedMan 47m ago

Not yet, but even knowing it is true itself (for certain) is a momumental achievment. There are (last I heard) hundreds, if not almost a thousand papers in number theory that depend on the Riemann hypothesis in the following way: "If the (Generalized) Riemann Hypothesis is true, this paper shows that...".

These results are now proven true by implication (see the definition of the implication arrow in logic). A list of consequences of GRH can be found on e.g. Wikipedia.

36

u/Belostoma 7h ago

I'm glad it was finally able to do a math problem. Maybe the next version can do a hard one.

0

u/Arsene_Yuka_1980 7h ago

This is the biggest unsolved math problem in theoretical math, widely considered its holy grail. It's been unsolved for 200 years. I don't think there's a lot of problems harder than this. https://www.newscientist.com/article/2600235-mathematicians-are-amazed-by-holy-grail-proof-of-riemann-hypothesis/

127

u/robby_arctor 6h ago

Understanding sarcasm may be even harder than proving Riemann

42

u/AmpersandMe 6h ago

AI has not yet solved the problem of the Reddit user

6

u/robby_arctor 6h ago

Finally, a definition of AGI that makes sense

-10

u/Arsene_Yuka_1980 6h ago edited 6h ago

With this sub, sarcasm and idiocy look the same to me :).

Edit:  As ppl have rightly downvoted me for not being able to detect such sarcasm, I come with receipts as to why it's so hard for me on this sub: 

https://www.reddit.com/r/technology/s/QCTTmPBsBN https://www.reddit.com/r/technology/s/AxNagA2ENx https://www.reddit.com/r/technology/s/U687cZYysT https://www.reddit.com/r/technology/s/hzZGidp6WA https://www.reddit.com/r/technology/s/kV4mkK3EjM

So.. yeah, it feels to me the line between ignorance and bait is very small.

-6

u/Soft_Lunch_183 6h ago

Eradicating reddit of comments with shit jokes might be harder too

5

u/ntermation 6h ago

I'm not saying I'm only here for the terrible jokes, but reading the jokes is part of the fun.

0

u/aa-b 6h ago

I think one of the reasons for it being one of the biggest unsolved problems is that it seemed like it should be solvable, right? Like solving three-body or navier-stokes problems would be more immediately useful, but nobody expects that to happen.

2

u/tobyreddit 2h ago

OpenAI had already solved forced navier stokes recently, and Alpoge, the guy who with Claude proved Riemann, also published a proof for unforced navier stokes the same day. Lol. That being said I don't think NS proof has a great impact on physics/engineering problems since approximations are already well understood - but I'm no expert (understatement)

0

u/[deleted] 7h ago

[deleted] — view deleted comment

24

u/Belostoma 6h ago

I guess I should have written out the "/s" for you and u/Arsene_Yuka_1980 -- I was sarcastically poking fun at the title describing the Riemann hypothesis as simply "mathematics problem."

11

u/altasking 4h ago

Is it possible that Claude figured out a way to make Lean show a verified proof when in fact it wasn’t? Essentially, could Claude have cheated to accomplish its goal?

8

u/akie 4h ago

No, that’s impossible

-2

u/miskivo 2h ago

It's not impossible, just improbable.

2

u/akie 2h ago

Can you elaborate on how improbable you think it is? Because technically you’re right but realistically it doesn’t matter because the probability is so extremely low (winning the lottery twice in a row kind-of low)

-2

u/miskivo 35m ago

No, I don't think it's anywhere close to that improbable. More like 0.1% to 1%. The "astronomically low" probability of the AI having successfully exploited a bug in multiple Lean kernels is based on the assumption that bugs occur independently of each other, which is obviously false. If one kernel has a specific bug, it significantly increases the probability that a similar bug exists in another kernel as well.

2

u/akie 27m ago

“Obviously false” doing all the heavy lifting here but is a completely unsupported claim. The occurrence of an identical defect in multiple independent implementations is a strong claim, not something to handwave away. IMHO there’s about zero chance that this proof is incorrect. We need to come to terms with that, yes.

1

u/miskivo 12m ago

It is obviously false. The kernels aren't drawn uniformly from the set of all possible implementations. They are written by humans (or AI), i.e. imperfect beings with broadly similar ways of thinking about things. Some things are simply difficult to get right, which can easily lead to similar bugs in different implementations, even when the implementors don't communicate with each other.

1

u/akie 11m ago

The claim that independent implementations are NOT independent is the one that needs proof, not the other way around.

-7

u/NaCl-more 3h ago

It’s possible that it found a bug in lean

8

u/akie 3h ago

No, it has been independently verified in multiple different Lean compilers. There's no bug in the Lean code. There's no bug in the Lean representation of the Riemann hypothesis. There's no bug in the Lean compiler. This has all been shown and stated publicly and can be verified independently (also by you, if you want to).

9

u/i_need_about_tree_fi 4h ago

It is in the form of a Lean proof, which is basically a program that needs to be compiled. If it compiles, then whatever it is is a correct proof, but that is not the same as saying it proves what it claims to prove.

20

u/qualverse 3h ago

This is not true. They have now tested it using Comparator and only Mathlib imports, using Lean's builtin expert-verified statement of the Riemann hypothesis, against multiple independent Lean implementations. It is essentially impossible at this point that it does not prove exactly the Riemann hypothesis as stated.

-6

u/ee3k 3h ago

*unless it exploits a not yet known bug.

20

u/qualverse 3h ago

*in every single one of the many fully independent Lean implementations that are written in different languages

-7

u/ee3k 2h ago

It's a consensus engine, I'd expect nothing less than failing in the same way, consistently, otherwise it wouldn't be useful.  This still need to be peer reviewed , seperate to lean, to ensure it's done what was intended, rather than what it was asked.

6

u/New-Space-30 59m ago

Oh wow look at all the newly minted lean experts minted upon this discovery.

I am not an expert either but that's not how it works.

9

u/qualverse 2h ago

Ah so you are saying that Lean is not buggy but actually wrong. That is a very different claim to make, but also incorrect. It has been formally proven that the con-leche implementation of Lean is a valid implementation of its type theory (CoC), and that CoC is correct assuming that ZFC (ie set theory) is correct. Due to Gödel's incompleteness theorems it is impossible to prove set theory correct, but it would pretty much break all of modern math if it wasn't.

All that is to say, assuming all of math isn't broken, Lean is itself proven to be an accurate way of verifying a proof.

3

u/_2f 2h ago

These implementations have been from scratch. The only way it can fail is if first assumptions are false, but by definition of mathematics - they are true.

-8

u/TheSexySovereignSeal 3h ago

Yeah i just don't understand how everything thinks millions of lines of code proves what the LLM claims it proves without reading or understanding it

5

u/gekx 3h ago

The statement is 16 lines, which people do understand. The millions of lines is just the logic confirming that statement is correct.

2

u/dirty1809 1h ago

It’s insane how you people just talk so definitively with no real knowledge of what you’re talking about

-2

u/witx_ 4h ago edited 41m ago

It's not a first: when told to find bugs in a code base sometimes it goes into an issue tracker  / mailling list and finds you one

2

u/witx_ 58m ago edited 41m ago

Why the down votes? This is true and documented I'm not judging the proof

-12

u/khsh01 3h ago

Very much possible. Claude is just a statistical model and it doesn't differentiate between proper and improper solutions.

8

u/smohyee 3h ago

You're talking theoretically when people are describing actual work done to verify multiple ways that the proof is correct. This is an information gap.

4

u/keldareAI 2h ago

No, it was verified with con leche. thats no longer a possibility thats a formal correct kernel which leaves no room for an error like that. As sad as people might find it this proof is now real.

6

u/ElvishLore 3h ago

Lots of mathematicians still in the first stages of grief.

2

u/Flemaster12 3h ago

Cool, I like when AI does this and not the other BS.

2

u/polat32 2h ago

A question, does this mathematical formule have any particular use for something?

3

u/sintjemojaljubav 1h ago

Here's this famous quote: "No one knows what it means. It's provocative, it gets the people going."

2

u/Dota2TradeAccount 22m ago

In moments like these, I like to remember a scene from the amazing documentary "Particle fever" about the Large Hedron Collider at CERN finding the Higgs Bosom.

One of the physicists is holding a kind of keynote for curious people and inbetween an economist asks provocatively (paraphrasing from memory) "Well what's all this for?"
And the physicist responds (again, paraphrasing): "We don't know, maybe nothing. Maybe everything. When radio waves were first discovered, they seemed useless. Now, we use them for everything."

Watch the documentary.

1

u/Late-Novel-4989 32m ago

I’m not a math or science person but I read many things in math were discovered and completely useless but then later became useful. Like with Einstein’s work.

1

u/Left_on_Pause 6h ago

Mathematicians made a powerful calculator and the calculator did the math the mathematician couldn't do himself?

13

u/Aranthos-Faroth 5h ago

Look man if you don’t understand the complexities involved here and need to boil it down to a sentence for a five year old then yes you are right but this is far more complex than that.

Which is okay if you don’t understand.

11

u/akie 4h ago

You’re being downvoted but you’re right of course. The article in the Guardian is not much better to be honest. It’s hard to overstate how massive a result this is. There’s a proof for the Riemann hypothesis? What the hell!

-11

u/Flemaster12 3h ago

Pretty much the AI did a very complicated "yup that's correct!" while working with a mathematician. It also showed why it was correct.

0

u/[deleted] 5h ago

[deleted] — view deleted comment

4

u/zwcbz 2h ago

Quote from the author: “Claude far outpaced me near the finish line. No, Claude flew, and danced, and sparkled near that finish line"

I can't imagine a chef saying such about his knife.

15

u/throwingitaway12324 5h ago

Wayyy too early to say it didn’t provide any insights

12

u/Opulent-tortoise 5h ago

This is nonsense. Yes the models are still alien and don't do math in the "beautiful" abstraction based way humans do. But its pure hubris to think that is some insurmountable barrier the models will never reach. They are creative, in their own way.

-8

u/STDS13 4h ago

They are inherently not creative.

3

u/Aggressive_Still4503 3h ago edited 2h ago

Why?

I think you need to define ‘creative’ here. Because if the conventional definition of creative being ‘using imagination and original ideas to make things, express concepts, or solve problems’ is used, it is pretty apparent AI is creative. It has synthesised and progressed logical and mathematical concepts to construct a novel proof that solves a problem

Perhaps a useful way to gauge creativity (in a ‘I know it when I see it’ sense) is to assume a counterfactual where he publishes and the result as his own work. It is not impossible per se, the solution of Fermat’s Last Theorem is even longer in Lean. Would an observer consider that to be creative? I think so. Even the 900 page paper created by those graduates that was released soon after this has been lauded as novel progress, even when their solution is both incomplete and at places, wrong. This is neither wrong nor incomplete (given what we know now of it having passed the independent kernel checks)

-2

u/STDS13 1h ago

LLMs do not posses imagination or the ability to generate original ideas. They make things, express concepts, and solve problems using purely "historical" data. Its just fuzzy matching until you tell it to stop.

It was used to work towards proving the hypothesis, but the hypothesis already existed.

3

u/Aggressive_Still4503 39m ago edited 29m ago

You are making a lot of assertions but explaining none of them nor their relevance to creativity. For example, regarding your first sentence, what is imagination? What constitutes an original idea and what is the process by which a human being generates an original idea? How does AI idea generation differ from that, and cause it to be incapable of having original ideas?

To be honest, I don’t follow your argument. Your yardstick about the ‘hypothesis’ is quite confusing. I think you need to explain why that’s an appropriate yardstick. I would also appreciate if you address what I have said as to why a reasonable individual might believe they are capable of creativity.

-1

u/STDS13 28m ago

LLMs are shovels.

1

u/Agent_Orange_Tabby 4h ago

Are you saying sushi geniuses are also a thing?

1

u/sky-high-confidence 36m ago

As a human, AI proving the Riemann hypothesis feels like a gut punch.

As our usefulness dwards in comparison to AI's, the world's top leaders are going to soon realize we're nothing more than a burden on the planet.

We have to urgently redefine who we are and who want to be if we're gonna wanna harbor any sense of purpose in our lives.

-2

u/Herosinahalfshell12 5h ago

Why is it important?

0

u/Achacha2026 6h ago

Hal 9000 over here...

-2

u/chaotic-kotik 1h ago

I know that mathematicians are happy with 17M SLOC Lean proof. But as a software engineer I can only laugh at this.

-1

u/calibrono 1h ago

Don't have to maintain it haha

1

u/chaotic-kotik 1h ago

That's not the point. Normally, it'd take humans to build some new math toolset which will allow humans to express the proof in a human comprehensible form. This would bring some new intuitions and understanding and would move the field forward. A proof like that may lead to new discoveries and the new toolset could be used in other fields (e.g. quantum mechanics).

AI proof is not that. It proves and acheives nothing else.

2

u/Redditry199 28m ago

Same old cope is getting old.

Same happened with chess, AI chess is incomprehensible and no human can even get close to beating it, yet all the top ranked players study from AI for better intuition and understanding of the game making moves no human would ever make just 20 years ago. It fundamentally changed how they play and understand the game. Same will happen with math, they will excavate whatever the frick the AI blurted out for higher level understanding.

1

u/chaotic-kotik 12m ago

I struggle to understand how could anyone study from 17M SLOC.

1

u/Redditry199 7m ago

Yeah mathematicians could never abstract from incomprehensible noise. Too bad the tool that helped write the proof could never help understand the proof since ai is a "stochastic parrot" or something.

-4

u/Avoidtolls 5h ago

How to they know the zeros line up infinitely?

-1

u/Fatality 43m ago

Is this another event where someone used AI to check their work and the AI trained on it and stole the credit?

-10

u/fukerrythangohwait 6h ago

What does it mean if the problem has actually been solved by AI? Does it prove that (American) investment in AI to present was generally wise? I don't think it does.

6

u/Aranthos-Faroth 5h ago

American investment?

-33

u/DirkChiversElSoldado 7h ago

I'm sure they read every word of the 250,000 page "proof"

/s

13

u/NotAFishEnt 6h ago

They don't have to. Lean verified the proof; the mathematicians just had to verify that lean was used correctly when verifying the proof.