Not true - the long proof is the verifiable one (because we have it in Lean), the short human solution is the one that can't be verified without a lot of extra work.
> It is all human, with no AI. The hope was to bring Alessandro to Stanford for a year to polish the writing and then announce it after running it by enough people. Now it seems best to put out the current draft.
It's a little like the Patch Gap, but for math proofs.
A timely announcement like this makes me wonder: was the time just "right" for this, in mathematics? What proofs would have come out without AI, in the next few years?
Or, alternatively, did people start working harder in some fashion, even on creative problems that require deep insights, because they felt it was their last chance?
Or, alternatively, are people just (sensibly) starting to post all their work-in-progress results to establish priority (on either the results or approaches used)?
Let's just the shareware approach -- release when you have like 90% of the stuffs but still need time to complete, and promise you will finish it in a year.
The linked proof has been in the works for 12 years and was expected to be worked on for at least another year and was announced early in light of the other GRH announcement.
I don't think anything fundamentally has changed except for the tension introduced by the very real possibility that if you have been working as a human on a math proof for a long time that AI pointed toward the problem you have been working on could scoop you at any time before you get your results out.
It could also be that several mathematicians were already close (after working for decades, like this post). Then AI got its hands on the breadcrumbs, merged them into the weights, and then laundered a path to a solution without a way to trace the credit.
This bugs me and feels much closer to truth than I think OpenAI and Anthropic are acknowledging.
I work as a staff developer at a research institution and it boggles my mind that researchers seem to uncritically use commercial LLM services instead of locally-hosted LLMs.
Could it not also be the case, that mathematicians improved due to AI assistance? Seems far fetched to me, that these highly competitive individuals would not reach for AI assistance in the last few years.
Yes that's probably also true, for the same reason that mathematicians probably improved with the internet.
I guess the main difference is that for a long time it was not acceptable to publish a paper with citations of "I dunno, I wrote this paper by putting literally everyone's paper into a blender".
Is it common for mathematicians to keep a polished version of their work? I'm surprised by how quickly they are able to put work out after it's been contested, and this is 940 pages of well-formatted text, from the looks of it.
It's common for them to type it up as soon as they have some faith that the proof is valid, because that is the version they send to other mathematicians to confirm before the proof is officially published. Brian Conrad was in the process of reviewing this proof, so it makes sense that it's been written up. They were probably waiting to submit it for publication until multiple mathematicians confirmed its validity, but Anthropic forced their hand.
It is said that others have been reviewing this human-written proof for months, so the publication presumably was waiting for the finalization of the reviews, until the Anthropic announcement forced an immediate publication.
Have you tried doing this recently? For my work on software at least, the latest LLMs have a very low false positive rate for bugs. They almost never hallucinate issues. My understanding is the same applies to math.
I'm not saying LLMs aren't useful tools for mathematicians, I'm questioning the quality of discourse that amounts to "I pasted it into the LLM and it said there are errors".
It's being hurriedly announced as fully human work. I wonder if the author had carefully avoided ever running the full argument through frontier LLMs (OpenAI/Anthropic) for fear of it being stolen or incorporated into AI training.
This may be the first time this proof is being proof-read by frontier models
(this is pure speculation, but provides an answer to your question)
Can confirm that current GPT (with no guidance) took 5 minutes to find what it claims are errors with counterexamples. (I have nowhere near the level of state-of-the-art mathematical knowledge and experience needed to validate them. I'm posting this solely as additional confirmation of "there may be issues with this proof that an actual mathematician together with LLM assistance would be able to properly evaluate".)
Now there are two proposals to the GRH. One assisted with AI and one that is all human with ZERO AI.
Both should be put to the test and all of them should be rigorously reviewed, just like FLT and the poincare conjecture. This one is 900 pages rather than 250K pages.
You can see how you cannot assume anything yet as both are still claims. It starts to not make sense to do so with the top post in this thread [0] apply appeal to a singular authority:
"This is Levent Alpöge/Alessandro Masullo. If he says he has Riemann, well then, he has Riemann."
Rather than that, instead we should wait for multiple authorities to review both of them and the one that satisfies the GRH and is verified as the correct solution is the one that we go with.
> It starts to not make sense to do so with the top post in this thread [0] apply appeal to a singular authority
That's a bit uncharitable, I read that comment differently - it's telling you that the person who submitted it has a strong track record. That gives valuable context and credibility.
If this is real, and the results on all sides check out, the author made a HUGE mistake by not publishing a few months ago.
Other mathematicians should take heed. If you've got any ten-year-running projects, take them out of the shadows and into the light, or an Anthropic or OpenAI employee is going to solve your problem when they decide to bother with it and have enough spare compute at hand. And then you'll be scooped, with, at best, a "runner up" trophy.
I'd also add that the time is upon us where hobbyists can solve outstanding problems and prove theorems. The short-lived age of the professional mathematician may be genuinely over.
I don’t agree, because his work is considerably shorter and more comprehensible than the Anthropic proof. That will always have more value than some giant lean proof.
I'd value the meticulous work. I don't think this was a mistake, for one thing how could he have known? Secondly, mathematics is a human activity, whose reward is insight. I'll value the effort and insight -- or what is the point of priority, to prove you are better than the rest? In that case it's already an apples to oranges comparison. Well, it has to be a matter of personal philosophy on whether it's a mistake or not, I guess. Side note, for the record I have no objection in principle to resolving an unsolved questions using AI, the objection is entirely in what I find valuable besides the answer.
> mathematics is a human activity, whose reward is insight
If the author believed that they wouldn't have published now. They did it because one of the rewards for solving a problem is the recognition from your peers for doing so.
I disagree. Why would you feed years of your work to aid an LLM in beating you if you think you’re close to the answer yourself? Furthermore, many mathematicians have referred to the AI proofs as jumbled incomprehensible messes. Humans should continue their work unabated by the threat of some slop paper that claims a solve.
Sorry, most mathematicians don't want to look ridiculous by posting something that doesn't hold up careful scrutiny for something as big as RH. See the ABC conjecture and Mochizuki fiasco for example.
> made a HUGE mistake by not publishing a few months ago
Oh no, they'll lose out on some minor press.
Their work will still stand on it's own and for the people that it matters to, they'll know of him and his work.
The broader public probably wouldn't care much anyways, and solving math problems is going to lose a lot of glamour now that llms can do it to large degree. Not to say that it isn't impressive, but there's a large segement that just wants problems solved and doesn't care if it's done by human or otherwise.
By publishing half a result, the mathematician guarantees an AI will have the chance to build on their work and beat them. How do you expect these people to get grants if all they do is publish half solutions that machines poach?
LLMs are not humans, they don't 'think' yet we use that term to describe what they do. Using the term poach to describe what AI companies are doing is not being done as a parallel to how that term is used by human academics
With that kind of thinking, why don't we all just give a few companies access to all our personal thoughts? That way we can all get partial credit from our favorite LLM company
This also ignores the fundamental question: how do mathematicians get funding from anyone for publishing half complete problems? They can't and it isn't enough to say academia must change. Academia doesn't change until professors die. You're decades away from this sort of change and the people who it harms the most [young academics] have no say in making the changes people are proposing
Will we soon learn that this human-made proof somehow made it to Anthropic pipeline and so their LLM later regurgitated (or at least worked off of) it?
As an academic, can I just say that I for one am happy that, irrespective of the pockets of social mayhem caused by AI rollouts, the acceleration of peer review and publication timelines in academia is a true benefit. I hope more scholars feel compelled to get their ideas out faster now that they might be scooped, like, tomorrow by the next frontier AI model. And I doubly hope that the humanities will speed along quicker, too, not just STEM.
I hope that taking the time to produce a legible write-up instead of releasing the proof up front doesn't bite him back. It would be great if, looking back in history, all contributions to solving the hypothesis were attributed fairly; but that's largely up to mathematicians themselves!
I wonder about the cause and effect. Is this only that this hurried announcement is released in response to Alpöge's publication today, or could Alpöge also have known about another mathematician whose work on proving GRH was close to completion — and felt compelled to release first? Especially given the statement in this draft that "[t]he math is complete".
I don’t like it when people release work they say they’ve been on for a long time, right after someone else publishes the result. I don’t care whether the other person used AI. That’s going to continue and we’d better get used to it.
It’s annoying because if you’d been working on this all that time, you could have made some effort to tell the wider community and get at least some recognition. Posting after someone else has solved it is like claiming you had the winning numbers once the draw is already public.
Did you read the post?
Clearly Alessandro Masullo was talking to people in the field. However, you cannot present all parts publicly when you are not finished yet. Otherwise someone might take your ideas.
Mathematicians are perfectionist, they only publish when they are sure it's correct. And Alessandro Masullo does simply not have the compute resources of anthropic, otherwise he probably would be finished earlier.
It doesn't matter how "principled" someone is, when it comes to over a trillion dollars no one is "principled".
It is very obvious Anthropic is trying to stabilize their stock. They will stop at nothing to ease concerns of investors, and it is apparent they probably stole results.
Nothing more than ego. If you claim to seek the truth, seek the truth. Don't fret if someone finds it before you. I don't care how hard you've worked. The truth is the truth.
Obviously this exact sentiment applies to the Anthropic announcement, so I'm not sure what the point is. If Anthropic cared about the truth and nothing else, then they would have waited until they had a much more succinct proof that could be understood by everybody in the field, so that everyone could be sure of the truth, rather than rushing out a collection of notes to be first in line. If they had no ego, they would have not even attached their (company) name to it at all. It turns out, everybody has an ego and it drives much of our behavior.
900 pages vs 250,000 pages Compression is intelligence
That 250k pages proof would take decades to comprehend and verify. Even if it is factually correct.
Not true - the long proof is the verifiable one (because we have it in Lean), the short human solution is the one that can't be verified without a lot of extra work.
For those who don't eat math for breakfast: "GRH" is the Generalized Riemann Hypothesis [1].
[1] https://en.wikipedia.org/wiki/Generalized_Riemann_hypothesis
> It is all human, with no AI. The hope was to bring Alessandro to Stanford for a year to polish the writing and then announce it after running it by enough people. Now it seems best to put out the current draft.
It's a little like the Patch Gap, but for math proofs.
A timely announcement like this makes me wonder: was the time just "right" for this, in mathematics? What proofs would have come out without AI, in the next few years?
Or, alternatively, did people start working harder in some fashion, even on creative problems that require deep insights, because they felt it was their last chance?
Or, alternatively, are people just (sensibly) starting to post all their work-in-progress results to establish priority (on either the results or approaches used)?
Let's just the shareware approach -- release when you have like 90% of the stuffs but still need time to complete, and promise you will finish it in a year.
The linked proof has been in the works for 12 years and was expected to be worked on for at least another year and was announced early in light of the other GRH announcement.
I don't think anything fundamentally has changed except for the tension introduced by the very real possibility that if you have been working as a human on a math proof for a long time that AI pointed toward the problem you have been working on could scoop you at any time before you get your results out.
It could also be that several mathematicians were already close (after working for decades, like this post). Then AI got its hands on the breadcrumbs, merged them into the weights, and then laundered a path to a solution without a way to trace the credit.
I mean, that's literally how AI works.
This bugs me and feels much closer to truth than I think OpenAI and Anthropic are acknowledging.
I work as a staff developer at a research institution and it boggles my mind that researchers seem to uncritically use commercial LLM services instead of locally-hosted LLMs.
Yes, OAI and Anthropic are in the business of stealing your work and ideas and then reselling it as tokens.
Could it not also be the case, that mathematicians improved due to AI assistance? Seems far fetched to me, that these highly competitive individuals would not reach for AI assistance in the last few years.
Yes that's probably also true, for the same reason that mathematicians probably improved with the internet.
I guess the main difference is that for a long time it was not acceptable to publish a paper with citations of "I dunno, I wrote this paper by putting literally everyone's paper into a blender".
By the linked paper, this has been in the works for 12 years.
> S(G) the space of Schwartz-Bruhat functions on a Hausdorff locally compact abelian group G.
I'm done.
Is it common for mathematicians to keep a polished version of their work? I'm surprised by how quickly they are able to put work out after it's been contested, and this is 940 pages of well-formatted text, from the looks of it.
It's common for them to type it up as soon as they have some faith that the proof is valid, because that is the version they send to other mathematicians to confirm before the proof is officially published. Brian Conrad was in the process of reviewing this proof, so it makes sense that it's been written up. They were probably waiting to submit it for publication until multiple mathematicians confirmed its validity, but Anthropic forced their hand.
It is said that others have been reviewing this human-written proof for months, so the publication presumably was waiting for the finalization of the reviews, until the Anthropic announcement forced an immediate publication.
Yes of course.
I only write up in LaTeX in almost polished form, the unpolished part is in the pen and paper stage.
If it’s written using LaTeX it will look polished and well-formatted without any extra effort.
yikes. I hope this is mostly correct and he gets credit!! :-(
And a retrospective review of all past discoveries, now that who published first does not mater.
man this is all just so insane
@AcerFur (former openai math employee on twitter) claims there are issues with this proof: https://x.com/AcerFur/status/2123853069599547786
Maybe repairable, but either way, alpoge/anthropic certainly has the claim to the first proof
What value is there in just dumping something into an LLM and saying it produced errors?
Have you tried doing this recently? For my work on software at least, the latest LLMs have a very low false positive rate for bugs. They almost never hallucinate issues. My understanding is the same applies to math.
I'm not saying LLMs aren't useful tools for mathematicians, I'm questioning the quality of discourse that amounts to "I pasted it into the LLM and it said there are errors".
It's being hurriedly announced as fully human work. I wonder if the author had carefully avoided ever running the full argument through frontier LLMs (OpenAI/Anthropic) for fear of it being stolen or incorporated into AI training.
This may be the first time this proof is being proof-read by frontier models
(this is pure speculation, but provides an answer to your question)
Can confirm that current GPT (with no guidance) took 5 minutes to find what it claims are errors with counterexamples. (I have nowhere near the level of state-of-the-art mathematical knowledge and experience needed to validate them. I'm posting this solely as additional confirmation of "there may be issues with this proof that an actual mathematician together with LLM assistance would be able to properly evaluate".)
And that is the problem.
AI claims but too few people can check.
Won‘t get better from now on
I mean I guess there is incentive for some human curiosity and trying to learn more than ever, small bit but still to get a standard for verification.
Wow, I wasn't expecting this for sure. On the same year a human mathematician attempting full GRH?!
There have been many _attempts_, most of which probably have never been published
Now there are two proposals to the GRH. One assisted with AI and one that is all human with ZERO AI.
Both should be put to the test and all of them should be rigorously reviewed, just like FLT and the poincare conjecture. This one is 900 pages rather than 250K pages.
You can see how you cannot assume anything yet as both are still claims. It starts to not make sense to do so with the top post in this thread [0] apply appeal to a singular authority:
"This is Levent Alpöge/Alessandro Masullo. If he says he has Riemann, well then, he has Riemann."
Rather than that, instead we should wait for multiple authorities to review both of them and the one that satisfies the GRH and is verified as the correct solution is the one that we go with.
[0] https://news.ycombinator.com/item?id=50574968
> It starts to not make sense to do so with the top post in this thread [0] apply appeal to a singular authority
That's a bit uncharitable, I read that comment differently - it's telling you that the person who submitted it has a strong track record. That gives valuable context and credibility.
> This one is 900 pages rather than 250K pages.
This one can't be verified with certainty on a computer (yet) while the other one can be.
If this is real, and the results on all sides check out, the author made a HUGE mistake by not publishing a few months ago.
Other mathematicians should take heed. If you've got any ten-year-running projects, take them out of the shadows and into the light, or an Anthropic or OpenAI employee is going to solve your problem when they decide to bother with it and have enough spare compute at hand. And then you'll be scooped, with, at best, a "runner up" trophy.
I'd also add that the time is upon us where hobbyists can solve outstanding problems and prove theorems. The short-lived age of the professional mathematician may be genuinely over.
I don’t agree, because his work is considerably shorter and more comprehensible than the Anthropic proof. That will always have more value than some giant lean proof.
Damned if you do, damned if you don't.
Keep your work secret and you'll get scooped. Make partial progress public and they'll ingest it into the model and scoop you anyway.
I'd value the meticulous work. I don't think this was a mistake, for one thing how could he have known? Secondly, mathematics is a human activity, whose reward is insight. I'll value the effort and insight -- or what is the point of priority, to prove you are better than the rest? In that case it's already an apples to oranges comparison. Well, it has to be a matter of personal philosophy on whether it's a mistake or not, I guess. Side note, for the record I have no objection in principle to resolving an unsolved questions using AI, the objection is entirely in what I find valuable besides the answer.
> mathematics is a human activity, whose reward is insight
If the author believed that they wouldn't have published now. They did it because one of the rewards for solving a problem is the recognition from your peers for doing so.
insight can only come with bread on the table no?
I suspect history will celebrate the human author
I disagree. Why would you feed years of your work to aid an LLM in beating you if you think you’re close to the answer yourself? Furthermore, many mathematicians have referred to the AI proofs as jumbled incomprehensible messes. Humans should continue their work unabated by the threat of some slop paper that claims a solve.
Sorry, most mathematicians don't want to look ridiculous by posting something that doesn't hold up careful scrutiny for something as big as RH. See the ABC conjecture and Mochizuki fiasco for example.
Circumstances have changed. I think the community will understand; everybody is in the same position, after all.
> made a HUGE mistake by not publishing a few months ago
Oh no, they'll lose out on some minor press.
Their work will still stand on it's own and for the people that it matters to, they'll know of him and his work.
The broader public probably wouldn't care much anyways, and solving math problems is going to lose a lot of glamour now that llms can do it to large degree. Not to say that it isn't impressive, but there's a large segement that just wants problems solved and doesn't care if it's done by human or otherwise.
Well but you wouldn't want to rush it out in case there's a mistake and then you'd look like an idiot, which in math circles is tantamount to treason.
This.
Publish what you got, when you got it, or get overtaken by someone who will.
By publishing half a result, the mathematician guarantees an AI will have the chance to build on their work and beat them. How do you expect these people to get grants if all they do is publish half solutions that machines poach?
Because it's more credit than nothing. Also, building on others' work is not "poaching".
LLMs are not humans, they don't 'think' yet we use that term to describe what they do. Using the term poach to describe what AI companies are doing is not being done as a parallel to how that term is used by human academics
With that kind of thinking, why don't we all just give a few companies access to all our personal thoughts? That way we can all get partial credit from our favorite LLM company
This also ignores the fundamental question: how do mathematicians get funding from anyone for publishing half complete problems? They can't and it isn't enough to say academia must change. Academia doesn't change until professors die. You're decades away from this sort of change and the people who it harms the most [young academics] have no say in making the changes people are proposing
> This.
This... what?
Will we soon learn that this human-made proof somehow made it to Anthropic pipeline and so their LLM later regurgitated (or at least worked off of) it?
As an academic, can I just say that I for one am happy that, irrespective of the pockets of social mayhem caused by AI rollouts, the acceleration of peer review and publication timelines in academia is a true benefit. I hope more scholars feel compelled to get their ideas out faster now that they might be scooped, like, tomorrow by the next frontier AI model. And I doubly hope that the humanities will speed along quicker, too, not just STEM.
I hope that taking the time to produce a legible write-up instead of releasing the proof up front doesn't bite him back. It would be great if, looking back in history, all contributions to solving the hypothesis were attributed fairly; but that's largely up to mathematicians themselves!
I wonder about the cause and effect. Is this only that this hurried announcement is released in response to Alpöge's publication today, or could Alpöge also have known about another mathematician whose work on proving GRH was close to completion — and felt compelled to release first? Especially given the statement in this draft that "[t]he math is complete".
Is the method for this similar to Anthropic's or independent?
It was literally published an hour ago. Have patience :)
i was here
I don’t like it when people release work they say they’ve been on for a long time, right after someone else publishes the result. I don’t care whether the other person used AI. That’s going to continue and we’d better get used to it.
It’s annoying because if you’d been working on this all that time, you could have made some effort to tell the wider community and get at least some recognition. Posting after someone else has solved it is like claiming you had the winning numbers once the draw is already public.
Did you read the post? Clearly Alessandro Masullo was talking to people in the field. However, you cannot present all parts publicly when you are not finished yet. Otherwise someone might take your ideas.
Mathematicians are perfectionist, they only publish when they are sure it's correct. And Alessandro Masullo does simply not have the compute resources of anthropic, otherwise he probably would be finished earlier.
That still grants you the prize
It doesn't matter how "principled" someone is, when it comes to over a trillion dollars no one is "principled".
It is very obvious Anthropic is trying to stabilize their stock. They will stop at nothing to ease concerns of investors, and it is apparent they probably stole results.
Nothing more than ego. If you claim to seek the truth, seek the truth. Don't fret if someone finds it before you. I don't care how hard you've worked. The truth is the truth.
It is okay to value human achievement.
I do. Artificial intelligence is human progress.
There's likely at least one pretty big monetary prize at stake.
How do you know who found it first?
If you're unsure if your proof is correct, you haven't proven it.
Obviously this exact sentiment applies to the Anthropic announcement, so I'm not sure what the point is. If Anthropic cared about the truth and nothing else, then they would have waited until they had a much more succinct proof that could be understood by everybody in the field, so that everyone could be sure of the truth, rather than rushing out a collection of notes to be first in line. If they had no ego, they would have not even attached their (company) name to it at all. It turns out, everybody has an ego and it drives much of our behavior.
Don't you have an IPO to take care of, Dario?
I highly doubt that they would've rushed the publication if it were not Anthropic making extraordinary claims first.
In this age no one will remember your name anyways.