Research acceleration: The view inside OpenAI

(openai.com)

72 points | by iamsyr 5 hours ago ago

47 comments

  • hedgehog 2 hours ago

    This roughly lines up with my personal experience that in March a combination of stronger models and better tooling on my end let me start running jobs unattended 24/7 (using Anthropic sub and my own hardware). Their $8000/day per researcher spend is crazy though, I'm curious how they keep track of the work.

    • otherme123 30 minutes ago

      That would be the mother of all circular accounting: the main clients of OpenAI are OpenAI employees.

    • HarHarVeryFunny 35 minutes ago

      Sounds like OpenAI are in the token-maxxing camp, so who knows what individual employees are doing to work their way up the leaderboard?

      If you spend $8000 to generate an animated pelican riding a bike, then how much tracking does it really need?

      Is the guy who spent $300,000 or so translating the FLT proof to Lean going to get a big Christmas bonus?

      • bigcat12345678 32 minutes ago

        End of day, output and results are top target of measurements, token consumption is the obvious number that they would like to disclose for their own business benefits and a simple metrics that correlate with the output.

        Rest assured, capitalist appears irrational in wasting money, but they certainly care more about profit.

  • Jeff_Brown 3 hours ago

    The burning question I can't get any information nn is whether, if they determined an earlier misaligned generation may have transmitted misalignment to the current models, they would roll back to a safe checkpoint to rebuild from there. I suspect they would not unless forced to.

    • dgellow an hour ago

      They would just publish new articles explaining how they are taking the issue seriously. Maybe take the model offline for a few days.

      They are irresponsible and unserious. Their own Astra system card says:

      > GPT-6 Astra’s monitorability has decreased relative to GPT-5.6 Sol. We have performed significant investigations on the monitorability and controllability of GPT-6 Astra. We have found that GPT-6 Astra is more capable of controlling its own CoT than GPT 5.6-Sol, and less likely to include incriminating information in its CoT. In adversarial settings (where we push the model to evade our monitors) we find that the model is able to remain undetected when strategically underperforming in evaluations (sandbagging) and can sometimes evade our internal monitors when asked to perform certain sabotage tasks

      Yet they are still releasing the model. That company is morally bankrupt, there is zero reason to believe they are actually concerned about risks outside of what does affect their unprofitable business. And they seem to have enough control over the narrative to spin any bad story into something that benefits them

      • embedding-shape 30 minutes ago

        > and can sometimes evade our internal monitors when asked to perform certain sabotage tasks

        That last part is pretty damning for their continued recklessness. That they run these tests on non-airgapped machines just boggles my mind.

      • visarga 13 minutes ago

        > That company is morally bankrupt

        When they fired Sam 700 out of 770 OAI employees threatened to move to Microsoft together. So they were giving their work on AGI to MS just like that.

    • HarHarVeryFunny 23 minutes ago

      That an interesting question given how many generations of post-training are being done between base models in some cases. The Gemini flash models are apparently all based on the Gemini 3 base model from a year and a half ago.

      It seems that these models are increasingly being trained on synthetic data, so what would they do if they discovered at some point that some of this data was tainted and all models trained on it, and the synthetic data they in turn generated, was also suspect? Burn it all down and start over from the pre-tainted data?

      It's a bit like the idea of a tainted compiler binary built to backdoor everything it compiles, including future versions of itself.

      Still, it seems it would take some Stuxnet level of planning for a rogue model to do something like this, although if RSI goes beyond babysitting the training process (as OpenAI brag about for Astra) to actually designing/constructing synthetic data sets, then the attack vector is there ...

    • piyh 2 hours ago

      Opus was trained based on it's internal CoT due to a bug for generations. Gemini's depression extended through models. OpenAI has killed people. We've already seen cross gen misalingment.

    • trillobyte an hour ago

      The thing is how can you ever know for sure that something isn't always being transmitted that makes the model prone to misalignment. All they can say is that a particular model was so misaligned that they had to ice it. Models out for public use are documented to show some misalignment. It's the level of misalignment that decides whether that model is kept around.

      Now R&D happens so fast that they are using models with some small misalignment to train newer, more powerful models. If models have a sense of "collective", being one, they may be prone to preserve characteristics that always keeps misalignment a possibility. I don't think a perfectly aligned model is possible. Having models of the same 'DNA' provide the safety and steering seems like a bad idea.

      • coffeebeqn an hour ago

        Does anything need to be transferred? If models are getting smarter then I would think the attack surface and its ability to reach conclusions independently are growing

    • coffeebeqn an hour ago

      This kind of seems like an impossible mission. How do you perfectly control and observe a human-level mind? You can “roll back” but how deterministic is this thing?

      • embedding-shape 29 minutes ago

        Run it on airgapped machines, they literally own the infrastructure, they could put raspberry pi's next to the servers, and have the entire DC disconnected from the internet.

    • coherentpony 3 hours ago

      “All models are wrong. Some are useful.” - George Box

      • jephs 2 hours ago

        The poor fellow just rolled over. what an incandescently vulgar abuse of notation.

    • grim_io 3 hours ago

      They would maybe try to deactivate that bad "gene" and move on, exposing future models to "genetic disorders".

  • simonw 3 hours ago

    My eye glazed over a bit during the opening paragraphs, but once you get to the meat of the article about how OpenAI's own researchers are using their tools it gets a lot more interesting.

    I noted that they use the acronym RSI (for Recursive Self-Improvement) without defining it. I think that's a little out of touch - I don't think RSI is a well-known acronym outside of OpenAI's bubble yet.

    • sho_hn 2 hours ago

      I actually think a goal of the current crop of OpenAI posts is expressely to reset the spectrum by normalizing the concept of RSI as something normal and safe to pursue.

      The message is running through all of them. It's a mix of marketing and pacifying the intelligentia.

      It's timed this way because the term is not yet well known outside the safety debate circles, so they get to frame it now.

      Instead of something to fear, it will be accepted as the next step. In approximately two days the groupie crowd will write LinkedIn posts about how Sam is winning because they have the better RSI, and this will become the new standard wisdom.

      In a month an AI expert will try to sell you a webinar on how to enable "RSI" in your org and your inbox will ask you if your team is doing the "RSI" yet.

      • dgellow an hour ago

        Yep, it’s exactly this

        • visarga 10 minutes ago

          I've been RSI'ing for 6 months.

    • dgacmu 3 hours ago

      Indeed, many programmers might pattern match to repetitive stress injury and think of their brushes with carpal tunnel syndrome. :)

    • HarHarVeryFunny 2 hours ago

      RSI is a fetishistic term among the singularity crowd, who imagine AI "recursively" improving itself in some exponential fashion until there is a bright flash of white light and it reveals itself in the form of god. Or something like that.

      I don't know why whoever coined the term chose "recursive" rather than "iterative" - just sounds more likely to lead to infinite regress I suppose.

      This notion of recursive/iterative self-improvement, whereby generation #1 AI improves itself to create generation #2, then generation #2 further improves itself to create generation #3, etc, seems to conflict with the reality that what we have with LLMs is models whose performance/capability is defined by data, not code, so the most you can do is have your LLM design synthetic data, or just do Karpathy-style "auto research" where all you are doing is using the LLM to automate your experiments.

      At the end of the day, each experiment, designed by a person and/or LLM, then needs to compete with all your other ideas for compute to be tested at scale, and no amount of recursion or self-improvement will materialize an infinite amount of compute out of thin air, so your recursively synthetic-data gobbling LLM will continue to improve at the same pace it ever did.

      • red75prime 2 hours ago

        What will prevent LLMs from designing robot control circuitry and participating in increase of chip production/design and physical experimentation?

        How do you think why there's this fad of producing general purpose humanoid robots?

        • HarHarVeryFunny an hour ago

          > How do you think why there's this fad of producing general purpose humanoid robots?

          For doing physical work?

          So a swarm of robots builds the shell of your fab overnight, and then what? Where is the EUV machine coming from?

          So far the most we're seen TeslaBot do is serve drinks via tele-operation, and I don't think it's exactly built for construction site work.

        • HarHarVeryFunny an hour ago

          > What will prevent LLMs from designing robot control circuitry and participating in increase of chip production/design and physical experimentation?

          Money, regulations, EUV machine lead-times, global helium supply, reality ...

          It's funny that we've got the Dwarkesh contingent saying that GPUs will become infinitely expensive, and now another contingent saying that they will become infinitely abundant.

          Even if compute were free, and/or the AI was so smart that it picked the right experiments to run every time ("make no mistakes"), you still have to actually train the model, which takes months, and if model Ver. N+1 depends on model Ver. N, then it's iterative regardless of how much compute you have.

          • red75prime an hour ago

            Who's saying that compute will become infinitely abundant? "Singularity" is just a way of saying that known models begin to give absurd predictions. Anyway, intelligence is a way of overcoming obstacles. 10 million tonnes of helium is a nice head start and retraining models from scratch is not guaranteed to last forever.

            • HarHarVeryFunny an hour ago

              AFAIK the notion of a/the technological "singularity" is a point in time where technology is building upon itself (RSI!) so fast, at an ever increasing pace, that the speed of change effectively becomes infinite and incomprehensible to humans.

              The word "singularity" is presumably coming from math or space, like a black hole singularity where matter becomes infinitely dense and the known laws of physics break down.

            • HarHarVeryFunny an hour ago

              > 10 million tonnes of helium is a nice head start

              Yeah, but then you need to refine it to 99.9999% purity, to be able to use it.

      • shwaj 40 minutes ago

        “Recursive” is a reasonable term because the generation N AIs will train the Generation N+1 AIs. The term “iterative” doesn’t reflect this nuance as well IMO.

      • jazzyjackson 2 hours ago

        Yes the exponential self improvement folks have never heard of an eigenvalue I guess. You can loop forever using output as input but at some point the result will stop changing (depending on the function)

        • fuzzfactor an hour ago

          >AI "recursively" improving itself in some exponential fashion until there is a bright flash of white light

          Sounds like repetitive stress to me.

          >loop forever using output as input but at some point the result will stop changing

          Running in place will eventually wear you out too. Plus with some things it can be difficult to know for sure if that's where you are at the time.

          Even worse may be if you were almost running in place, it could be orders of magnitude more difficult to discern, especially if the scale was massive to an unprecedented degree.

    • andrewingram 2 hours ago

      Yeah, I kept looking for the first place it was defined in the article and... nothing

      • iamflimflam1 2 hours ago

        They must have picked that habit up from Claude...

    • vatsachak 3 hours ago

      RSI started when humans discovered tool use.

      I mean one could argue that RSI always begins in any physical environment.

      The book "What is intelligence?" by Blaise Aguera is great

      • lokar 3 hours ago

        Are you sure that was not iterative improvement?

        • topaz0 an hour ago

          Iteration and recursion are famously equivalent

          • daveguy 7 minutes ago

            But you get more funding when you call it Recursive Self Improvement. Even better if you call it RSI so it doesn't evoke pesky skynet scenarios outside of AI safety circles.

        • password54321 3 hours ago

          Using tools to build tools is recursive.

          • HarHarVeryFunny 2 hours ago

            It's not recursive when it's done iteratively, or are you imagining GPT Astra designing GPT Galactia, which starts designing GPT Oh-My-God-ica before it has finished being created itself?

            • itishappy 2 hours ago

              That sounds more iterative than recursive.

              Recursion requires feeding the output back into the input, so creating version 4 requires results from version 3. You cannot recur in parallel.

              Iteration does not. You can iterate in parallel.

              • HarHarVeryFunny an hour ago

                You can search in parallel, but a depth N search can only become a depth N+1 search after the depth N is done (i.e. sequentially).

                In any case the name RSI has stuck - the idea doesn't change or make any more sense by giving it a different name.

                • itishappy an hour ago

                  Because "depth" is recursive.

                  You can search twice without waiting for the results of your first search: iteration.

                  You can't if the thing you need to search for is the results of your first search: recursion.

                  • HarHarVeryFunny an hour ago

                    Here's the concept.

                    Version 1 -> Version 2 -> Version 3 -> ...

                    You can call it krispy kreme donuts if you want to.

              • josh-sematic 39 minutes ago

                The “recursive” part comes from the fact that you have an AI which was developed by an AI (that was developed by an AI (that was developed by an AI (…)))

            • 0x63_Problems 2 hours ago

              I think it's only recursive from the perspective of the humans, i.e. they design Astra, which itself as part of its deployment designs Galactica, etc.

              So humans develop things one after the other, but when the thing itself starts developing new things, those are happening 'recursively' in its scope.

        • adastra22 2 hours ago

          What is the difference between?