I expect this to be another revenue stream. My guess is that there will be an accreditation step and afterwards you get access to an unlocked model. Just as in security. And possibly it will come with a price tag.
This already exists with Mythos. You can apply to get approved for cybersecurity testing, which is relatively easy if your need to just test your own software. But Mythos is accessible only through the API, not through your subscription, so you will be paying quite a bit for it.
or you have to have your organization approved so then everything will be done through approved "partners" I.e. consulting companies who add their own markup ontop of everything. we're already seeing this with Mythos
Do you mean 'skill for a human' or 'Skill for an LLM'? :)
I used to do bioinformatics, although more of the structure side than sequence. Like an information or understanding, it depends on what outcome you want that might benefit from the skill.
I suppose that predicting the next amino acid in a sequence would be useful for, say, reconstructing a protein sequence from fragments. Or constructing evolutionary trees of sequences by predicting the common ancestors?
I'm not sure how to phrase this correctly sorry, But I suppose the question I have is what comes after say "reconstructing a protein sequence from fragments" -> like what how does one go from this to developing a drug or enzyme. Is being able to predict the next amino acid useful in this process ?
Linking to ML space, is this analogous to knowing the model's weights byheart ? Traditionally this has been not useful to humans and machines, but recently some LLMs have started showing capability to directly edit the model weights to alter the behavious of smaller models. Is that a completely wrong analogy ?
Also I guess what I am partly curious is on how this data ended up in the model. Was it part of the pretraining corpus or was there an RL environment which specifically rewarded this behaviour
Ok the next steps beyond predicting a sequence would then be modelling the structure - which requires something like AlfaFold or 'traditional' (as it were) software for molecular mechanics and dynamics.
How useful the predicted sequence is for the predicted structure - and predicted function - no idea! There are already several layers of prediction here.
Sorry, I definitely do not know enough about LLMs to understand the analogy to weights. You can predict the effects of mutations on sequences, I think? As in, if I change this Q to an E will it make the enzyme faster (??). Perhaps you could LLM-generate a plausible member of a family of enzymes with a particular function, given fragments of an existing protein (???).
No idea how the data got in the model. It seems like the study that Xinming and Chen have done was designed to eliminate sources from the general corpus of knowledge - like any old science papers - b choosing obscure and rare sequences that might only be found in a sequence db.
I guess predicting the next amino acid is about as useful as predicting the next word in a sentence - that is to say the task itself is not interesting but a. there is plenty of data to train on that does not need to be labeled by a human and b. hopefully this meaningfully improve performance on tasks we care about.
They both depend on how much generalisation you can get behind it. Next token prediction can go from spitting out the most common token after the previous one, to a deep understanding of the text that precedes, from syntax to semantics.
You, however, will be banned for "biosecurity" research. Or, as Amodei puts it, "you can't have opensource models because with them you can't ban users"
No doubt that all of them, except maybe Gemini, surely were trained on SciHub and all books + data they could download from torrents and other sources, as well. That could include leaked personal data and proprietary copyrighted material, from anywhere maybe even including Darknet. Add to that public patent registry and the book buyout and scanning campaigns that occur.
I am certain that all these companies have stored and backed up all they could find, so that it can't be taken away from them.
Curious: how can there be a correct prediction for the next element of a "shuffled" protein? The shuffled proteins don't occur in real life, so what makes one answer correct and another incorrect?
> Shuffling keeps the letters and destroys their order, so the difference in accuracy measures what the model knows about the sequence itself.
So by analogy, if you know a word in English starts with 'Q', you could reasonably predict the next letter would be 'u'. By shuffling, you might encounter the letter Q later on, and not successfully predict a 'u'.
Put another way, the shuffled sequences can only use frequency analysis for prediction, while the unshuffled ones have local and global order signals.
We are definitely going beyond the borders of my understanding of sequences here, but I would guess the source of truth is just the expected frequency distribution of amino acids? So 'G' (glycine) is most frequent, and something like 'W' (tryptophan) is least frequent (dependent on organism?).
However I thought the point was that the _difference_ between the shuffled prediction and the unshuffled is the measure here. So shuffled is the baseline, and the gap above that is how good the prediction is.
Claude just blocks from anything in this field. Can't even work with my own DNA without triggering opus 5.5 50% of the time
I expect this to be another revenue stream. My guess is that there will be an accreditation step and afterwards you get access to an unlocked model. Just as in security. And possibly it will come with a price tag.
https://www.anthropic.com/news/life-sciences-verification-pr...
It already exists
This already exists with Mythos. You can apply to get approved for cybersecurity testing, which is relatively easy if your need to just test your own software. But Mythos is accessible only through the API, not through your subscription, so you will be paying quite a bit for it.
Are you sure about this? I’m verified for cybersecurity uses and I can use mythos with no issues with my subscription.
or you have to have your organization approved so then everything will be done through approved "partners" I.e. consulting companies who add their own markup ontop of everything. we're already seeing this with Mythos
What does "triggering it" look like in this case? Does it want verification that it's really your own DNA?
https://wallhop.io/http://xinmingtu.cn/blog/2026/claude-opus...
Is this a valuable skill ? Sorry, bit of a noob question ig but have been seeing a lot of buzz around protein sequences in general
Do you mean 'skill for a human' or 'Skill for an LLM'? :)
I used to do bioinformatics, although more of the structure side than sequence. Like an information or understanding, it depends on what outcome you want that might benefit from the skill.
I suppose that predicting the next amino acid in a sequence would be useful for, say, reconstructing a protein sequence from fragments. Or constructing evolutionary trees of sequences by predicting the common ancestors?
I'm not sure how to phrase this correctly sorry, But I suppose the question I have is what comes after say "reconstructing a protein sequence from fragments" -> like what how does one go from this to developing a drug or enzyme. Is being able to predict the next amino acid useful in this process ?
Linking to ML space, is this analogous to knowing the model's weights byheart ? Traditionally this has been not useful to humans and machines, but recently some LLMs have started showing capability to directly edit the model weights to alter the behavious of smaller models. Is that a completely wrong analogy ?
Also I guess what I am partly curious is on how this data ended up in the model. Was it part of the pretraining corpus or was there an RL environment which specifically rewarded this behaviour
Ok the next steps beyond predicting a sequence would then be modelling the structure - which requires something like AlfaFold or 'traditional' (as it were) software for molecular mechanics and dynamics.
How useful the predicted sequence is for the predicted structure - and predicted function - no idea! There are already several layers of prediction here.
Sorry, I definitely do not know enough about LLMs to understand the analogy to weights. You can predict the effects of mutations on sequences, I think? As in, if I change this Q to an E will it make the enzyme faster (??). Perhaps you could LLM-generate a plausible member of a family of enzymes with a particular function, given fragments of an existing protein (???).
No idea how the data got in the model. It seems like the study that Xinming and Chen have done was designed to eliminate sources from the general corpus of knowledge - like any old science papers - b choosing obscure and rare sequences that might only be found in a sequence db.
I guess predicting the next amino acid is about as useful as predicting the next word in a sentence - that is to say the task itself is not interesting but a. there is plenty of data to train on that does not need to be labeled by a human and b. hopefully this meaningfully improve performance on tasks we care about.
They both depend on how much generalisation you can get behind it. Next token prediction can go from spitting out the most common token after the previous one, to a deep understanding of the text that precedes, from syntax to semantics.
What's more surprising is that the other models aren't
Gemini should be good at naming the next sugar in a polysaccharide. :)
You, however, will be banned for "biosecurity" research. Or, as Amodei puts it, "you can't have opensource models because with them you can't ban users"
No doubt that all of them, except maybe Gemini, surely were trained on SciHub and all books + data they could download from torrents and other sources, as well. That could include leaked personal data and proprietary copyrighted material, from anywhere maybe even including Darknet. Add to that public patent registry and the book buyout and scanning campaigns that occur.
I am certain that all these companies have stored and backed up all they could find, so that it can't be taken away from them.
Curious: how can there be a correct prediction for the next element of a "shuffled" protein? The shuffled proteins don't occur in real life, so what makes one answer correct and another incorrect?
It is a rather odd control. Is it just to confirm that Claude isn't reading the sequence off disk?
Perhaps. They explain why:
> Shuffling keeps the letters and destroys their order, so the difference in accuracy measures what the model knows about the sequence itself.
So by analogy, if you know a word in English starts with 'Q', you could reasonably predict the next letter would be 'u'. By shuffling, you might encounter the letter Q later on, and not successfully predict a 'u'.
Put another way, the shuffled sequences can only use frequency analysis for prediction, while the unshuffled ones have local and global order signals.
Yes but what is the source of truth for the next element of a shuffled sequence?
For a natural sequence, the observed molecule in nature is the source of truth.
We are definitely going beyond the borders of my understanding of sequences here, but I would guess the source of truth is just the expected frequency distribution of amino acids? So 'G' (glycine) is most frequent, and something like 'W' (tryptophan) is least frequent (dependent on organism?).
However I thought the point was that the _difference_ between the shuffled prediction and the unshuffled is the measure here. So shuffled is the baseline, and the gap above that is how good the prediction is.
So the american "government", "apparently", goes full steam in to develop biological weapons (of which, as usually, they accuse others).
stop being anti vax