There's usually a reasonably strong correlation between thinking level and visual quality of the pelican. This is the first time I've seen that correlation appear to break - more reasoning tokens doesn't seem to produce an obviously better SVG.
It does pretty insane to me that only on max setting (and after waiting 27 seconds) did you actually manage to receive an SVG where the pelican's legs are straddling the bike correctly.
Luna 6 is getting a bit long in the teeth now. It's two full months old, but it was only a slight step above Luna 5.6, which was already four months old (Imagine saying this about anything else). So I'm not too surprised that a newer small model is beating it handily. I've been hoping for Luna 6.1/2 as the next model release for a few days now.
I'm always a bit surprised to see Meta talking about models. They have become (almost*) entirely irrelevant to the LLM race, which is weird because their AI lab used to be decent before LLM was cool.
What happened to zuck? Was the metaverse this destructive?
Isn't Muse Wonder at or at least very close to the frontier? Considering they essentially started from scratch after rebooting their AI efforts post-Llama 4 about a year ago it's pretty solid progress.
Six effort levels (minimal, low, medium, high, xhigh, max), so here are six pelicans (actually five, "high" didn't return a complete SVG):
https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
There's usually a reasonably strong correlation between thinking level and visual quality of the pelican. This is the first time I've seen that correlation appear to break - more reasoning tokens doesn't seem to produce an obviously better SVG.
It does pretty insane to me that only on max setting (and after waiting 27 seconds) did you actually manage to receive an SVG where the pelican's legs are straddling the bike correctly.
Wow, minimal seems to be the best here interestingly. Only 10 reasoning tokens so basically none?
Is there a problem if I like the minimal more than the others?
Incredible. How do you get these out so fast?
Model refusals should be a -ve score, not zero?
Treating the refusal as a 0 score erases the difference between lack of capability and a lack of willingness to perform.
Super frustrating that I still can’t give Muse Wonder Full a spin.
I believe this is what the “crouton alpha” stealth model was
https://openrouter.ai/stealth/crouton-alpha
Luna 6 is getting a bit long in the teeth now. It's two full months old, but it was only a slight step above Luna 5.6, which was already four months old (Imagine saying this about anything else). So I'm not too surprised that a newer small model is beating it handily. I've been hoping for Luna 6.1/2 as the next model release for a few days now.
Uniquely among models I've tried, Luna 6 is infuriatingly lazy. As if it expects me to do the work, unaware that it is a tool.
I'm always a bit surprised to see Meta talking about models. They have become (almost*) entirely irrelevant to the LLM race, which is weird because their AI lab used to be decent before LLM was cool.
What happened to zuck? Was the metaverse this destructive?
(*) Feeling charitable today
Isn't Muse Wonder at or at least very close to the frontier? Considering they essentially started from scratch after rebooting their AI efforts post-Llama 4 about a year ago it's pretty solid progress.
Meta is trying to stay relevant. They fell behind after llama 4, hired new talent and re-organized.
They have started to catch up; the Spark series is good.