Gemini 4 Argon (deepmind.google)
svara 3 hours ago
This is a clear step change, I'm genuinely amazed.
Its answers are to-the-point, logically structured, clearly written. Like a really well made mini essay on your question.
It also really likes to build little simulations / models that you can tweak the parameters on. Amazing to explore how different assumptions affect economic scenarios, for example.
It's also great at picking (sourced) illustrations.
I'll be using this for everything that isn't coding from now on.
A_D_E_P_T 2 hours ago
halJordan 2 hours ago
holaysuns 2 hours ago
glouwbug an hour ago
WillPostForFood an hour ago
taneq 42 minutes ago
becquerel 20 minutes ago
HSO an hour ago
why? is it not so good on that? or is there something better performance, or better price for same performance?
A_D_E_P_T an hour ago
That said, I'm extremely impressed with Argon thus far. I take back everything bad I've ever said about their AI strategy. Argon is very good and very fast. It might be competitive at coding, but it's too early to say.
fonrex 22 minutes ago
VirusNewbie an hour ago
jwpapi 30 minutes ago
drob518 15 minutes ago
da_chicken 5 minutes ago
postalcoder 6 hours ago
I've been trying it out via the API and the model has been a delight so far. Clear in the head, not RL-fried, distinct writing style, and big model smell. That said, the em-dash is back w/ this model.
That said, I would be so frustrated with Sundar Pichai if I was on the Google team. The botched rollout of this model seems to be entirely a matter of capacity, and Pichai has been more than happy to give it to anybody but his own team.
algoth1 6 hours ago
thmorriss 3 hours ago
kypro 3 hours ago
I think there was a lot of misplaced hate of the em-dash due to all the low-qualify AI slop people were trying to pass off as their own for a while.
algoth1 an hour ago
leoooodias 3 hours ago
johnisgood 3 hours ago
gfody an hour ago
Quarrel 2 hours ago
If you just want good llm text, it’s great.
postexitus 6 hours ago
postalcoder 6 hours ago
At the same time, OpenAI had a disastrous dev day that led a lot of users to jump ship to Claude.
Couple weeks later, Gemini-4-argon is still unavailable on anything less than the ultra tier, which means there's no natural funnel to get ppl to pay for the more expensive ultra plan other than "trust us the model is good".
If Google had argon broadly available earlier this month they would have picked up a ton of new users.
kranke155 5 hours ago
Narrating this as if it’s the game of thrones is a fun exercise, but it’s just becoming commonplace now that models jump ahead of each other on a weekly to Monthly basis.
postalcoder 5 hours ago
Do you really think people in google are happy about how long it took to release this model?
rebolek 3 hours ago
nomel 4 hours ago
This was part of the issue, as stated in their comment. We couldn't jump around to try it for the reason that is wasn't made available to, as you say, "all the power users".
msabalau 5 hours ago
I mean, I heard rumors too that it would be ultra only, but that doesn't seem to be the case, unless you are specifically talking about antigravity?
Realistically, market adoption isn't going to be the result of terminally online people (like me, I confess) following things way too closely on social.
mrybczyn 5 hours ago
topspin 3 hours ago
reportingsjr 3 hours ago
doodlesdev 5 hours ago
edit: just a few hours after this comment I got access to Gemini 4 on the Gemini app. Yayy! :)
Ternari 2 hours ago
https://blog.google/innovation-and-ai/models-and-research/ge...
doodlesdev 16 minutes ago
asdfman123 5 hours ago
Models move so fast now and Google is very cautious about releasing them.
justinhj 4 hours ago
varispeed 3 hours ago
Then basic mistakes (inferring wrong information from the given text, hallucinations...). Gemini is okay for some absolute basics and the rest of the work goes to actual frontier models.
jimjimjim 3 hours ago
BoorishBears 3 hours ago
asdfman123 2 hours ago
user_7832 an hour ago
Ofc I know this isn't your fault in person, but I really wish Google would get its shit together.
...As a long time tech enthusiast I should probably stop being so delusional. Heh (cries internally)
1: lol I know who cheers for a trillion dollar company but I'd rather not cheer for OpenAI
vardump an hour ago
asdfman123 an hour ago
As a Google employee my defense is it's hard for a company this big to move fast, but I can understand how Google customers would be annoyed.
BoorishBears 13 minutes ago
The top level comment blamed cheerleading but let's apply critical thinking for a second as product people and look at the funnel:
1. Potential users sees new release 2. Potential user takes time to install and set up Google harness (you already lost 90% of people here, the funnel better close quick!) 3. Potential user cannot use new model.
Then what? You hope they developed good will towards your model through this experience?
You stuck a two week wait in your funnel? Is that the definition of not having your act together or what?
We're on HN, how many of us have heard from Google staff this kind of stuff is a result of them growing so big that AI Cloud has to compete with Vertex Cloud, and AI cloud exists because Vertex Cloud needed 2 years to get OAI/Ant API keys working and they were losing dev mindshare in the meantime?
BoorishBears 21 minutes ago
vessenes 3 hours ago
What sucks, hard, is googles ability to deploy direct to devs and customers at scale when the deployment is not a longstanding Google project.
Case in point: I’m an ultra subscriber and see in my app right now an ad to try Gemini 4; meanwhile the only models I have available are 3.1 pro,3.6 flash, and 3.8 thinking.
Clicking the try gemini 4 link takes me to a demo prompt that loads 3.6 flash. Srsly
I won’t even start telling you what getting api key based access together was like a year ago.
iforgotmypasswo 4 hours ago
We’re all running on Astra medium the whole week and loving it.
I’m curious what I missed.
alex0015 4 hours ago
bitexploder 3 hours ago
iforgotmypasswo 2 hours ago
$500/month for 40+ hours a week of Astra usage, with ultrafast mode available when you’re near the weekly reset has made our jobs so much easier. Our product has some sciencey bits as well, ands Astra kills it as a rubber duck in this area.
As a consumer whose 20x account got downgraded, I am a bit sad. I can’t justify $500 a month on personal AI spend. As an engineering manager, I could not be happier with OpenAI’s services. Also, Codex App Server is amazing.
discreteevent an hour ago
Hey, account created 39 days ago. Did you really have to tag that on after all the other stuff? Could you make it any more obvious?
That said this thread is hilarious because it's just an open ai sales manual debating with an anthropic sales manual. It's funny, but it's not, because the truth is that you people are just shitting all over the commons. Someone needs to kick you out but that's not going to happen here.
bitexploder an hour ago
holoduke 43 minutes ago
motoboi 4 hours ago
Can you elaborate on this?
baq 3 hours ago
simonw 2 hours ago
Reddit thread with 247 comments here: https://www.reddit.com/r/codex/comments/1wtgv3z/dev_day_l/
Aside from that I'm not sure what was "disastrous" - maybe the lack of a new model release to compete with the just-released Claude Opus 5.5?
AspireOne an hour ago
- Dots. People don't understand it. Their presentation didn't explain it properly at all. Additionally, many people thought it's stupid, and that the cutesy mascots are dystopian.
- Voice mode didn't work in their presentation. The demo failed.
- 200$ plan goes 20x -> 10x usage. 500$ plan introduced, 25x usage. The contrast is stark.
- "Ultrafast": 8x pricing on subscription plan (6x API). That's 80$ input, 400$ output, 100$ cache write. Hello?! Additionally, since it generates 8x faster, it consumes your quota 8x faster. Per wall-clock minute, it's 64x more usage spend per minute of generating. People report that on the 500$ plan, their weekly usage is gone in 40-100 minutes.
- People believe gpt-6.1-sol was planned to be released as astra-minor, but OpenAI renamed it at the last possible time, because gpt-6-sol is a disaster (this I can get behind)
topspin 3 hours ago
Oh yeah. Completely forgot about that. Big headlines and big claims, but no one could actually use it and report on it.
Does seem like they don't quite grasp how the hype train operates. Or maybe they don't care as much.
Al-Khwarizmi 2 hours ago
polynomial 5 hours ago
Given FelonyBench, do we also have a FantasyBench?
jstummbillig 5 hours ago
noooooooo
asdfman123 5 hours ago
petesergeant 5 hours ago
asdfman123 4 hours ago
I know it's a matter of personal taste but it reminds me of a grad student that tries to sound smarter than he is by being dismissive and opaque.
glhaynes 3 hours ago
mkoryak 3 hours ago
rad-b 3 hours ago
mattlondon 2 hours ago
IndySun an hour ago
Strange. I wonder why? Have you adjusted 'roles', added 'ask clarifying questions'? This is most peculiar.
geertj 2 hours ago
> You gave me a long answer but it didn’t answer my question: can we safely remove $X
flockonus an hour ago
Great model to architect and resolve eng. problems in a harness loop tho. Poor handoff.
bitexploder 3 hours ago
baq 3 hours ago
cluckindan 3 hours ago
bitshiftfaced 3 hours ago
xd1936 3 hours ago
lackoftactics 2 hours ago
Em dashes ended up as one of the first victims of llm age
TeMPOraL an hour ago
In other words, since the very start of computer era, the use of em dashes was always a signal.
TeMPOraL 2 hours ago
So obviously, government documents, top publications from liberal arts scholars and STEM > Wikipedia > Reddit (and within, r/AskHistorians > r/all, etc.). The first group is the one most likely to (over)use correct / fancy typography.
I have a related pet theory: the telltale sign of AI writing is being too good for the context it's found in, in terms of vocabulary and style as well as structure.
What is jarring about this is precisely the quality - we associate certain styles with important (or self-important) venues, so it's uncanny to suddenly see random shitposts, copywriting spam, or regular chat replies look like work of NYT bestselling authors or legal scholars - it feels wrong in places we expect basic language, grug-brain reasoning, and lots of typos.
Also, what makes the above much more noticeable, is that AI systems don't have cross-session stylistic memory. From the POV of an LLM, that perfectly fitting, masterfully crafted starter is the first and only time it used it. From the user's POV, it's the tenth time they're seeing it in the span of an hour.
astrange 2 hours ago
TeMPOraL an hour ago
Doesn't change my point anyway - even if post-training, labs naturally want the LLM to come off as smart (well, except for Grok). Post-training is where they "untrained" em-dashes and such, due to complaints of users.
epihelix 2 hours ago
knollimar an hour ago
epihelix 35 minutes ago
I don't ever recall seeing an LLM using them incorrectly, as opposed to simply at high frequency but correctly (although I'm sure some low param or early models must have done so at some point).
dalemhurley an hour ago
mikestorrent an hour ago
nostromo an hour ago
Way too many bullets -> way too many emojis -> way too many em dashes
holoduke an hour ago
xandrius 40 minutes ago
pkulak 3 hours ago
dsco an hour ago
The results are a bit disappointing given Googles scale and training data.
The results are on par with cheaper Chinese open source models to be frank. https://cliphou.se/benchmark/
andybak 18 minutes ago
I'm not entirely sure you're correct. Your claim boils down to "Writing natural human prose" vs "Broad use of complex software and spatial awareness". My gut feeling is that there's more untapped and fruitful applications in the second group than the first - at least in the short term.
I_am_tiberius 5 hours ago
the_real_cher 4 hours ago
Lucasoato 4 hours ago
_s_a_m_ 4 hours ago
They had gemini cli, what happened to that? Was fine
InsideOutSanta 3 hours ago
AspireOne 41 minutes ago
Lucasoato 4 hours ago
Is there anybody in Google having a look at how bad and complicated their payment system is? In all the other AI providers you just sign in, pay, get a key, done. In other clouds like AWS, you add a card, pay little to verify the card the first time, monthly bill, done. In Google it looks like you have to fight them every time for the very thing they should make as easy as possible: opening your wallet.
dynm 3 hours ago
CamperBob2 3 hours ago
rdtsc 2 hours ago
deno 3 hours ago
I would also advise against buying Gemini if you have any other Google services, because you get banned across board if they don't like something. To use Google it's best to first migrate off of Google.
Otherwise great product, I really like and would recommend Gemini. The usage is also very generous, at least Flash models.
serbuvlad 3 hours ago
I recently had to verify my YouTube account with a phone number recently because it requires this in order to set a thumbnail.
Questions right off the bat:
1. Why do I need to verify to post a thumbnail that will take 1MB on their servers but not to post a video that will take 100MB on their servers and be public??
2. Why do I need to verify my phone number on YouTube when it's linked to my Google account which has a verified phone number and 2FA etc.?
In any case, it takes you to a CSS-less page that asks you to choose between getting an SMS or being called to get a code. I choose SMS and it doesn't work. It shows an error message with no description just "something went wrong". I try a few times and it keeps not working.
I then switch to the call, and guess what! I have tried "too many times" and will have to try again later. Call worked the next day, but geez, what a mess.
singingtoday 3 hours ago
algoth1 3 hours ago
guybedo 3 hours ago
i live in French Polynesia, a French territory, i'm a Google AI subscriber and i can't use Google AI Studio or antigravity cli because i'm in a geo restricted area ...
It seems Google has no issue laying out cables across the Pacific Ocean from/to Tahiti, they don't have an issue selling their services and plans there but i can't use AI Studio or antigravity cli because of geo restrictions ...
bluerooibos 3 hours ago
- Try in Gemini
- Try in Google AI Studio
- Try in Google Antigravity
Will non users of Google products even know what these three things even are?
34679 3 hours ago
I have AI Pro, but AI Studio tells me I can "unlock" Argon by upgrading to Ultra.
vessenes 2 hours ago
IanCal an hour ago
Classic Google.
malshe 2 hours ago
irthomasthomas 2 hours ago
ssernikk an hour ago
DriverDaily 2 hours ago
kccqzy 3 hours ago
What you did isn’t wrong, but is unfortunately very similar to what real scammers do. The heuristics behind these anti-abuse efforts are always going to have false positives.
Xenoamorphous 3 hours ago
codethief an hour ago
For the lazy:
https://www.osnews.com/story/19921/Full-Text-an-Epic-Bill-Ga...
throwaway919233 2 hours ago
kristofferR 2 hours ago
Ended up with Soniox instead, took minutes to get started.
0xbadcafebee 2 hours ago
mrshadowgoose 2 hours ago
They made using it so hard/unclear that myself and every other dev I knew gave up.
It's clear that they still haven't done any organizational self-reflection.
gpugreg 2 hours ago
fsflover an hour ago
randerson an hour ago
They now ask for your mobile number during signup. And it wouldn't let me register any more accounts with my number. So frustrating.
mfkp 35 minutes ago
"Unavailable · Gemini 4 Argon is currently available to Ultra plan subscribers."
talon8635 34 minutes ago
That said, asking Gemini.google.com to walk you through the steps seems to suffice. In fact, one of AIs big perks for me is walking my through kafkaesque systems like Google’s to cut the shit and get to the result
rumblefrog 30 minutes ago
vidarh 35 minutes ago
If they don't want to make it available even for small tests for free, that's fine, but then don't put a button suggesting I can try it without qualifying it...
EDIT: It's actually worse: The page then shows "Look what you can do with Gemini 4" and a "Let's go" button that leads to a bunch of links to examples, all with enticing pictures. Except if I click on them I get a box stat strongly suggests it'll run with Gemini 4, except the dropdown shows "Flash" and if you click on it, it shows as Gemini 3.6 again, and if you run it, the results unsurprisingly end up looking nothing like their pictures.
I don't know if that page was built by humans or AI, but clearly nobody tested it properly.
fudged71 18 minutes ago
damsta 6 hours ago
Couldn't you just say what the price will be after the introductory period and when it'll take effect? Do they have some SKILL.md for these blog posts that requires the most important information to always be buried ten levels deep and hidden behind a login page?
nananana9 6 hours ago
dyauspitr 6 hours ago
staticman2 5 hours ago
dyauspitr 5 hours ago
brainwad 5 hours ago
stymaar 4 hours ago
It was the case a year ago, but it's less clear cut nowadays, I've seen non-tech people using claude on their phone in the train, and many tech people seem to have switched from Claude Code + Opus to Codex + Sol over the past few month.
vikramkr 3 hours ago
andriy_koval 2 hours ago
simonw 6 hours ago
$2/million input and $10/million output today. $4/$20 after December 1st.
logicchains 6 hours ago
Is Elon Musk doing their pricing?
square_usual 6 hours ago
eptcyka 6 hours ago
LeBit 5 hours ago
WhereIsTheTruth 5 hours ago
It is price fixing, nothing else
ac29 4 hours ago
simonw 4 hours ago
girvo 2 hours ago
It’s still damned capable though, I’ve done a crazy amount of good work with 5.3 Flash.
wasfgwp 3 hours ago
I think at this point comparing raw token pricing is often apples to oranges.
vikramkr 3 hours ago
nateb2022 6 hours ago
vineyardmike 6 hours ago
squidbeak 5 hours ago
gcanyon 5 hours ago
heaney-555 5 hours ago
mlmonkey 4 hours ago
vikramkr 3 hours ago
mufufu 3 hours ago
damsta 6 hours ago
fancyfredbot 3 hours ago
It's perhaps a face saving thing to pretend you'll charge the same. Let's see if it actually happens.
jklinger410 6 hours ago
mattmaroon 5 hours ago
mrandish 5 hours ago
+1. FWIW, I didn't even get far enough to wonder about the price.
The lead (and only) sentence states "Our next era of frontier intelligence, built to solve your hardest problems" a statement equally true of any new Google or competitor model, hence completely devoid of useful meaning. I then kept scrolling down... and down... and down, giving up after a half dozen screens of big images, huge videos and some customer stories. The first sentence of every text block was equally vague or meaningless so... tv;dr (Too vague, didn't read).
Even the Gemini sub-reddit is laughing: https://www.reddit.com/r/GeminiAI/comments/1x2dr47/the_lates...
apatheticonion an hour ago
It might not be as smart, though my employer gives me access to Claude, so I tried giving the same task to Opus 5.5. Both DS4.1 Flash and Opus5.5 produced nearly identical outputs.
After that, my company switched the entire engineering department to Azure hosted DeepSeek4.1 and costs were cut by 3/4. So far, no one has really noticed the change.
mridulmalpani 6 hours ago
https://arena.ai/leaderboard/agent/chat/pareto
For almost same intelligence (+15.56%, +15.18%), drastic difference in cost/task ($3.51 vs $0.41)
BrokenCogs 4 hours ago
yipinwong 4 hours ago
abeppu 4 hours ago
kridsdale1 3 hours ago
ianm218 3 hours ago
jonas21 an hour ago
seizethecheese 20 minutes ago
vessenes 2 hours ago
cheema33 2 hours ago
For chat, yes. But switch to code on the same page, and the picture changes. OpenAI takes the lead.
manlymuppet 2 hours ago
- Natively multi-modality
- Enormous context windows
- Reliably cheap prices
It's like they don't release a model until it passes the above checklist.
Most providers have some mixture of these three occasionally, but with Google, every model is consistent. This kind of consistency is really nice to have.
jjcm 6 hours ago
Argon build: https://html.non.io/lcars-argon/
GPT 6.1 sol: https://html.non.io/lcars-gpt-6.1-sol/
Opus 5.5 (currently SOTA for this): https://html.non.io/lcars-opus-5.5/
Original designs: https://diffui.ai/app/canvas/5093e689-1e74-4f26-b632-2a4500f...
jjcm 6 hours ago
jadbox 4 hours ago
sergiotapia 6 hours ago
jjcm 5 hours ago
capnjngl 5 hours ago
bobviolier 6 hours ago
(Chrome, also incognito)
MaxikCZ 5 hours ago
jjcm 5 hours ago
FWIW, I have literally the exact same configuration (M3 air, google chrome). Here's a recording on mine where I'm seeing 60fps: https://non.io/video/video-3587018401.mp4
Gallows4574 4 hours ago
Edit: The argon built site pins 1.3 cpu cores. The Sol 6.1 site uses 0.18 cores.
dr_kiszonka 4 hours ago
hedgehog 5 hours ago
piperswe 4 hours ago
niek_pas 4 hours ago
wireless6948 4 hours ago
daemonologist 4 hours ago
jjcm 3 hours ago
As soon as gpu acceleration is disabled, the webpage goes from 60fps across the three systems I tried to ~7-20fps when software rendering is forced.
I suspect if you go to chrome://gpu you'll find something different from what I have here: https://image.non.io/a47a1b03-1b87-4fd5-92a2-b39e62b1cfd9.we...
bobviolier 3 hours ago
So that all being said, a normal website should work totally fine on low power mode, and this should definitely be a negative on the Opus implementation.
jjcm 2 hours ago
I would disagree with this based on two things:
1. the prompt, which explicitly states to render the planets in the background in 3js (thus the gpu implementation).
2. the purpose of this, which is a test of its ability to convert an image design into a html/js/css implementation that matches it as closely as possible. I've talked about this before when it's come up[†]. The purpose is to be a good test, not a good design or website.
For reference, here's the full prompt used:
> Create a web page implementation from the following instructions: https://diffui.ai/build/Futuristic_Interior_UI_build.md?auth... dont reference any other folders that have similar builds. Focus on the flowing SVGs. Animate elements that make sense to be animated. For the starships that have planets in the background, ask for high quality images with the windows as a transparent background, and recreate the planets behind them in 3js. It should be one single page application that I can just open the index.html file to view.
[†] https://news.ycombinator.com/item?id=49997135
[‡] here's a copy of this since the diffui build instructions wont be accessible without an account: https://non.io/lcars-build-instructions
awkwardpotato 4 hours ago
jjcm 4 hours ago
Here's a vid of both opus and argon side by side, which might be more viewable on mobile: https://x.com/pwnies/status/2110058987462988152
jdthedisciple 4 hours ago
demibabs 3 hours ago
vessenes 2 hours ago
simonw 6 hours ago
Here's low, medium, high. Even low is better than pelicans from any other lab: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
low cost 10.185 cents, medium was 11.098 cents, high was 17.166 cents.
The costs are similar because it used more output tokens than reasoning tokens for all three pelicans, even for high.
zzulanas 6 hours ago
simonw 6 hours ago
32297 6 hours ago
hyperparticles 6 hours ago
anthonyrstevens 4 hours ago
boo_you an hour ago
129751 6 hours ago
algoth1 6 hours ago
HelloMcFly 6 hours ago
soperj 6 hours ago
Medium and high are fixies apparently, (or they have a worm gear, although the hub doesn't look big enough for that), since neither has a derailleur. That would also explain the lack of brakes at least.
Low is still obviously failing the "test". It's pedals are not actually attached to the bike either.
Medium has a handlebar that goes through the pelican's beak. So I'd say also failing.
For the high, the only nitpick would be that the bell isn't quite on the handlebars and the stripes on his scarf don't line up correctly.
staticman2 5 hours ago
rdtsc 6 hours ago
> If it's on HN and is a meme at this point, it will end up in the training set.
> It's kind of fun to imagine that there is an intern in every AI company furiously trying to get nice looking svg pelicans on bicycles.
Google listened and assigned a few interns, I guess, for the task
eli 6 hours ago
PorciiVorbesc 6 hours ago
gh0stcat 6 hours ago
PorciiVorbesc 5 hours ago
Figure of speech.
>Why not just generate svgs with any editing software?
How do you do that from the whiteboard/notebook?
eli 5 hours ago
PorciiVorbesc 5 hours ago
TeMPOraL 4 hours ago
PorciiVorbesc 3 hours ago
Everyone says that until ms, apple, google, etc introduces this polished feature as part of their tablet imaging editing/document collaboration office suite. Then everyone can;t get enough of it.
> It's a small task whose result is an input to something else - ideal for a tool for LLM (or script)
Have you actually tried this? If it's a small task then why can't LLMs actually do it? Kind of like the pelican test. Every LLM can do a SVG pelican but most of the results are unusable in practice for production/productivity purposes.
Every LLm can extract some half-broken SVG hallucination of your jots, but I'm asking for an app that's polished and works accurately 99% of the time, which means a dedicated app/model tuned specifically for this task, and nobody makes this yet.
TeMPOraL an hour ago
I don't feel like I'm a representative sample of general userbase, so I won't dispute this too hard. For me, it's rare but it does happen. Still, 90% of my mobile experience is "how is this so broken, why is it missing the obvious follow-up feature that completes a workflow, and why, again, am I not using a laptop for this?".
> If it's a small task then why can't LLMs actually do it?
What if they actually can?
This is exactly what Karpathy was talking about the other day[0]. If your only LLM experience is the default chat app in chat mode, then this doesn't make sense. If your experience includes using agentic harness like Claude Code/Cowork / Codex/ChatGPT Work, then it's obvious.
The LLM app in "chat mode" will just zero-shot you a pelican, or digitize your notes into SVG, and maybe improve on it a bit if you complain about the result. The same app[1] in "agentic mode" will digitize your notes, refine the SVG against the original image, reduce it to probable strokes based on high-frequency patterns in the photo and knowledge of how people write, OCR it, save both the text and SVG to your library, then extract parts you wanted and insert them into a document, typeset the rest of it, and print it on your printer - all in response to a single prompt.
LLMs in agentic mode are very good at stringing long and advanced workflows; today, if you give them shell access or computer use, they will use regular apps for you if that's the easiest way to accomplish the goal.
> Have you actually tried this?
Yes![2].
That's why I can confidently say: there is no limit to this pattern. LLMs can handle apps just fine; giving them tools just saves time and tokens.
Another example: I'm currently resurrecting a 30 year old game, and the other day I asked Claude to hack on a way to run it headlessly, so I can use my computer while it plays with it. It did, and then immediately leveraged it to just causally run several instances of the game in parallel, entirely in the background, whenever it needed to playtest something.
--
[0] - https://news.ycombinator.com/item?id=50047422 - was on the frontpage two days ago.
[1] - Claude and ChatGPT now have both modes in their mobile, web and desktop apps. I personally use Claude Code a lot, but exclusively through these surfaces (I can't be arsed to deal with TUI at home anymore). IMO, these tools are already within reach of regular users - the users just didn't notice it yet.
[2] - Not with SVGs, but equivalent with voice recordings, and yes, Claude Code set up and is managing the whole local processing pipeline. Recordings go in, Markdown (or more advanced signal processing) comes out, and in itself, it's not a task, but merely a step.
xnx 5 hours ago
matsemann 4 hours ago
CuriouslyC 5 hours ago
slyrus 4 hours ago
sulam 6 hours ago
afavour 6 hours ago
compiler-guy 6 hours ago
DoctorOW 5 hours ago
gcanyon 6 hours ago
They look remarkably good, sure -- but not perfect.
orbital-decay 5 hours ago
nomel 4 hours ago
orbital-decay 4 hours ago
pwython 5 hours ago
> How many pelican riding bicycle SVGs were there before this test existed? What if the training data is being polluted with all these wonky results...
But Simon has demonstrated before that asking for any animal doing something silly will still get similar results from the same model.
simonw 3 hours ago
thinkingemote 3 hours ago
simonw 15 minutes ago
dominotw 5 hours ago
JoshTriplett 5 hours ago
ngruhn 5 hours ago
NoDodgeQuestion 4 hours ago
rubyn00bie 4 hours ago
gedy 4 hours ago
codethief an hour ago
mlmonkey 5 hours ago
Expect Google models to be benchmaxxed as much as possible, but don't expect commensurate performance on real-world tasks.
anthonyrstevens 4 hours ago
This is not true. It is needless negative hyperbole that IMHO doesn't belong on HN.
mlmonkey 4 hours ago
agar 4 hours ago
If what you say is true, then the next set of benchmarks will be written to illuminate the true reflection of real-world tasks. Then those get benchmaxxed so managers can show "numbers go up."
Repeat enough times, and you get materially and genuinely improved products.
The burden is on the press, outside researchers, and general tech industry to both write and care about the metrics that matter.
kalcode 4 hours ago
bilsbie 6 hours ago
Modern models can make nearly photorealistic games in threejs. So why do they struggle with these pelicans?
simonw 6 hours ago
The test is always going to be hard though, because it's an absurd image to ask for.
UPDATE: I like this theory about using an agentic harness that can render and iterate better: https://news.ycombinator.com/item?id=50073879#50074395
boo_you an hour ago
this is a really profound insight
jephs 6 hours ago
The pretty 3d stuff you see are agents controlling a Blender MCP in a loop where they look at the scene, think, adjust the scene, repeat.
simonw 6 hours ago
vineyardmike 6 hours ago
AspireOne 5 hours ago
agar 3 hours ago
(As I said in a separate comment above, results are all bikini-clad and not revealing. However, whether it is NSFW is up to you/your work policies.)
epihelix an hour ago
Perz1val 6 hours ago
sobiolite 6 hours ago
TeMPOraL 6 hours ago
charcircuit 6 hours ago
duckmysick 5 hours ago
https://www.gianlucagimini.it/portfolio-item/velocipedia/
HN discussion: https://news.ycombinator.com/item?id=17699017
mason55 5 hours ago
https://www.wired.com/2016/04/can-draw-bikes-memory-definite...
ben_w 3 hours ago
Are you sure they're not fetching free asset packs for that?
agar 3 hours ago
However, result quality really drops off once you get out of the top 5 or so.
(NSFW note: all buttocks are covered by fairly conservative bikini bottoms and show no genitals, bulges, etc.)
postalcoder 6 hours ago
kart23 6 hours ago
squidbeak 6 hours ago
huseyinkeles 6 hours ago
MrAssisted 3 hours ago
Fraterkes 6 hours ago
perardi 6 hours ago
Subtle highlights on the metal frame, sweat beads, jaunty little hat…it has style. At least compared to the rather literal ChatGPT outputs. https://static.simonwillison.net/static/2026/gpt-pelicans-gr...
jameshart 6 hours ago
Is the prompt context telling the models what their effort level is, and the ambient presence of that concept of ‘high effort’ in the context window is leaking through and affecting the portrayal?
simonw 6 hours ago
https://huggingface.co/Qwen/Qwen3.8-27B/blob/main/chat_templ...
xhigh: "Reasoning effort is set to xhigh. Please think carefully through the task, validate key assumptions, consider plausible alternatives, and prioritize correctness, consistency, and clarity in the final answer."
low: "Reasoning effort is set to low. Keep your thinking brief and focused, moving directly to the conclusion without unnecessary elaboration."
LarsDu88 6 hours ago
It's a simple manner of prompt...generate concept art with nanobanana, measure, llm creates svg with text, measure the distance between rasterized svg embedding to nanobanana art....do post-training RL on a 3 million such images and matching embeddings.
I swear this will be a canonical example of Goodhardt's Law in action.
You have to switch to a new benchmark that isn't so easy to run a verifiable rewards pipeline on...Perhaps a longer horizon task where it's easy to mess up midway.
jameshart 6 hours ago
Yes, Simon has made pelicans a benchmark and now models have grown very good at rendering them. Is there a reason to believe that this isn’t manifesting as useful skill in general in SVG generation?
wasfgwp 3 hours ago
It would perhaps be slightly interesting if the prompt was run 100 times for each model. I doubt the pelicans would look identical.
whoamii 6 hours ago
mceachen 6 hours ago
yuhmahp 6 hours ago
simonw 6 hours ago
Here's 'Generate an SVG of an armadillo in fishnet tights jaywalking on Mars' for Gemini 4 Argon: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
Some other models for comparison: https://tools.simonwillison.net/markdown-svg-renderer?url=ht...
make3 6 hours ago
dyauspitr 6 hours ago
gcanyon 6 hours ago
As one point, the high pelican's arm is see-through/messed up.
They do look worlds better than previously, to be fair.
YZF 5 hours ago
https://en.wikipedia.org/wiki/Pelican#/media/File:Pelikan_Wa...
ASalazarMX 5 hours ago
ameliaquining 5 hours ago
matt123456789 5 hours ago
diseasedyak 5 hours ago
saaaaaam 4 hours ago
CamperBob2 3 hours ago
geniium 5 hours ago
petra 5 hours ago
I've noticed that chatgpt is working harder. But still I prefer Claude, it just feels nicer to me.
mroset 5 hours ago
juleiie 5 hours ago
Give me reverse engineering bench and agentic coding.
Leave making visuals to humans who actually have aesthetic sense unlike whatever made this mess
ionwake 3 hours ago
gordon_freeman 5 hours ago
tyre 5 hours ago
philipwhiuk 4 hours ago
bigcat12345678 5 hours ago
mt_ 5 hours ago
travbrack 5 hours ago
tintor 4 hours ago
epihelix an hour ago
However, how the front fork rake affect stability is I believe a little complex. I doubt this old article is the last word on the subject, but it's a great read nonetheless, and note especially the ultra-stability of the reversed fork bike!
https://physicstoday.aip.org/features/from-the-archives-the-...
rich_sasha 4 hours ago
I note that even these bikes are not actually rideable. For a bike to be stable, the front wheel axle needs to extend forward a little ahead of the fork - the fork must ”bend forwards”. This is what actually keeps the bike upright, not gyroscopic effects or some such. Given LLMs are generally good at basic maths, im surprised they get this wrong.
Maybe a bit less so in this case though. As per the announcements, the model was actually trained for this prompt, so was fed some training data. I can well imagine the data there was just not so good.
jonas21 4 hours ago
https://www.walmart.com/ip/Huffy-26-inch-Rock-Creek-Men-s-Mo...
(apologies if I'm misunderstanding).
sokka_h2otribe 4 hours ago
jonas21 4 hours ago
IsTom 4 hours ago
matsemann 4 hours ago
People drawing bikes, scroll down to see they having made renders of all the drawings. Hilarious
saberience 4 hours ago
You're nit-picking on a detail no one actually cares about.
kevmo314 4 hours ago
You can also ride a negative rake fork. They are less stable, yes, but a far cry from not actually rideable, cf https://www.instagram.com/yourforkisonbackwards/
Enginerrrd 4 hours ago
Bedon292 4 hours ago
I'll also note that, using a piece of paper as a straight edge against my screen, there is a very slight forward curve on the low and a bit more on the high responses. Medium does appear to be perfectly straight.
NooneAtAll3 4 hours ago
wasn't the whole point of pelicans is that labs *wouldn't* train for that?
so now the benchmark is ruined
motoboi 4 hours ago
Also, that first tweet contains a commentary that, for me, explain a lot about the public misconception about how current AI works:
> wait, does this mean you guys are actively training svg generation? i was mostly amazed by it thinking the models doing better at it by itself due to becoming better at reasoning.
No, it's not better reasoning that drives current AI, it's better examples we have been giving them. Whole army of people generating content for the frontier labs.
Also, reasoning improving the out of distribution part, like computer use, tool use etc.
TeMPOraL 4 hours ago
Another case where allowing oneself to anthropomorphise LLMs a little yields better intuitions.
People don't get more skilled by raw reasoning, either. They improve their skills with better textbooks (pre-training data), more practice exercises (RL data), and generally goofing around (self-play).
boutell 4 hours ago
w29UiIm2Xz 4 hours ago
KeplerBoy 4 hours ago
kmod 4 hours ago
<https://tools.simonwillison.net/svg-render#%3Csvg%20font-fam...> <https://tools.simonwillison.net/svg-render#%3Csvg%20font-fam...>
- I was having trouble embedding the SVGs as links, and ChatGPT recommended Simon Willison's SVG Renderer as a workaround.
Just my 2 cents on the pelicans benchmark: I think it might help if you were a bit more explicit about not taking this one benchmark too seriously. I know you say that at times, but at other times (such as the comment I'm replying to) you elide it which can read as a seriousness about the benchmark.
thefourthchime 4 hours ago
Argon: https://jonclegg.github.io/pacman-bakeoff/dev/#gemini-4-argo...
Opus 5.5 https://jonclegg.github.io/pacman-bakeoff/dev/#claude-opus-5...
vessenes 2 hours ago
JieJie 5 minutes ago
IanCal 6 hours ago
Like a working scroll on a webpage.
God damn this is impossible to use of safari mobile.
rs_rs_rs_rs_rs 6 hours ago
jedbrooke 6 hours ago
InvisibleUp 6 hours ago
jstummbillig 6 hours ago
winwang 3 hours ago
pierreozoux 6 hours ago
throwawayy6767 6 hours ago
medler 6 hours ago
oh_no 6 hours ago
dymk 4 hours ago
yipinwong 4 hours ago
Argon is trying to solve the "hard" problems like those.
layer8 4 hours ago
boutell 4 hours ago
InsideOutSanta 4 hours ago
axblount 6 hours ago
Is it actually available?
robotmay 6 hours ago
chpatrick 6 hours ago
hiq an hour ago
I'd be curious to see if people have managed to just add custom instructions to make the outputs more standardized and less annoying. I never have such annoying cases, whatever the model, it's just too verbose, but in this case I ask it to be more concise and it's usually fine.
IshKebab 2 hours ago
artdigital an hour ago
Anthropic’s vision of “safe” is so frustrating to deal with, it makes me want to go back to ChatGPT.
alex1138 6 hours ago
copperx 5 hours ago
alex1138 4 hours ago
copperx 3 hours ago
kridsdale1 3 hours ago
demibabs 3 hours ago
dizhn 4 hours ago
d2kx 6 hours ago
babelfish 6 hours ago
d2kx 6 hours ago
mattmanser 6 hours ago
Eyes glazed over again.
Did you even read your own site before you posted it?
One of the first pages I opened:
> Smoking-gun proof of plant-label ingestion: in Row 2, the central cut root is labeled okol (f88r.15), and directly underneath it on Line 2 (f88r.19) the recipe writes...chokol daiin qoekol qoekol qockhol okol cheol...!
It's just gibberish.
case540 6 hours ago
HenryMulligan 5 hours ago
swingboy 22 minutes ago
shawabawa3 4 hours ago
It looks like you've managed to decode it? Is that legit?
yipinwong 4 hours ago
What kind of progress was made with Argon with the Voynich?
jdthedisciple 3 hours ago
kzrdude an hour ago
But id the progress of decoding it is legit, you should write something properly about it!
protoman3000 6 hours ago
The code is bad though.
jug 6 hours ago
TomGarden 6 hours ago
gradus_ad 5 hours ago
mavamaarten 5 hours ago
copperx 5 hours ago
bahmboo 5 hours ago
yipinwong 4 hours ago
Or else it say, here is the result. (but no it didn't do no research, and tells me, sorry I forgot to search).
It's got balls to lie straight at my face.
SwellJoe 3 hours ago
They all ramble, they're all allergic to getting to the point. But, Gemini historically has pretty good prose. Even the self-hosted Gemma models have pretty nice, inoffensive prose. I wouldn't want to read a novel written by any of them, but I tend to ask Gemini questions in chat more often than Claude or GPT, because it has good prose and is good at using the web to research.
aliljet 6 hours ago
Now, I happen to believe that's an excellent strategy. I bet they actually resolve more LLM requests than any other company at this point. The lay person still uses Google exclusively.
nateb2022 6 hours ago
hersko 6 hours ago
acmotifs 5 hours ago
paimapi 5 hours ago
I use the hell out of both. Kind of sad that they took Spark out of beta-access, being able to orchestrate via your phone on something that has direct access to your Drive meant I was authoring skills and other functionality on a schedule with spreadsheets serving as databases, deterministic tests, etc.
Hope they roll it out to a full feature soon
ASalazarMX 5 hours ago
paimapi 5 hours ago
freecodeio 5 hours ago
if they throw in youtube premium in that package then I might reconisder
crossroadsguy 4 hours ago
lanthissa 3 hours ago
they gave away so much pro that they need to have smaller usage levels than competitors or they'll lose a ton of money. $20 was already a loss for users actually using their quota. the majority of pro users are paying far less than that.
so they'll lose their paying users, and keep their free or subsudized, which will make the economics even worse.
sroussey 6 hours ago
cubefox 6 hours ago
sroussey 6 hours ago
dbuser99 6 hours ago
tireonfire 6 hours ago
verdverm 6 hours ago
steego 6 hours ago
More specifically, who are they targeting with Argon and why is it behind the Ultra plan? Who is paying $99/month if not developers?
fschuett 5 hours ago
Corporate companies. Bog-standard office workers don't need top-of-the-line Mythos intelligence, just something to add to Google Workspace. I personally doubt developers use Gemini for coding beyond marketing materials.
alephnerd 5 hours ago
verdverm 4 hours ago
There is another subset in the Google Workspace for enterprise clients.
steego 6 hours ago
Because if it’s not, and it’s not available to all paying users (Right now, it’s only available to Ultra users), then they are behind the curve if they’re treating it like Fable.
It’s tone deaf.
copperx 5 hours ago
steego 2 hours ago
epihelix an hour ago
Whether it's actually better than OAI/Anthropic offerings, probably not, but if Google has managed to get back to parity, that's good for competition, prices, and increased model performance in the future. Three strong western competitors is better than two.
I_am_tiberius 6 hours ago
w4yai 6 hours ago
redox99 6 hours ago
Unique users, maybe. But a simple query that's answered in a paragraph is negligible compared to devs running agents continuously for tens of hours.
freecodeio 5 hours ago
redox99 5 hours ago
When I see non technical people use that Google reply I'd be surprised if it's more than 1k output tokens, and with a tiny model. So a 3000x in output tokens, on a model at least 10x as expensive, I wouldn't be surprised if hardware usage is 30.000x for a dev that uses coding subs vs someone who uses the Google AI overview a couple of times a day.
And that's not counting the absurd difference in cache reads.
Macuyiko 5 hours ago
scirob 3 hours ago
https://dach.peerbench.ai/compare?models=google%2Fgemini-4-a...
tezza an hour ago
Very fast.
Makes mistakes. Corrects the mistakes quickly with direction.
Google Argon 4: https://share.gemini.google/T9r6tr2dDaTE
I didn't have time to make it into a full blog post yet. Here is a previous one.
https://generative-ai.review/2026/07/kimi-k3-rush-test-vs-cl...
tezza an hour ago
Astra 5.6 is significantly better than Google Argon 4 and a lot better than Claude Fable
https://generative-ai.review/2026/10/catchup-openai-astra-5-...
tekacs 9 minutes ago
tekacs 6 hours ago
catigula 6 hours ago
owlninja 6 hours ago
verdverm 6 hours ago
I like this phrasing and am curious what new word or phrase we might use to describe big companies over pushing Ai internally at the expense of their product quality. This pattern is so ubiquitous across google cloud products I have taken to calling them the 21st century IBM, having been a IBM baby and witnessing first hand their fall from exceptionalism.
wyldberry 6 hours ago
catigula 6 hours ago
cmrdporcupine 6 hours ago
And took similar companies that were quality engineering focused -- like DEC or Palm -- down with them through acquisition.
kridsdale1 6 hours ago
cmrdporcupine 6 hours ago
mistic92 6 hours ago
xbmcuser 6 hours ago
w4yai 6 hours ago
fridder 6 hours ago
ano-ther 6 hours ago
PorciiVorbesc 6 hours ago
PorciiVorbesc 3 hours ago
moecables 6 hours ago
niek_pas 4 hours ago
This is in the Gemini app on macOS.
wslh 6 hours ago
Gallows4574 6 hours ago
edit: It failed on the second prompt and they disabled it now.
melasadra 6 hours ago
EDIT:
Apparently Ultra subscribers gets Argon everywhere including in Google Antigravity
Pro subscribers only get them in Gemini app and Search
jonesy827 6 hours ago
https://antigravity.google/blog/gemini-4-argon-in-google-ant...
niek_pas 4 hours ago
> Gemini 4 Argon is available today for Google AI Pro and Ultra subscribers
ehsankia 2 hours ago
1. It's available to Pro in Gemini app, but NOT antigravity (for coding)
2. It's a phased rollout and Ultra got it first, Pro is coming later
The latter blog post is specifically "Argon in Antigravity" versus the other blog post is about Argon in general, so seems like #1 is more likely.
efficax 5 hours ago
copperx 5 hours ago
caminanteblanco 6 hours ago
https://one.google.com/about/google-ai-plans/?icid=microsite...
freakynit 6 hours ago
It seems to be rolling out gradually.. not available at once to everyone.
ChadNauseam 5 hours ago
It's crazy to me how care there is in most of these vibe-coded vibe-coding harnesses. I don't like oai's models much but I have to say their UI has by far the best attention to detail of any major player.
SwellJoe 3 hours ago
yegle 6 hours ago
It doesn't show in the desktop UI.
rahimnathwani 6 hours ago
frangonf 6 hours ago
> Gemini 4 Argon (Medium)
Unavailable · Gemini 4 Argon is currently available to Ultra plan subscribers.ehsankia 2 hours ago
schleck8 6 hours ago
hnfong 6 hours ago
bretpiatt 5 hours ago
Antigravity CLI 1.3.4
[My account email] (Google AI Ultra)
Gemini 4 Argon (High)
~/[working folder]
> /model
⎿ Model set to Gemini 4 Argon (High)gandreani 4 hours ago
alexmr 21 minutes ago
FranciscoCarlos 3 hours ago
As of my knowledge cutoff, three of the top state-of-the-art large language models are Google's Gemini 2.5 Pro, OpenAI's o3 (and GPT-4.5), and Anthropic's Claude 3.7 Sonnet.
arbuge 3 hours ago
FranciscoCarlos 3 hours ago
parasti 8 minutes ago
freakynit 6 hours ago
This is crazy if it can work accurately.
ArashEdalat 6 hours ago
verdverm 6 hours ago
kridsdale1 3 hours ago
34679 2 hours ago
amai 5 hours ago
dandaka 4 hours ago
deniska 4 hours ago
karp773 3 hours ago
l0kihardt 3 hours ago
grim_io 2 hours ago
Related funny https://www.youtube.com/watch?v=DlTNN0gvkLM
Andrex 31 minutes ago
tireonfire 6 hours ago
sureglymop 6 hours ago
Pretty misleading.
ezfe 6 hours ago
verdverm 6 hours ago
peheje 5 hours ago
verdverm 4 hours ago