Codegen is clearly lowering the cost of getting things to run on different hardware
the real moat is everything around it: stability, tooling, all the weird infra edge cases.
Doesn't your own deployment story kind of argue the opposite? If standing up one model still takes hours of cold starts and flag tuning across different layers, the moat was never CUDA. It's years of failure modes that live in the heads of people who built this stuff. AI writing the code is the easy part.
idk feels a bit overstated. CUDA’s moat isn’t just writing kernels, it’s the whole ecosystem + hard earned perf intuition. AI helps write code but doesn’t replace that.
switching costs are def going down though, so CUDA feels more like the default vs the only option.
real moat is still ops. getting stuff to run is easy, getting it stable at scale isn’t. so yeah, not gone, just more like a tax now.
The moat was never CUDA syntax. It was ten years of documented failure modes, and that’s not something you can prompt your way out of. Whoever ends up owning the serving layer inherits it.
What is happening to Hackernews, Firstly its obvious that this is AI generated post and then I checked it on an AI text detector website as well and it shows as being clearly AI generated (100%)
I am so so tired about AI posts on this website. I am seeing so many of them and comments being AI generated too. It seems that the guidelines aren't being enforced.
I am sad to see this community die in almost real time but within 2 days, I am seeing so many AI generated things. It's getting real bad real fast and real human submissions get undiscussed oh boy. :-(
Codegen is clearly lowering the cost of getting things to run on different hardware the real moat is everything around it: stability, tooling, all the weird infra edge cases.
Doesn't your own deployment story kind of argue the opposite? If standing up one model still takes hours of cold starts and flag tuning across different layers, the moat was never CUDA. It's years of failure modes that live in the heads of people who built this stuff. AI writing the code is the easy part.
idk feels a bit overstated. CUDA’s moat isn’t just writing kernels, it’s the whole ecosystem + hard earned perf intuition. AI helps write code but doesn’t replace that.
switching costs are def going down though, so CUDA feels more like the default vs the only option.
real moat is still ops. getting stuff to run is easy, getting it stable at scale isn’t. so yeah, not gone, just more like a tax now.
These days, half the HN posts seem A.I. generated, or at least edited. Am I overly suspicious?
The moat was never CUDA syntax. It was ten years of documented failure modes, and that’s not something you can prompt your way out of. Whoever ends up owning the serving layer inherits it.
I believe brand loyalty will carry the day for them. "GPU" means "NVIDIA" to buyers.
Good point. Corporate inertia plays in NVIDIA's favor.
What is happening to Hackernews, Firstly its obvious that this is AI generated post and then I checked it on an AI text detector website as well and it shows as being clearly AI generated (100%)
I bet this user ID got sold, or hacked. Look at its comment and submission history.
Excellent post, could you also direct your chatbot to read the guidelines first?
From [0]
> Don't post generated comments or AI-edited comments. HN is for conversation between humans.
[0] https://news.ycombinator.com/newsguidelines.html
I am so so tired about AI posts on this website. I am seeing so many of them and comments being AI generated too. It seems that the guidelines aren't being enforced.
I am sad to see this community die in almost real time but within 2 days, I am seeing so many AI generated things. It's getting real bad real fast and real human submissions get undiscussed oh boy. :-(