This project generates synthetic computer vision training data. The arxiv paper has more detail including some cool pictures of random creatures it can generate. The images are nice but all of them are nature settings so I assume one would have to supplement this type of data with another data set for training a computer vision model.
From the homepage it sounds like they've prioritised geometry fidelity for CV research rather than performance:
> Infinigen is optimized for computer vision research, particularly 3D vision. Infinigen does not use bump/normal-maps, full-transparency, or other techniques which fake geometric detail. All fine details of geometry from Infinigen are real, ensuring accurate 3D ground truth.
So I suspect the assets wouldn't be particularly optimised for video games. Perhaps a good starting point though!
Epic did say that you might in some situations forego normalmaps with Nanite and save disk space even though you have super detailed models so it DOES fit in this context.
Also, video games are used to take a high poly model and bake a normalmap corresponding to it on a lower poly model anyway so it might also be used that way. I think Doom 3 was the first game to show the technique?
I doubt they prioritized it. To get normal maps you usually first need a high resolution mesh, but then need other steps to get good decimation for lods and normal bake. That's mostly extra work, not alternative work that wasn't prioritized. If by transparency they mean faking aggregates, you also need full geo there before sampling and baking down into planes or some other impostor technique.
Also discussed 30 days ago, 33 comments: https://news.ycombinator.com/item?id=42485423
Watching the video I thought "No Man's Sky as a python lib."
Also terragen but for everything
I like the "zero AI" part.
This project generates synthetic computer vision training data. The arxiv paper has more detail including some cool pictures of random creatures it can generate. The images are nice but all of them are nature settings so I assume one would have to supplement this type of data with another data set for training a computer vision model.
The same authors also created Infinigen Indoors[1] to generate indoor scenes for computer vision applications such as robotics & AR.
[1] https://arxiv.org/abs/2406.11824
An LLM frontend for this would be amazing.
You could describe the scene you want in normal english and iterate eith conversation.
It could automatically create scenes from novels and poems.
It feels like l-systems on mega steroid, cool
Source: https://github.com/princeton-vl/infinigen
This seems extremely cool. I’m wondering if it can be used to create procedural video game assets.
From the homepage it sounds like they've prioritised geometry fidelity for CV research rather than performance:
> Infinigen is optimized for computer vision research, particularly 3D vision. Infinigen does not use bump/normal-maps, full-transparency, or other techniques which fake geometric detail. All fine details of geometry from Infinigen are real, ensuring accurate 3D ground truth.
So I suspect the assets wouldn't be particularly optimised for video games. Perhaps a good starting point though!
Well, we've come a long way. Look at nanite - it might actually be compatible...
Epic did say that you might in some situations forego normalmaps with Nanite and save disk space even though you have super detailed models so it DOES fit in this context.
Also, video games are used to take a high poly model and bake a normalmap corresponding to it on a lower poly model anyway so it might also be used that way. I think Doom 3 was the first game to show the technique?
I doubt they prioritized it. To get normal maps you usually first need a high resolution mesh, but then need other steps to get good decimation for lods and normal bake. That's mostly extra work, not alternative work that wasn't prioritized. If by transparency they mean faking aggregates, you also need full geo there before sampling and baking down into planes or some other impostor technique.
I was very confused by “math rules only” - as opposed to what? But it seems they don’t think an LLM is maths. Which it absolutely is.
While mathematics are necessary to build LLMs, they are not a kind of math or a distinct branch of mathematics.
Is what?
"Infinigen is a procedural generator of 3D scenes".