Hacker News

> Opus 5 is just as good for this tbh and cheaper.

It depends on the fidelity, there's a threshold slightly over "low poly" that Opus cannot get over. Once you get into creating foliage l-systems, or physical mob animation, or a house with realistic appliances, Opus is under the convergence threshold for a world model no matter how much time you give it, it will flail around and say it's done even though it's nowhere close to plausible. Fable takes forever but knows how to zoom in and out on the abstractions.

> They don't generate optimized 3d models. They have high poly count for simple geometries.

By default LLMs will do the quick prototype thing and slap some primitives into a THREE.js scene. Which is probably correct because most users don't know or care. But if prompted Fable will connect the manifolds/sculpt with a mesher, instance out the pieces, etc. and make you an efficient art pipeline. You can make it optimized. Just not in 10 minutes.

> A better approach I've utilized for game ready assets is to use the model to create low poly silhouettes

You can also let Meshy make the geo and then fit it back to the world with PCA + BB's. Diffusion models are still 10x better at making physically plausible geometries than LLMs, plus they are faster all things considered. One technique I've found that works well is socketing; let the LLM generate the high level structure with blockouts for sockets, then slot in the higher poly objects that fit. Which is closer to the professional approach for world design.

I’m interested! I struggled to get goos detail on my Back to the Future Delorean 3D animation on my docs hero: https://contextify.sh/docs/

I posted this previously and people wanted more info so here is how I built it, with a deeper dive into some film scene recreation I worked on focusing on a scene from Apocalypto:

https://banagale.com/cinematic-canvas-ai-film-animation.htm

I’d love to improve the look of these things.

I created a skill just for the 3d models. Works with Unreal Engine too. It generates an image using stable diffusion, then it transforms the object in the image into a 3d object using Hunyuan3D-2. You can check it out here: https://github.com/LaurentiuGabriel/unreal-game-assets-creat...

"Can post a tutorial if there's interest."

There is.

why would you force me to login to see what the game is, I have zero information and you're asking me for a password or my google information. hostile and creepy.

Kind of interesting that most ai games want me to sign in.

Uh, I tried feeding 5.6 Sol High my 2D DXF drawings of my house floor layout & house exterior to generate 3D visualization within blender via MCP... and it was miserable. No understanding on how windows attach to walls, misaligned bearing walls between floors, gaps all around the places, chimney not continuous, windows don't line up and are in wrong places, house parts swapped. And still struggling when I explain those things - that it is a house and real-life architectural constraints should be taken into account. But I just had to keep prompting to fix this, that, redo this and that and then it breaks other things until I fed up.

Part of it is probably struggle to understand the DXF and mixing up "wall lines" with "dimension/helper lines" (I tried also feeding PDFs)

Anyways, if someone has an idea how to improve 3D modelling with AI or how to make understand 2D drawings to understand rooms/walls/square meters, etc - would be nice.

As you might have researched it, do you know if there's currently any AI model or arrangement of models that are able to produce truly game-ready 3D assets? Good meshes with appropriate poly count and good topology, decent UV maps and textures, etc. I've seen some products advertising that, but I'm not sure they are up to their promise, and I haven't had the bandwidth to research it in depth...

Please do post the tutorial. Also, your RTS looks great, I will definitely check it out!

Regarding your game shared here: https://news.ycombinator.com/item?id=48943351

oh, it's "play war pact".

I read it as "play, warp, act"

Wait so Opus modeled your cool scifi buildings?

[dead]

> I would be especially curious to see the NPC person/car logic and if they're on rails or what, that's a pretty good NPC density for a demo.

Here ya go: - https://github.com/PhiloLabs/fable51-worlds/blob/main/union-... - https://github.com/PhiloLabs/fable51-worlds/blob/main/union-...

AI generated everything. Dude probably didn't even look at the examples.

Agreed. Author should not be using this term. A world model, as I understand, is what an LLM is missing that a human brain has: in addition to a linguistically described world, we also posses a sensory model of the world, a physics model so to speak, against which the random token/thought chains generated by our brains can be validated.

ik, "world model" has too many definitions at this point. imo the bar is just: can it simulate the world.

Well, nothing now starts in a completed state. See pre-production footage for movies and video games, for how scenes progress.

Uncharted 4: https://youtu.be/NedDxIGQVs0&t=147

Coco: https://youtu.be/nl_JkjgHfFU&t=10

Up: https://www.youtube.com/watch?v=JHfLGgOs6gY

And, eventually you can just run it through Nvidia DLSS 7 for better hair physics and textures. ;)

i discovered doing this in claude design and i can tell you... it's useful in a professional domain. Although I am not going to share what I'm using it for, to keep an edge in my domain ;)

this is a one-shot result but i have a really really lengthy prompt: https://github.com/PhiloLabs/fable51-worlds/blob/main/union-... with clear guidance in using subagents and self-QA loop. ~2 hour (extensive subagents usage), total ~8M tokens, ~$33 under API

I'm really curious how GML-5.3-flash would do. Very affordable, and it seems to do pretty well with 3D modeling.

This, maybe?

https://news.ycombinator.com/item?id=49525160

we're working on a survey paper about world modeling via code, with folks from frontier labs (qwen omni, oai, etc) and academic institutions (e.g., oxford, stanford, etc) reach out to us about collab: [email protected]

VRML was incredible. It's a "hypertext" markup language but instead of documents it produces 3D environments. It's a shame it never really caught on.

$33 is expensive? Compared to what?

Because it’s a very complex task to do especially with any level of quality and consistency.

Classical algorithmic approaches for data to CAD are quite unreliable heck commercial CAD software still struggles turning scanned 2D plans into sketches with any degree of reliability.

Something of this scale would normally require 1000’s and 1000’s of man hours in manual modeling, placement and quality control.

Some of the latest prompt to CAD agents and models I’ve seen are the most impressive use of AI I’ve seen in a long time.

At least for me this is rather exiting since it gives me the ability to turn many more ideas into reality as a hobbyist rather than spending the entire weekend in Fusion 360.

the topology/texturing critique is fair for mesh generation, but code-generated worlds mostly sidestep it. when the model writes three.js or blender scripts, geometry comes from primitives, csg, and parametric construction, so topology is clean by construction rather than something you clean up after. texturing is still a gap, agreed, though procedural materials cover more than people expect.

> I've yet to see a single agent generated piece of software above that bar.

Begs the question, an earnest one: what software would be above that bar?

Why don't you try to do it yourself with Fable and compare it with this one? Even with AI there are still a lot of work, knowledge, and gotchas involved. What's the point of such comment?

Making callouts by SF street intersections, lol

yes we're working on it! trying to push a few open world rpg games with real economy and game design. it's also super interesting to benchmark the current models' capability in this direction, since this is a naturally hard and multimodal coding task

I'm not sure about expanding domains, but I expect that very close to 100% of games are now using LLMs to a very significant degree during development, even if most won't admit it. The "AI disclaimers" for games need to go away, simply because it's just rewarding and incentivizing lying and punishing truth.

yes we added the side by side comparison, check out the readme!

simulate the universes and then observe the parallel universes

Had to vouch for your comment, for some reason it was not visible.

> Geometry is derived from OpenStreetMap (ODbL) and USGS 3DEP (public domain).

This is probably how I would have tackled this, saves on time, especially if Fable just writes code to convert OSM data to a reasonable ThreeJS model.

Do you have data on the tokens or $ cost of this?

I think perhaps you've misunderstood what the linked repo actually is? It seems to indeed be a 3d model of an area. It's not an image model, and nothing to do with frames.