andai6 minutes ago
>I used Qwen2.5-Coder-0.5B as the starting point. I needed a small model to get close to realtime performance. Being a coding model, it had also already seen plenty of CLI usage.
Interesting. I wanted to ask, how that model compares with the fine-tuned version, but I just saw the author provided benchmarks. Interesting that fine-tuning improved the memory so significantly, wouldn't have expected that.
Though, on second thought, I had an experience where I was able to, as a human, fine-tune my memory beyond what I previously thought was possible!
Reminds me of one of my favorite jokes.
Excuse me, can you tell me how to get to Carnegie Hall?
—Practice, man... Practice...
thorum19 minutes ago
I regretfully suspect this actually is the future of UI. You just need smart local models running fast enough to keep the framerate high, but that’s inevitable in the long term, isn’t it?
skohan5 minutes ago
We had decades to work on making software more performant, but instead most users' space-age 2nm chips spend most of their time running Javascript because it was faster to make software that way.
gr_norm6 minutes ago
Why would you do that instead of having the model do the task you're using the UI for? It could generate UI widgets on-the-fly as needed to take richer inputs.
psandoran hour ago
Reminds me of this project from Microsoft. A Quake II “simulation” model where the whole application was just a model.
https://www.microsoft.com/en-us/research/articles/whamm-real...
soulofmischief21 minutes ago
These are called world models, which is why the project is called WorldTUI. For another example, take a look at Google's recent Genie models. https://deepmind.google/blog/genie-2-a-large-scale-foundatio...
__mp43 minutes ago
It would be interesting to expose this on the internet. I wonder what the scrapers etc… would do with it.
oilkillsbirdsan hour ago
Very cool. Fun project. I feel like there’s a wide field to be explored once you understand fine tuning good existing models
yjftsjthsd-h26 minutes ago
Wait, how did it `sleep 3`? I thought LLMs didn't have a concept of time
peder15 minutes ago
It’s still rendering frames constantly, no? So it just figures the next X frames are all doing nothing?
sprobertson15 minutes ago
from the post:
Time is an input too. If nothing is pressed, the model gets a WAIT token with a duration instead of a key, which is how snake keeps moving on its own.
yjftsjthsd-h8 minutes ago
That seems as likely as anything, but that just moves the problem to counting, doesn't it? The model gets the duration, but I was under the impression LLMs struggled with the arithmetic that would make that useful.
skohana few seconds ago
Idk about Qwen 2.5 Coder that this is based on, but modern models don't struggle with arithmetic. I see Qwen 3.8 do long-hand math in thinking traces (ie. it outputs 17+35+12=64 in the thinking trace) so I would imagine this is something they train into the model specifically. Sometimes it creates and runs a simple python script to check its work.
obilgican hour ago
There was a whole fake gui OS with similar concept right
andai12 minutes ago
VibeOS - Fully Hallucinated Operating System
prodigycorp38 minutes ago
athropic had an experiment that did exactly this. we need more experimentation in this space.
prodigycorp39 minutes ago
Wow! This this reminds me of when we tried doing this with gpt 3 and.. it worked!
The tmux thing had me confused for a moment until i realized it was emulating tmux. Super fun. Is the model window width aware?
[deleted]an hour agocollapsed
simedw19 minutes ago
[flagged]
htoz1an hour ago
Where is the point of this project if i have terminal ?
mehmetoguzderin40 minutes ago
Terminal world models have many applications, but empirical observation of successful pretraining or fine-tuning can be significant for encapsulating from rather expensive Bash traces, such as ones obtained from systems with scarce accelerators, etc.
YmFzZTY0ZGFkZHk36 minutes ago
Sometimes it's just fun to do something absurd because you can. This is one of the reasons software is exciting.
good-idea34 minutes ago
because curiosity is the most fun of virtues!
dotancohenan hour ago
Because it was there