demibabs33 minutes ago
What happens if there are no more humans in the loop, and instead of building on human work, models have to build on their own work? Would we get stuck in a local maxima?
When AI labs talk about “long-horizon tasks”, they mean tasks on the order of a few days. But what about keeping coherence across decades, like humans can? Models are not trained or tested on the ability to do that, and it seems unlikely that capability would naturally exist.
karim7915 minutes ago
I'm pretty sure that if you put a few LLMs, agents, or anything into a room together without outside access, and get them to learn off of each other, you'll end up with gibberish, nonsensical garbage and definitely nothing magical will happen. Delirium, oblivion, dementia and so on...
darkerside21 minutes ago
Coherence is a given... What we lose over decades is alignment.
needfish2 hours ago
I wish AI could do my chores. Laundry, folding clothes, dishes, cleaning... That would be nice.
arcanemachineran hour ago
If it does that, you should hope it can also stand in bread lines for you too.
[deleted]an hour agocollapsed
voidhorse38 minutes ago
Unfortunately that will never happen because the people who stand to benefit most from AI already have cost-efficient (see grossly underpaid) humans to do this for them.
They need AI to replace the expensive not cost-effective humans.
georgemcbayan hour ago
> I wish AI could do my chores. Laundry, folding clothes, dishes, cleaning... That would be nice.
Sorry, AI only does the fun stuff.
Off to the silica sand mines with you and the rest of the meat bags to keep the AI well fed.
charcircuit36 minutes ago
Washing machines, dish washers, power washers, etc exist.
esafak5 minutes ago
Yours put your laundry and dishes away?
Founderarcstonean hour ago
one day soon, right?
mykoan hour ago
literally the only thing i want out of ai ^^^^
that said, it is fun generating code with them
Rover222an hour ago
this will of course happen in a few years...
dd8601fnan hour ago
Won’t matter. Most of us won’t have paychecks to buy it with.
Kidding (…kinda).
streetcat12 hours ago
AI can do anything that it was trained on based on humans. As soon as humans are not involved, AI will have nothing to train on, and hence, the rate of improvement will approch zero, and the AI will collapse.
felipeeriasa minute ago
Nowadays training relies heavily on reinforcement learning with verifiable rewards (RLVR), which assesses a model's output according to objective automated checks, not subjective human judgments.
bpodgursky35 minutes ago
Human knowledge races up to the frontier through formal education and then nudges past the frontier a little bit at a time and AI will train on AI outputs that do the same. But, it will do it 1000x faster than humans because that's just how they work.
charcircuit32 minutes ago
>1000x faster than humans
Some of the process of expanding the frontier is not parallelizable and is built on top of previous discoveries. And pushing the frontier requires doing things in the real world, or running experiments that take significant real world time that can hurt your 1000x faster claim.
[deleted]36 minutes agocollapsed
Rover222an hour ago
what a dumb thing to keep repeating at this point
lolakutty8 minutes ago
Why?
esafak2 minutes ago
Because all the models train on synthetic data too, plus they can collect their own data with robots.
jazzpush2an hour ago
Just ignoring all the recently solved math problems human, huh?
tacomonstrousan hour ago
If you understood how they were solved, you'd see that you're only bolstering the point you were responding to.
daft_pink36 minutes ago
I think what you are missing is that it will dramatically lower the cost of living so that everyone’s standard of living increases. It’s not about jobs.
irishloop34 minutes ago
I don't think there's any particularly good evidence of this other than blind optimism.
zobzu20 minutes ago
that's not how it works. you get better tech for the same or more work and you can work longer before you die.
if you are no longer needed, you won't be allowed to live.
makes me chuckle every time folks think humans who get to power are nice.
esafak8 minutes ago
Housing and healthcare are going to get cheaper??
dosisking23 minutes ago
> I think what you are missing is that it will dramatically lower the cost of living so that everyone’s standard of living increases. It’s not about jobs
This is flat out wrong. The problem is excessive taxation and government spending beyond its means that lowers everyone's standard of living.
tacomonstrous17 minutes ago
Not always that you see two wildly wrong claims made in ostensible opposition to each other
applfanboysbgon19 minutes ago
> the people who are grasping for some indication that AI can’t do everything have become increasingly desperate. If you push hard enough, the answer is inevitably something like “the AI simply cannot [dream, love, laugh],”
Dogshit strawman article. I am willing to concede that a token predictor is better than you at whatever task you can dream up. It is not better than me, and will never be better than me, at my profession.
octoberfranklin29 minutes ago
New is never normal.
I stopped reading when the author became overwhelmed by their compulsion to blame everything in the universe to the current US president.