AIExplained patreon

Is o1 No Longer a LLM? LeCun + New 'LRM' paper explained (+ exclusive interview clips)

🕑 Added 2024-09-24 14:05:00 +0000 UTC

Comments

Andrew Salinas

When do you think true AGI will arrive?

Pacert

I loved the video and now feel excited and a bit nervous where all of this new LRM domain is heading. I have one question that is still unclear to me. It seems that LRMs do not improve performance outside of a scientific setting, provable correct answer like in math, on which RL can be performed. I would have expected these abilities to increase as well given that the reasoning strategies where reinforced. But maybe the issue is actually how to evaluate such a setting. I am thinking of tasks like, plan my next vacation I like x,y,z and have 3000$ or so. Where there is not a right answer of final location but of how well the model derived its answer from the initial conditioning(likings of the user). Sorry for the wall of text

Doug97

Good video - will it make its way onto Youtube?

Martin Fjeldbonde

Great video again! I have just watched your video on Situation Awareness. Would love to hear if your analysis of Leopold’s claims have changed with the release of O1?

Jonathan Kirk

I am glad that the researchers pointed out the cost and time constraints with o1, but I think some leniency is also due. New technologies and frontiers were never meant to be efficient right away. So who knows what this will look like once the chips have been improved, the micro-nuclear plants built, and the models scaled up. This decade will not be forgotten.

Billy N

I was talking with Beth Rudden from Bast AI on hybrid symbolic/LLM systems for critical work. Would be worth talking/interviewing her.

Tom English

It's worthwhile to review Andrej Karpathy's notion, sketched 10 months ago in a YouTube talk (starting at 42:15), of an "LLM OS" with an LLM "kernel process" making use of tools: https://youtu.be/zjkBMFhNj_g?si=kzFx73VBJ-aXPdvy&t=2535

Michal Babula

I think I will use O1 models more often (as part of an agent's workflow) when APIs become easier to acces.

Philip

Don't crack out 2001 unless it's worth it!

Michael Cho

Loving the background music to this video :)

Erik

You know it's serious when Phillip highlights words like "quantum improvement" in the first 5 minutes of his video, and doesn't specify any caveats until much later!

Lee FRASER

Thanks for another fantastic exclusive to your old and new Patreons.

Gabor Melli

Now we (likely) know what Ilya (and the board?) saw.

Nikolai NM

I had a wish come through here: perspectives on planing :)

Alexis Olson

Next-gen LRM + competent tool use is going to be quite powerful.

Philip

Yeah, which boils down to the richness of the training data

Philip

I agree totally

Philip

I did, yeah, at like -30 decibels to normal vol.

Christian Hendriksen

Sneaky Philip

Barnaby Golden

If reasoning can be scaled using inference cost, does the bottleneck become the world-model?

SteveHaupt

I have the impression that most people don't realize what the new capabilities of o1 are. Thank you for pointing them out with very good examples. I wonder what the limit of LRM will be.