Start / LessWrong posts by zvi / Ai 91 deep thinking by zvi

“AI #91: Deep Thinking” by Zvi

108 min • 21 november 2024

Did DeepSeek effectively release an o1-preview clone within nine weeks?

The benchmarks largely say yes. Certainly it is an actual attempt at a similar style of product, and is if anything more capable of solving AIME questions, and the way it shows its Chain of Thought is super cool. Beyond that, alas, we don’t have enough reports in from people using it. So it's still too soon to tell. If it is fully legit, the implications seems important.

Small improvements continue throughout. GPT-4o and Gemini both got incremental upgrades, trading the top slot on Arena, although people do not seem to much care.

There was a time everyone would be scrambling to evaluate all these new offerings. It seems we mostly do not do that anymore.

The other half of events was about policy under the Trump administration. What should the federal government do? We [...]

---

Outline:

(01:31) Language Models Offer Mundane Utility

(05:37) Language Models Don’t Offer Mundane Utility

(08:14) Claude Sonnet 3.5.1 Evaluation

(11:09) Deepfaketown and Botpocalypse Soon

(11:57) Fun With Image Generation

(12:08) O-(There are)-Two

(15:25) The Last Mile

(22:52) They Took Our Jobs