“On Devin” by Zvi

Introducing Devin

Is the era of AI agents writing complex code systems without humans in the loop upon us?

Cognition is calling Devin ‘the first AI software engineer.’

Here is a two minute demo of Devin benchmarking LLM performance.

Devin has its own web browser, which it uses to pull up documentation.

Devin has its own code editor.

Devin has its own command line.

Devin uses debugging print statements and uses the log to fix bugs.

Devin builds and deploys entire stylized websites without even being directly asked.

What could possibly go wrong? Install this on your computer today.

Padme.

The Real Deal

I would by default assume all demos were supremely cherry-picked. My only disagreement with Austen Allred's statement here is that this rule is not new:

Austen Allred: New rule:

If someone only [...]

---

Outline:

(00:02) Introducing Devin

(00:48) The Real Deal

(03:27) The Metric

(04:48) What Could Possibly Go Subtly Wrong?

(07:29) What Could Possibly Go Massively Wrong for You?

(09:36) If This is What Skepticism Looks Like

(12:33) What Happens If You Fully Automate Software Engineering

(16:24) What Could Possibly Go Massively Wrong for Everyone?

(18:24) Conclusion: Whistling Past

---

First published:
March 18th, 2024

Source:
https://www.lesswrong.com/posts/wovJBkfZ8rTyLoEKv/on-devin

---

Narrated by TYPE III AUDIO.