Andrej Karpathy — “We’re summoning ghosts, not building animals”

You could go with the title from the associated YouTube video ( [VIDEO] )? Andrej Karpathy — “We’re summoning ghosts, not building animals”

Not criticizing per se but I just watched this recent (and great!) interview where he extols how special written language is. That was my take away at least. Still trying to wrap my head around this vision encoder approach. He’s way smarter than me! [VIDEO]

He gives an update in the Dwarkesh interview: [VIDEO] Not too many details on timeline - just that he's working on it.

Electricity analogy is fairplay, but ChatGPT had something like 110% global adoption 5 minutes after its release. The infrastructure and the electrical appliances had to catch up, but the Internet is all built out already. So I think it's fair to be looking at results a few years in. Andrey Karpathy famously mentioned in an interview with Dwarkesh Patel [0], that the computer doesn't show up on GDP numbers, there's no noticeable jump or change in slope. Even if Excel is so damn fast, people are likely not drawing its full potential, and institutions are likely actively resisting change anyway. My take is that the general population hasn't found the productive levers yet, they're at the stage where they're happy to drag down and auto generate the date list in Excel, but don't know to adjust diagrams or read function docs, not to even mention VBS scripting. And the enthusiast (dev) community I'd say is starting adoption with internal tools, and shot-in-the-dark apps, but big successes need time to mature in all the other ways (design, reliability, user feedback, marketing...), which comes back to what you said also, that needs time. Product Market Fit isn't happening automatically by chance or good prompting, I would like to think. [0] [VIDEO]

This is kinda a hilarious coincidence, because I just watched a podcast with Andrej Karpathy, the guy who was running their autopilot program back when the sage "fully autonomous in one year" predictions kicked of their 15+ year long run (and counting). These days he's moved on to predicting 10 years for AGI and is, I shit you not, citing his 15 year track record of making accurate predictions (timestamped link below if you want have a laugh). [VIDEO]