OpenAI's Chief Scientist: AI Is an Alien Mind We Don't Fully Understand
In a personal essay, OpenAI co-founder and Chief Scientist Ilya Sutskever reflects on the moment in 2023 when he realized machines would become smarter than humans, and warns that the rapid progress of AI could lead to recursive self-improvement. He argues that AI is 'grown' more than 'designed', making it an 'alien mind' whose inner workings are opaque. Sutskever discusses the challenges of aligning such systems with human values, the limitations of current monitoring techniques like chain-of-thought, and the urgent need for broader interventions beyond technical fixes.
AI is grown more than designed - it is, to first degree, the product of repeating a straightforward optimization step many times on a hard-to-imagine amount of compute.