In this podcast, Turing Award winner Yann LeCun discusses deep learning, convolutional neural networks, and self-supervised learning. He argues AI value alignment isn't new—it's like how societies use laws to constrain behavior. He's bullish on self-supervised learning as key to future AI but notes visual prediction is tough because there are too many possible next frames. Key mentions: Waymo operates self-driving taxis in Phoenix using lots of lidar; Sophia robot is criticized as overhyped with limited real ability.
Yann LeCun, the godfather of deep learning, a professor at New York University, Vice President and Chief AI Scientist at Facebook, and a Turing Award winner, discussed deep learning, convolutional neural networks (CNNs), and self-supervised learning on the Lex Fridman podcast. Core viewpoint: AI sys
Yann LeCun, the godfather of deep learning, professor at New York University, Chief AI Scientist at Facebook, and Turing Award winner, discussed deep learning, convolutional neural networks (CNNs), and self-supervised learning on the Lex Fridman podcast. Core thesis: AI systems face a "value alignment" problem, akin to the machine in 2001: A Space Odyssey harming humans due to an unconstrained objective function. LeCun emphasizes that designing AI objective functions should draw on how human societies shape behavior through laws and education, rather than starting from scratch.
LeCun argues that the "value alignment" problem for AI systems is not a novel challenge; human society has addressed similar issues through legal code for thousands of years.
LeCun argues that the most surprising fact about deep learning is that training giant neural networks with stochastic gradient descent (SGD) on relatively small amounts of data actually works, which "breaks every textbook."
LeCun firmly believes that reasoning must be compatible with gradient-based learning, and therefore opposes the use of discrete logic and symbolic representations of knowledge.
1. Working Memory-Based Reasoning: Requires a subsystem akin to the hippocampus, capable of storing large amounts of factual/situational information. The self-attention mechanism in current Transformers can be viewed as a form of working memory, but it is "insufficient in scale" — if the memory includes the entire Wikipedia, existing architectures cannot function effectively.
2. Energy Minimization-Based Reasoning: Similar to Model Predictive Control (MPC) — using a world model to predict the consequences of actions, and planning action sequences by minimizing an energy function (e.g., number of collisions, energy consumption). LeCun believes this is the origin of human reasoning abilities (hunting, survival require planning).
LeCun believes self-supervised learning is the most important research direction today, but the problem of prediction uncertainty in the visual domain is a core obstacle.
LeCun argues that the term "Artificial General Intelligence" (AGI) is misleading, as human intelligence is far from general and is instead highly specialized.
| Position | Guest Stance | Key Data |
|---|---|---|
| Waymo (Autonomous Driving) | Neutral/Endorses Current Path | Operates within 100 sq km in Phoenix, favorable weather and wide roads, uses extensive LiDAR |
| Sophia Robot | Critical | Marketed as a system far beyond its actual capabilities; LeCun believes "almost everything needs to change" |
1. AI value alignment is not a new problem (LeCun): Human society has addressed similar issues through legal codes for thousands of years—law is the "objective function," defining what is allowed and what is not, with penalties for violations. Designing ethical constraints for AI is "the fusion of legal science and computer science."
2. The most surprising fact about deep learning (LeCun): Training giant neural networks with stochastic gradient descent on relatively small amounts of data actually works, "breaking every textbook." This is akin to the 19th-century assertion that "heavier-than-air flight is impossible"—yet birds do fly.
3. Machine learning is "the science of imprecision" (LeCun): Computer science pursues precision (every index must be correct, algorithms must be provably correct), while machine learning "is precise about nothing." This is one reason deep learning is viewed with suspicion by traditional computer scientists.
4. Reasoning must be compatible with gradient-based learning (LeCun): Representing knowledge with symbols and using logical operations "is incompatible with learning." It should be done as Hinton proposed: replace symbols with vectors, and logic with continuous functions.
5. Self-supervised learning faces a fundamental challenge in vision (LeCun): Predicting masked image regions has countless plausible answers; training with least squares yields "blurry images." This differs from NLP—where the prediction space is small (about 100,000 words) and uncertainty is easier to represent.
6. Human intelligence is far from general (LeCun): The optic nerve has about 1 million fibers, and the number of possible Boolean functions is 2^(2^1,000,000), yet what the visual cortex can compute is only "an infinitesimally tiny, tiny, tiny fraction." Humans are only "general for what is comprehensible."
7. There is no autonomous intelligence without emotion (LeCun): Fear is the anticipation of bad things that might happen in the future—uncertainty creates fear. Therefore, "we cannot have autonomous intelligence without emotion."
8. A good test question for AI intelligence (LeCun): Ask "How is wind generated?" If the AI answers "Because leaves move, so wind is produced," it shows the rudiments of causal reasoning; if it says "That's a stupid question," then it is truly on the right track.