← Back to list
Lex Fridman PodcastPodcast22 Oct 2020Source: lexfridman.comHost: Lex Fridman

#132 – George Hotz: Hacking the Simulation & Learning to Drive with Neural Nets

In plain words

This interview covers George Hotz and his company Comma.ai's approach to self-driving cars. He argues that the current method used by Tesla and Waymo—breaking driving into many small tasks—is outdated and will be replaced by 'end-to-end learning' like AlphaZero. He is bearish on Waymo, calling its product logic flawed, and criticizes Nvidia for overpricing its chips. Key holdings: Comma.ai (sells a $1,200 device, ~2,000 daily users), Tesla (may win long-term but needs fixes), and Waymo (explicitly bearish, predicts failure).

AI SummaryAI-generated · may contain errors · verify against the original

At a Glance

George Hotz (Geohot), founder of Comma.ai, hacker, and former iPhone jailbreak developer. The core theme of this episode is Comma.ai's end-to-end autonomous driving technical approach, business model, and competitive landscape. The most significant takeaway: George Hotz believes that the ultimate solution for autonomous driving is end-to-end learning similar to AlphaZero / MuZero, rather than the "task engineering" (multi-task perception + rule-based stitching) approach currently adopted by Tesla and Waymo; the latter is essentially a higher-order form of feature engineering and will ultimately be replaced by end-to-end methods.

~9 min full read · 5 sections
Deep Analysis

End-to-End vs. Task Engineering: The "AlphaZero Moment" for Autonomous Driving

George Hotz argues that Tesla's multi-task perception (segmentation, detection, prediction) approach is a form of "task engineering," a higher-level feature engineering that will eventually be replaced by end-to-end learning.

He cites the AlphaZero case, noting that the modern chess engine (Stockfish) has a much larger codebase than AlphaZero, but the latter is more elegant and concise through learning. He calls MuZero "the foundational paper of the entire deep learning era" and believes it is the "solution" for autonomous driving—namely, performing "murder" and "rollback" (referring to extensive trial and error in simulation) within a learned dynamic model (simulator).

Argument Process:

  • Analogy: "If you were starting a chess engine company, would you hire a 'rook' expert?" — Hotz argues that breaking down driving into hundreds of independent tasks (such as "lane detection expert," "cone detection expert") is absurd.
  • Data Chain: Comma.ai's OpenPilot can now achieve "lane-line-free" driving, and its lateral control policy is almost entirely end-to-end, trained on actual user driving data.
  • Deduction: He believes that end-to-end is the only path to L5 autonomous driving. Although task engineering is theoretically feasible, the scale of engineering challenges may exceed human capabilities. His timeline is "late 2020s" for realization.

Hotz also acknowledges uncertainty: "I cannot make promises on timelines. But AI history shows that feature engineering approaches are always replaced by end-to-end approaches."


商业模式:先交付,后盈利,以“真实资本主义”为锚

Comma.ai的使命是“解决自动驾驶汽车,同时交付可发货的中间件”。 Hotz强调,“交付可发货的中间件”不仅是融资手段,更是让公司保持诚实的约束,避免像Waymo那样陷入“设定任意里程碑,仍然离目标无限远”的陷阱。

论证过程:

  • 核心逻辑“真实资本主义基于同意”。用户花$1,000购买Comma.2设备,意味着他们获得了至少$1,000的价值。现金流是公司价值的直接证明。
  • 数据链
  • Comma.2售价:设备$1,000 + 车接口$200,总计$1,200。
  • 用户留存70%的Comma.2购买者是每日活跃用户(DAU)
  • 用户规模:日活跃用户约2,000,周活跃约2,500,月活跃超过3,000
  • 未来预测:预计明年销售10,000台,按千美元单价,收入对应$1,000万;若销量达10万台,单价翻倍,收入可达$2亿
  • 推演:Hotz认为Comma.ai的商业模式对标Android:开源软件(OpenPilot)可能吸引更多用户,Comma.ai作为硬件公司,就像Google的Pixel手机,从中获取10%的份额也能赚取丰厚利润。他明确表示,不会出售公司,认为大型企业的并购行为“很侮辱人”。

Competitive Landscape: Critical Analysis of Tesla, Waymo, and NVIDIA

Hotz levels sharp criticism at major industry players while maintaining a nuanced stance toward Tesla.

  • On Waymo (outright rejection): Hotz argues that Waymo's problem is not technology but product logic. "Their product makes no sense." He cites an example: Waymo's autonomous driving is 20% slower than an Uber driver, yet in Uber Pool, users can already trade time for money, but only 15% choose to do so. He believes the L4 robo-taxi market will devolve into a "race to the bottom," much like the scooter market. He bluntly states: "I can't wait to see Waymo fail" and suggests that Anthony Levandowski (the engineer convicted of stealing trade secrets) should take over the company.
  • On NVIDIA (critical bearish view): Hotz believes that NVIDIA, as a chip supplier, is "killing the goose that lays the golden eggs." Its high pricing (A100 sells for $10,000, while the similarly specced RTX 3080 costs only $699) will "shoot itself in the foot." He observes that NVIDIA's management has become greedy since 2018, shifting from a "platform company" to a monopolist focused on "maximizing profits," which will push customers (such as Tesla) toward in-house development (Dojo).
  • On Tesla (complex stance, believes corrections are needed but it can still win): Hotz argues that Tesla is broadly on the right track, requiring only a few adjustments: adding infrared cameras for driver monitoring and ultimately transitioning to end-to-end learning. He acknowledges: "Tesla can still win. Elon is better than me at mobilizing massive resources... Even if they make some mistakes, they will eventually win."

Mentioned Positions

Position Guest Attitude Key Data
Comma.ai Bullish (self-described) ~2,000 daily active users; 70% D1 retention; Comma.2 priced at $1,200; projected revenue of $10 million next year
Tesla / Autopilot Bullish (long-term), but needs correction Hotz believes it will ultimately win, but needs to add driver monitoring and shift to an end-to-end approach
Waymo Clearly Bearish Hotz thinks its product logic is flawed, predicts it will fail, and says "it has already spent $10 billion, but the model is unsustainable"
NVIDIA Critically Bearish Hotz criticizes its pricing strategy (A100 vs. RTX 3080) and believes it will lose the ecosystem
Optimism (Ethereum L2) Neutral (technical partner) No position action, but Hotz modified its compiler (300 lines of code) to resolve its technical difficulties

Judgments Worth Remembering

1. Endpoint of the technical route (George Hotz): “MuZero wrote the solution for autonomous driving on paper.” — End-to-end learning plus a learned dynamic model (simulator) is the only path; segmented task engineering (feature engineering) will eventually be replaced.

2. Business model anchor (George Hotz): “Real capitalism is based on consent.” — Users buying products with real money is the most honest proof of a company's value, and also a corrective mechanism to avoid “infinitely approaching but never reaching the goal.”

3. Fatal critique of Waymo (George Hotz): “Their product makes no sense. Users can already choose to trade time for money, but defaulting to a slower and more expensive option is illogical.” — The core argument is that the business model of L4 Robotaxi is less competitive than existing Uber/Lyft, and the market will fall into a race to the bottom like the scooter market.

4. Warning to NVIDIA (George Hotz): “NVIDIA is killing the goose that lays the golden eggs. Sell chips, not dreams.” — Its high pricing (A100 vs RTX 3080) will drive customers (like Tesla) to develop their own chips, ultimately losing the market ecosystem.

5. Mild criticism of Tesla (George Hotz): “Elon will install driver monitoring before he reaches L5.” — He believes Tesla's vision solution (no infrared) is a major flaw, but it is a correctable “software problem” that does not affect its long-term success.

6. Product design philosophy: Adaptive driver monitoring (George Hotz): “Driver monitoring strategy must be scene-adaptive. The loosest on highways, the strictest in urban areas.” — The goal is to prevent fatigue and false alarms, and to prevent users from “learning to ignore it.” This is achieved through machine learning, not hand-written rules.

7. Key falsification condition (George Hotz): “When our unplanned disengagement rate improves from every 100 miles to every 100,000 miles, we will be approaching L5.” — It clearly sets an order-of-magnitude target, acknowledging the huge gap between current levels and human driving, but believes in exponential improvement.

8. Unique insight on AI (George Hotz): “Compression is intelligence. The Hutter Prize framework made me understand modern AI.” — He proposes that reducing the problem of intelligence to a lossless compression problem is the core framework for understanding artificial intelligence, driving his exploration in this field.