Zoox: ~1-Hour Fully Autonomous Drive in San Francisco with Commentary

James Philbin, our Sr. Director of Perception & Prediction, and Sarah Tariq, our Director of Computer Vision, talk through a ~1-hour drive in bustling SF, sharing insights into how our self-driving technology functions. This drive is 100% autonomous, with full perception output, making it the longest autonomous driving video of its kind released to date. You'll see many complicated scenarios often found in dense urban environments, such as tunnels, double-parked vehicles, cyclists, thousands of pedestrians, unprotected turns, six-way intersections, plus much more. https://zoox.com/ 0:00 Introduction 0:35 Start of Drive 0:43 Turning Right on Red Light 1:14 Explanation of Zoox's Perception Classifications 2:57 Driving Through Tunnel (No GPS) 3:24 Navigating Around Construction Zone 3:45 Turning Right on Red Light 3:53 Understanding Double-Parked Vehicles 4:27 Yielding to Reverse Parking Vehicle 5:00 Navigating 4-Way Intersection 5:12 Driving Up Steep Hill 5:44 Driving Down Lombard Street 7:07 Navigating Around Double-Parked Vehicle 7:17 Explanation of Zoox's X-ray Visualizations Pt. 1 8:09 Unprotected Left Turn at 6-Way Intersection 8:33 Navigating Around Double-Parked Vehicle 9:24 Driving Up Steep, Narrow Hill 10:24 Navigating Around Double-Parked Vehicle 10:49 Explanation of Zoox's X-ray Visualizations Pt. 2 11:03 Driving Up Steep Hill with Occluded Crest 11:13 Explanation of Zoox's Planner System 11:38 Yielding to Pedestrians on the Road 12:51 Double Lane Change 14:00 Flashing Red Lights at 4-Way Intersection 14:35 Green Left Arrow Traffic Light and Protected Left Turn 16:16 Yielding to Bicyclist Cycling Wrong Way up Street 16:35 Yielding to Car Cutting In Front of Vehicle 17:27 Detecting Parking Car 17:48 Detecting and Tracking Pedestrians 18:03 Turning Right on Red Light 18:54 Explanation of Zoox's Unique Sensor Configuration 19:50 Detecting Occluded Objects 20:02 Unprotected Left Turn at 4-Way Intersection 20:11 Overtaking Three Double-Parked Vehicles in a Row 20:29 Explanation of Zoox's Autonomous Stack (Perception, Prediction & Planner) 22:47 Driving in Dense, Multi-Lane Traffic 23:25 Nudging Around Bus in Lane 23:35 Understanding Traffic Lights 24:31 Unprotected Left Turn 25:17 Yielding to Cross Traffic at Occluded Intersection 26:13 Nudging into Bike Lane Before Turning Right 26:35 End of Drive