The Way We Regulate Self-driving Cars is Broken—Here’s How to Fix It

The first driverless cars will be rented, not sold—that has major implications.

Crash reports could provide an early warning system

At least one state has taken an important step in this direction: California requires companies testing driverless cars to report every time their vehicle gets into a crash. This requirement has produced a steady stream of data about how companies in California are performing.

But most states lack rules like this—in part because competition to attract self-driving car companies has led to a race to the bottom in state safety rules. That includes Arizona and Pennsylvania, two states where Uber has done extensive testing.

In these states, we don’t hear about driverless car crashes unless someone involved tells the media about it. This means that we tend to hear about the most spectacular crashes—like a 2017 incident in Tempe where an Uber vehicle rolled over. But the public has no way of knowing how many other crashes might have occurred that didn’t attract the attention of the media.

For example, last month an Uber car slammed into the side of another vehicle in Pittsburgh, Pennsylvania. The driver of the other car talked to a Pittsburgh television station, which did a segment on the evening news. We noticed that story and did our own reporting on the incident.

It wasn’t the biggest story by any means. No one was seriously injured, and it looks like Uber may not have been legally at fault. But if the other driver, Jessica McLemore, hadn’t told local television stations about it, it’s likely the public wouldn’t have heard about it at all.

Were there other minor crashes in the months before Herzberg’s death—crashes that could have hinted at problems with Uber’s self-driving technology? No one outside of Uber headquarters knows, and that’s a problem. A nationwide reporting system like the one in California would make sure the public knows every time a crash like this occurs. And while California’s system is better than nothing, there’s a lot of room for improvement.

Self-driving car companies gather data about every minute a self-driving car is on the road—data they later load into simulators to test future iterations of the driverless car software. An improved reporting system could require companies to release a lot more data—including video and sensor data—from the seconds before every crash. Independent experts could then examine the data and decide for themselves whether a self-driving vehicle’s behavior contributed to a crash.

We saw how significant this kind of disclosure can be in the Herzberg case. Before the release of the video, we heard from Tempe police chief Sylvia Moir that Uber was “likely” not at fault because Herzberg “came from the shadows right into the roadway.” Once the video was released, however, it became clear that this description was misleading. Even if cameras hadn’t picked Herzberg up, the car’s lidar and radar sensors clearly should have. The debate over Herzberg’s death became far more productive once the public had a chance to see the evidence first-hand.

It would be helpful to see this kind of footage for other recent incidents as well. For example, in December a Cruise car in San Francisco side-swiped a motorcycle after an aborted lane change. Cruise says that the motorcyclist was at fault for zipping into Cruise’s lane before the lane change was even complete. The motorcyclist disagrees and has sued Cruise over the incident.So who’s right? It would be helpful if the public could see the video footage from the crash so we can judge for ourselves.

A Cruise vehicle was recently ticketed by a police officer who believed that the car had gotten too close to a pedestrian on a San Francisco street. Cruise says the cop is wrong and that the car gave the pedestrian plenty of room—and it has the data to prove it. If that’s true, why not release it? And if companies won’t release this kind of information voluntarily, why not require them to do so?

A dedicated team should investigate self-driving car crashes

Responsibility for highway safety in the United States is divided between two different agencies. The National Highway Traffic Safety Administration is responsible for writing regulations governing car safety. The National Transportation Safety Board, on the other hand, is an independent agency dedicated to investigating major highway crashes—as well as crashes of airplanes, trains, and other modes of transportation.

After each investigation, the NTSB publishes a report describing what happened and providing recommendations—to carmakers, road designers, and policymakers—about how to prevent future tragedies.

Currently, the NTSB only investigates the most significant car crashes, including last month’s Uber crash in Tempe. But the NTSB doesn’t have time to investigate the vast majority of car crashes—even fatal ones—that happen on American roads each year.

As far as we know, the NTSB hasn’t investigated any non-fatal crashes involving self-driving cars. That’s not surprising given the NTSB’s limited resources, but that could be a big missed opportunity.

The typical car crash doesn’t merit an in-depth investigation because we already know a lot about how and why conventional cars crash. But we currently know very little about how driverless cars perform in the real world. So even if a driverless car doesn’t kill someone, a detailed independent analysis could be very useful.

Crash reports could help policymakers and the general public judge whether a company is doing a reasonable job protecting public safety. Reports could also be useful to self-driving car companies themselves—alerting them to difficult situations their competitors have encountered and allowing them to adjust their software without having to suffer a crash themselves.

Moreover, the wealth of data collected by driverless cars could allow the investigation process to be quite efficient. Rather than having to travel to the site of every crash, an investigator could start by requesting sensor data preceding the crash. Ideally, investigators would have the infrastructure to drop that data into a simulator so they can run through the crash from the office and examine the scene from every angle.

In many cases, the investigator would conclude that the driverless car clearly did nothing wrong—perhaps it was rear-ended by another vehicle. In that case, the investigator could move on to the next case. But if the data indicated the car’s behavior may have contributed to the crash, then she could investigate further.

In addition to investigating car crashes, investigators could also accept tips about erratic self-driving car behavior on public roads. Investigators could ask the company for sensor data from the time of the incident and check to see if the car was doing something dangerous.

Over time, these investigators would become some of the leading external experts on the behavior of the companies whose cars they were investigating. They could serve as an early warning system if a particular company’s cars are behaving more erratically than others.

Driverless taxis make post-sale testing impossible

Anyone can buy a conventional car and perform safety tests on it. Academic researchers, government regulators, and other independent experts can take a car apart, measure its emissions, probe it for computer security flaws, and subject it to crash tests. This means that if a car has problems that aren’t caught (or are even covered up) by the manufacturer, they’re likely to be exposed by someone else.

But this kind of independent analysis won’t be an option when Waymo introduces its driverless car service later this year. Waymo’s cars won’t be for sale at any price, and the company likely won’t let customers so much as open the hood. This means that the public will be mostly dependent on Waymo itself to provide information about how its cars work.

That’s particularly troubling because companies are under a lot of pressure to get their product to market quickly. In that kind of competitive environment, there will always be a temptation to cut corners.

An obvious way to mitigate this problem is to require companies to make detailed disclosures explaining how safety-critical aspects of their cars work—ideally with enough technical depth that independent experts could evaluate them.

For example, one key principle for designing driverless cars is redundancy. In a report filed last October, Waymo reported that its cars had redundancies in all of its safety-critical systems, including the main computer, braking and steering systems, power supply, and so forth. But the report devoted only a half-page to describing the system—safety advocate Henry Jasny described the document as “essentially a sales brochure.”

General Motors filed its own safety report in January, and it had a similarly paltry amount of detail about how the car’s safety features actually worked.

NHTSA could ask Waymo, Cruise, Uber, and other companies with significant testing programs to provide much more detailed documentation about this aspect of the car’s design. NHTSA could then evaluate these filings and produce a public report about the relative strengths and weaknesses of each company’s approach.

This kind of report wouldn’t have to be legally binding to have a significant effect. For starters, the requirement to disclose these details would force executives to focus on whether they have, in fact, made adequate provisions for safety. It would create an opening for safety proponents inside the company to press their case.

And if the report found that one company’s approach was inadequate, that company would not only get bad press, it could also face greater liability if it failed to fix it and then one of its cars subsequently got in a crash.

One advantage of this approach is that it can be applied to a broad range of issues. NHTSA could ask companies about the technical characteristics of vehicles. But it can also ask them about policies and procedures related to issues like vehicle maintenance, cybersecurity, or emergency preparedness.

New resources will be needed to effectively oversee driverless cars

NHTSA already has significant authority to beef up its oversight of driverless car testing if it wanted to. It could require more disclosures by car companies, and it could conduct investigations into car companies’ safety practices.

But a big problem is a lack of resources. Safety advocates have argued for years that NHTSA is under-funded—a theme I’ve heard from multiple experts in recent years as well. Effective oversight of driverless cars is going to require computer science skill, a skill that hasn’t traditionally been a strength of car regulators. That kind of expertise doesn’t come cheap.

The central idea of the leading driverless car legislation in Congress—giving driverless cars an exemption from the FMVSS—is a reasonable one. But that provision should be paired with dedicated funding to allow NHTSA and the NTSB to beef up their capacity to oversee the development of driverless cars.

Conventional thinking about self-driving cars assumes that any safety regulation of self-driving cars now will slow the development of the technology, costing many more lives in the long run. But regulations focused on transparency and oversight shouldn’t impose a significant burden. Indeed, an effective regulatory agency might be able to accelerate the development of driverless cars by encouraging the flow of information between companies.

And one of the biggest dangers to the progress of driverless cars is a series of further crashes along the lines of last month’s Uber crash in Tempe. That could create a public backlash that could set the industry back by years.