EVEN IN THE middle of the day, the 50-mile trip from San Francisco to San Jose is a pain. Like a toddler, Bay Area driving toggles between slumber (rush-hour slogs) and frenzy (passing-happy speeding). It’s enough to make one eager for the day when robots rule the roads. And it’s more than enough to make me envy Evan Livingston, who doesn’t have to show up in person this meeting, held in a Lincoln MKZ sedan roaming downtown San Jose.
No, Livingston is sitting comfortably in his office in Portland, Oregon, when he appears on the screens inside the car and announces he’ll be our teleoperator this afternoon. A moment later, the MKZ pulls into traffic, responding not to the man in the driver’s seat, but to Livingston, who’s sitting in front of a bank of screens displaying feeds from the four cameras on the car’s roof, working the kind of steering wheel and pedals serious players use for games like Forza Motorsport. Livingston is a software engineer for Designated Driver, a new company that’s getting into teleoperations, the official name for remote controlling self-driving vehicles.
Teleoperations is a little discussed but vital element of putting self-driving tech into the world. The serious players in this space aren’t about to let their robots into the world without the ability to drive, or at least direct them from afar. Waymo, General Motors’ Cruise, Nutonomy, Zoox, Drive.ai, Uber, and Nissan are all quietly developing teleoperation systems. California law says vehicles without drivers inside them must allow for remote control. Florida, Arizona, Oregon, and Washington are considering similar rules. US Senator Richard Blumenthal (D-Connecticut) has said he wants similar language in AV Start, the would-be federal law governing self-driving tech that has been languishing in Congress for nearly two years.
Designated Driver sees a market there. Autonomy is a vast space, including ride-hail cars, trucks, shuttles, tractors, mining equipment, sidewalk robots, and more. Surely not every company will have the time, resources, or patience to develop their own remote control system. That makes them potential customers. “We’re still struggling with voice control, right?” says CEO Manuela Papadopal. “The reality is that communication is a challenge.”
Papadopal and her co-founder, Walter Sullivan, aim to capture 20 percent of the teleoperations market in the next couple of years by solving that challenge, and offering the resulting hardware, software, and logistical know-how to anyone with a robot and a checkbook. Just what that market’s worth remains to be seen, but even a tiny slice of an industry expected to be worth trillions should do just fine.
On the tech side, the key issue is latency: Remote controlling a car doesn’t work if you’re even a second behind what’s happening. Designated Driver plugs into both Verizon and AT&T’s networks using four cellular radios. Even on a 4G connection, Papadopal says they’ve already dropped latency times below 100 milliseconds. And the team plans to dynamically adjust the resolution of the operator’s video feed when the connection slows (just like Netflix does).
The actual setup for the remote driver will evolve, but for now DD is using a bank of six screens that display the feeds from various cameras on the car and a map of the area. The remote driver can do everything he could if he were sitting in the car: use the turn signals, honk, change gears, and so on. The remote steering wheel even provides torque feedback the way the one in the car does, but the company is still figuring out how to ensure the operator can drive smoothly if they don’t get pushed back in their seat when accelerating, or jerk forward on a hard brake.
To start, Designated Driver has one customer: AutonomouStuff, an Illinois-based company that works as a sort of self-driving industry supplier, will now offer DD’s teleoperation kit for cars and other vehicles that don’t operate on public roads (think mining and agriculture). But Papadopal’s team isn’t coming into a green field. Phantom Auto does the same sort of work, and now has eight customers. Since launching last year, it has swung its focus from AVs on public roads to more immediate applications, like the sidewalk delivery robots now roaming cities around the US. “There’s other ways that autonomous technology is being deployed right now,” says cofounder Elliot Katz.
And of course, many companies developing robo-tech will prefer to build their own teleop tech. But autonomy promises to be a very large market. Designated Driver just has to control a small bit of it—from afar—to stick around.