Realistically at some point we need to be taken out of the equation. Planes have pilots because of the auto pilot breaks, the plane falls out of the sky.
Cars are easier, if the system has a problem the car stops itself and tells all of the other cars around it to go around. Until we can take the fleshy, stupid, dangerous meat bags out of driving cars, autonomous cars are going to be more of an amusement than a real transportation solution.