They probably have to assume the human co-pilot may still need to assume control and avert disaster, and give them enough extra time to do that (beyond the time they'd need after starting out in control). With no need for failover, the robot should reliably react faster, though it's probably only reacting to immediate events rather than predicting drivers' (mis)behavior.