Assuming the investment in driverless cars pays off in couple of years from now there will be massive job losses specially for taxi/uber drivers.

Since the initial driverless cars cannot be perfect, would it make sense for Uber to start with Remote taxi drivers (drivers sitting at home with a VR headset taking customers to homes)?

What are the challenges with this idea?