Robot Cars and Fake Ethical Dilemmas

Something feels dishonest about the moral panic over self-driving cars. It usually involves bizarre crash scenarios that would (probably) never happen in real life. Does it matter that the scenarios are artificial or unrealistic? The details change, but the set-up is the same. We're supposed to imagine that a self-driving car is faced with some terrible decision: should it crash into a crowd of people, or swerve into a single person? Or into a little girl on the road, or swerve into the side of a mountain?