preserve self
Self-Preserving Artificial Intelligence
I'm sure most people have heard of the dilemma of whether to design self-driving cars to reduce the number of deaths or to protect their driver. To those of you who haven't, picture this; you are sitting in your cars which is driving along in a partially blind curve. The car discovers a crowd of people in the lane without enough distance to stop the car. There are only two options, hit the crowd and potentially kill lots of people or drive the car off a cliff, sacrificing the driver while reducing the total number of deaths. On a macro level, the car should go off the cliff since the number of deaths is reduced.