Autonomous Driving in the Face of Unconventional Odds