Learning How AI Makes Decisions

In 2017, a Palestinian construction worker in the West Bank settlement of Beiter Illit, Jerusalem, posted a picture of himself on Facebook in which he was leaning against a bulldozer. Shortly after, Israeli police arrested him on suspicions that he was planning an attack, because the caption of his post read "attack them." The real caption of the post was "good morning" in Arabic. But for some unknown reason, Facebook's artificial intelligence–powered translation service translated the text to "hurt them" in English or "attack them" in Hebrew. The Israeli Defense Force uses Facebook's automated translation to monitor the accounts of Palestinian users for possible threats. In this case, they trusted Facebook's AI enough not to have the post checked by an Arabic-speaking officer before making the arrest. The Palestinian worker was eventually released after the mistake came to light--but not before he underwent hours of questioning. Facebook apologized for the mistake and said that it took steps to correct it.