The Rise and Fall (and Rise) of Datasets

Data sets are not neutral, but represent particular social and political norms, which can specifically affect marginalized groups. In recent years, many popular data sets have been identified by the machine-learning community as having an alarming number of potential legal and ethical problems--representational harms, effects of bias, privacy infringement, and unclear or dubious downstream use. This has led several data sets to be taken down or heavily redacted. In practice, however, they continue to be available and widely used, either in their original form, such as via online torrents, or in derivative form, as subsets or modifications of the original data set or models pretrained on the deprecated data set. Moving forward, a fundamental change in data set culture is necessary.