Recent advances in deep learning techniques have enabled machines to generate cohesive open-ended text when prompted with a sequence of words as context. While these models now empower many downstream applications from conversation bots to automatic storytelling, they have been shown to generate texts that exhibit social biases. To systematically study and benchmark social biases in open-ended language generation, we introduce the Bias in Open-Ended Language Generation Dataset (BOLD), a large-scale dataset that consists of 23,679 English text generation prompts for bias benchmarking across five domains: profession, gender, race, religion, and political ideology. We also propose new automated metrics for toxicity, psycholinguistic norms, and text gender polarity to measure social biases in open-ended text generation from multiple angles. An examination of text generated from three popular language models reveals that the majority of these models exhibit a larger social bias than human-written Wikipedia text across all domains. With these results we highlight the need to benchmark biases in open-ended language generation and caution users of language generation models on downstream tasks to be cognizant of these embedded prejudices.

The diffusion of innovations is an important topic for the consumer markets. Early research focused on how innovations spread on the level of the whole society. To get closer to the real world scenarios agent based models (ABM) started focusing on individual-level agents. In our work we will translate an existing ABM that investigates the role of opinion leaders in the process of diffusion of innovations to a new, more expressive platform designed for agent based modeling, GAMA. We will do it to show that taking advantage of new features of the chosen platform should be encouraged when making models in the field of social sciences in the future, because it can be beneficial for the explanatory power of simulation results.

The US should not agree to ban the use or development of autonomous weapons powered by artificial intelligence (AI) software, a government-appointed panel has said in a draft report for Congress. The panel, led by former Google chief executive Eric Schmidt, on Tuesday concluded two days of public discussion about how the world's biggest military power should consider AI for national security and technological advancement. Its vice-chairman, Robert Work, a former deputy secretary of defense, said autonomous weapons are expected to make fewer mistakes than humans do in battle, leading to reduced casualties or skirmishes caused by target misidentification. "It is a moral imperative to at least pursue this hypothesis," he said. For about eight years, a coalition of non-governmental organisations has pushed for a treaty banning "killer robots", saying human control is necessary to judge attacks' proportionality and assign blame for war crimes.

Conventional algorithmic fairness is West-centric, as seen in its sub-groups, values, and methods. In this paper, we de-center algorithmic fairness and analyse AI power in India. Based on 36 qualitative interviews and a discourse analysis of algorithmic deployments in India, we find that several assumptions of algorithmic fairness are challenged. We find that in India, data is not always reliable due to socio-economic factors, ML makers appear to follow double standards, and AI evokes unquestioning aspiration. We contend that localising model fairness alone can be window dressing in India, where the distance between models and oppressed communities is large. Instead, we re-imagine algorithmic fairness in India and provide a roadmap to re-contextualise data and models, empower oppressed communities, and enable Fair-ML ecosystems.

Deep neural networks have revolutionized many machine learning tasks in power systems, ranging from pattern recognition to signal processing. The data in these tasks is typically represented in Euclidean domains. Nevertheless, there is an increasing number of applications in power systems, where data are collected from non-Euclidean domains and represented as the graph-structured data with high dimensional features and interdependency among nodes. The complexity of graph-structured data has brought significant challenges to the existing deep neural networks defined in Euclidean domains. Recently, many studies on extending deep neural networks for graph-structured data in power systems have emerged. In this paper, a comprehensive overview of graph neural networks (GNNs) in power systems is proposed. Specifically, several classical paradigms of GNNs structures (e.g., graph convolutional networks, graph recurrent neural networks, graph attention networks, graph generative networks, spatial-temporal graph convolutional networks, and hybrid forms of GNNs) are summarized, and key applications in power systems such as fault diagnosis, power prediction, power flow calculation, and data generation are reviewed in detail. Furthermore, main issues and some research trends about the applications of GNNs in power systems are discussed.

In many domains data is currently represented as graphs and therefore, the graph representation of this data becomes increasingly important in machine learning. Network data is, implicitly or explicitly, always represented using a graph shift operator (GSO) with the most common choices being the adjacency, Laplacian matrices and their normalisations. In this paper, a novel parametrised GSO (PGSO) is proposed, where specific parameter values result in the most commonly used GSOs and message-passing operators in graph neural network (GNN) frameworks. The PGSO is suggested as a replacement of the standard GSOs that are used in state-of-the-art GNN architectures and the optimisation of the PGSO parameters is seamlessly included in the model training. It is proved that the PGSO has real eigenvalues and a set of real eigenvectors independent of the parameter values and spectral bounds on the PGSO are derived. PGSO parameters are shown to adapt to the sparsity of the graph structure in a study on stochastic blockmodel networks, where they are found to automatically replicate the GSO regularisation found in the literature. On several real-world datasets the accuracy of state-of-theart GNN architectures is improved by the inclusion of the PGSO in both nodeand graph-classification tasks. Graph representation learning has attracted a significant research interest over the last years, mainly due to the structural complexity of real-world data and applications (Hamilton et al., 2017b; Wu et al., 2020). The topology of the observations plays a central role when performing machine learning tasks on graph structured data.

Expressive text encoders such as RNNs and Transformer Networks have been at the center of NLP models in recent work. Most of the effort has focused on sentence-level tasks, capturing the dependencies between words in a single sentence, or pairs of sentences. However, certain tasks, such as argumentation mining, require accounting for longer texts and complicated structural dependencies between them. Deep structured prediction is a general framework to combine the complementary strengths of expressive neural encoders and structured inference for highly structured domains. Nevertheless, when the need arises to go beyond sentences, most work relies on combining the output scores of independently trained classifiers. One of the main reasons for this is that constrained inference comes at a high computational cost. In this paper, we explore the use of randomized inference to alleviate this concern and show that we can efficiently leverage deep structured prediction and expressive neural encoders for a set of tasks involving complicated argumentative structures.

In this paper we propose an extension of the notion of deviation-based aggregation function tailored to aggregate multidimensional data. Our objective is both to improve the results obtained by other methods that try to select the best aggregation function for a particular set of data, such as penalty functions, and to reduce the temporal complexity required by such approaches. We discuss how this notion can be defined and present three illustrative examples of the applicability of our new proposal in areas where temporal constraints can be strict, such as image processing, deep learning and decision making, obtaining favourable results in the process.

There is growing evidence showing the significant role of social determinant of health (SDOH) on a wide variety of health outcomes. In the era of artificial intelligence (AI), electronic health records (EHRs) have been widely used to conduct observational studies. However, how to make the best of SDOH information from EHRs is yet to be studied. In this paper, we systematically reviewed recently published papers and provided a methodology review of AI methods using the SDOH information in EHR data. A total of 1250 articles were retrieved from the literature between 2010 and 2020, and 74 papers were included in this review after abstract and full-text screening. We summarized these papers in terms of general characteristics (including publication years, venues, countries etc.), SDOH types, disease areas, study outcomes, AI methods to extract SDOH from EHRs and AI methods using SDOH for healthcare outcomes. Finally, we conclude this paper with discussion on the current trends, challenges, and future directions on using SDOH from EHRs.

Housebound by a pandemic, humanity slowed its emissions of greenhouse gases in 2020. But Earth paid little heed: Temperatures last year tied the modern record, climate scientists reported last week. Overall, the planet was about 1.25°C warmer than in preindustrial times, a trend that puts climate targets in jeopardy, according to jointly reported assessments from NASA, Berkeley Earth, the U.K. Met Office, and the National Oceanic and Atmospheric Administration. The annual update of global surface temperatures—an average of readings from thousands of weather stations and ocean probes—shows 2020 essentially tied records set in 2016. But the years were nothing alike. Temperatures in 2016 were boosted by a strong El Niño, a weather pattern that warms the globe by blocking the rise of cold deep waters in the eastern Pacific Ocean. Last year, however, the Pacific entered La Niña, which has a cooling effect. That La Niña didn't provide more relief is an unwelcome surprise, says Nerilie Abram, a climate scientist at Australian National University. “It makes me worried about how quickly the global warming trend is growing.” The past 6 years are the six warmest on record, but the warming of the atmosphere is unsteady because of its chaotic nature. The ocean, which absorbs more than 90% of the heat from global warming, displays a steadier trend, and here, too, 2020 was a record year. The upper levels of the ocean contained 20 zettajoules (1021 joules) more heat than in 2019, and the rise was double the typical annual increase, scientists reported last week in Advances in Atmospheric Sciences . The subtropical Atlantic Ocean was particularly hot, fueling a record outbreak of hurricanes, says Lijing Cheng, a climate scientist at the Chinese Academy of Sciences's Institute of Atmospheric Physics who led the work. This heat, monitored down to 2000 meters by a fleet of 4000 robotic probes, is spreading deeper into the ocean while also migrating toward the poles. An extreme heat wave struck the northern Pacific, killing marine life. For the first time, warm Atlantic waters were seen penetrating into the Arctic Ocean, melting sea ice from below and reducing its extent nearly to a record low ( Science , 28 August 2020, p. [1043][1]). The warming ocean and melting ice sheets are raising sea levels by 4.8 millimeters per year, and the rate is accelerating ( Science , 20 November 2020, p. [901][2]). On land, 2020 was even more relentless, with temperatures rising 1.96°C above preindustrial levels, a clear record, Berkeley Earth reported. It was the warmest year ever in Asia and Europe and tied for the warmest in South America. Russia was particularly hot, breaking its previous record by 1.2°C, while swaths of Siberia were 7°C warmer than in preindustrial times, leading to large-scale fires and thawing permafrost that caused buildings to founder and set off oil spills ( Science , 7 August 2020, p. [612][3]). “Siberia was crazy,” says Zeke Hausfather, a climate scientist at the Breakthrough Institute and co-author of the Berkeley Earth analysis. “That heat would effectively be impossible without the warming we've seen.” In Australia, record-setting heat and drought fueled catastrophic bushfires at the start of 2020. Fires torched nearly one-quarter of southeastern Australia's forests and destroyed 3000 homes. Climate change was to blame for the country's “Black Summer,” Abram and co-authors concluded in a study published this month in Communications Earth & Environment . Meanwhile, in the United States, unprecedented heat came to the desert Southwest, which is already warming faster than the rest of the country. Phoenix wilted under its hottest summer ever, averaging 36°C. Arizona's Maricopa county, home to Phoenix, is a leader in addressing heat exposure, yet its heat deaths have hit a new record each year since 2016. In 2020, the number approached 300, a jump of some 50% over the previous year, says David Hondula, a climatologist who studies heat mortality at Arizona State University, Tempe. “It was just off the charts in terms of heat.” ![Figure][4] Turning up the heatCREDITS: (GRAPHIC) N. DESAI/ SCIENCE ; (DATA) MET OFFICE; NASA; BERKELEY EARTH; NOAA Although the global economic slowdown of the COVID-19 pandemic cut carbon dioxide (CO2) emissions by some 7%, atmospheric CO2 is long-lived, and warming from previous emissions is preordained. In any case, the drop in emissions is unlikely to last. Later this year, in May, before photosynthesis in the Northern Hemisphere draws down CO2, the U.K. Met Office predicts that levels of atmospheric CO2 will pass 417 parts per million for several weeks, 50% higher than preindustrial levels. Only dramatic action by the world's countries, far beyond existing efforts, can begin to halt this build up, Cheng says. Should the current rate of warming continue, the world will breach the targets set in the Paris climate agreement—limiting warming to 1.5°C or 2°C—by 2035 and 2065, respectively. But Hausfather says it's quite possible that warming, which has largely held steady for the past few decades at 0.19°C per decade, will actually speed up. The rate of warming over the past 14 years is well above the long-term trend. The debate now, he says, is whether that is an omen of an even darker future. [1]: https://www.sciencemag.org/content/369/6507/1043.full [2]: https://www.sciencemag.org/content/370/6519/901.full [3]: https://www.sciencemag.org/content/369/6504/612.full [4]: pending:yes