Goto

Collaborating Authors

 Government


Improving the State of the Art for Training Human-AI Teams: Technical Report #2 -- Results of Researcher Knowledge Elicitation Survey

arXiv.org Artificial Intelligence

A consensus report produced for the Air Force Research Laboratory (AFRL) by the National Academies of Sciences, Engineering, and Mathematics documented a prevalent and increasing desire to support human-Artificial Intelligence (AI) teaming across military service branches. Sonalysts has begun an internal initiative to explore the training of Human-AI teams. The first step in this effort is to develop a Synthetic Task Environment (STE) that is capable of facilitating research on Human-AI teams. Our goal is to create a STE that offers a task environment that could support the breadth of research that stakeholders plan to perform within this domain. As a result, we wanted to sample the priorities of the relevant research community broadly, and the effort documented in this report is our initial attempt to do so. We created a survey that featured two types of questions. The first asked respondents to report their agreement with STE features that we anticipated might be important. The second represented open-ended questions that asked respondents to specify their priorities within several dimensions of the anticipated STE. The research team invited nineteen researchers from academic and Government labs to participate, and 11 were able to complete the survey. The team analyzed their responses to identify themes that emerged and topics that would benefit from further analysis. The most significant finding of the survey was that a number of researchers felt that various open-source STEs that would meet our needs already exist. Researchers also emphasized the need for automated transcription and coding tools to ease the burden of assessing inter-team communications; the importance of robust data capture and export capabilities; and the desirability of extensive flexibility across many aspects of the tool.


Everything Perturbed All at Once: Enabling Differentiable Graph Attacks

arXiv.org Artificial Intelligence

As powerful tools for representation learning on graphs, graph neural networks (GNNs) have played an important role in applications including social networks, recommendation systems, and online web services. However, GNNs have been shown to be vulnerable to adversarial attacks, which can significantly degrade their effectiveness. Recent state-of-the-art approaches in adversarial attacks rely on gradient-based meta-learning to selectively perturb a single edge with the highest attack score until they reach the budget constraint. While effective in identifying vulnerable links, these methods are plagued by high computational costs. By leveraging continuous relaxation and parameterization of the graph structure, we propose a novel attack method called Differentiable Graph Attack (DGA) to efficiently generate effective attacks and meanwhile eliminate the need for costly retraining. Compared to the state-of-the-art, DGA achieves nearly equivalent attack performance with 6 times less training time and 11 times smaller GPU memory footprint on different benchmark datasets. Additionally, we provide extensive experimental analyses of the transferability of the DGA among different graph models, as well as its robustness against widely-used defense mechanisms.


Small Area Estimation with Random Forests and the LASSO

arXiv.org Machine Learning

We consider random forests and LASSO methods for model-based small area estimation when the number of areas with sampled data is a small fraction of the total areas for which estimates are required. Abundant auxiliary information is available for the sampled areas, from the survey, and for all areas, from an exterior source, and the goal is to use auxiliary variables to predict the outcome of interest. We compare areallevel random forests and LASSO approaches to a frequentist forward variable selection approach and a Bayesian shrinkage method. This work is motivated by Ghanaian data available from the sixth Living Standard Survey (GLSS) and the 2010 Population and Housing Census. We estimate the areal mean household log consumption using both datasets. The outcome variable is measured only in the GLSS for 3% of all the areas (136 out of 5019) and more than 170 potential covariates are available from both datasets. Among the four modelling methods considered, the Bayesian shrinkage performed the best in terms of bias, MSE and prediction interval coverages and scores, as assessed through a cross-validation study. We find substantial between-area variation, the log consumption areal point estimates showing a 1.3-fold variation across the GAMA region. The western areas are the poorest while the Accra Metropolitan Area district gathers the richest areas. In 2015, the United Nations (UN) released their 2030 agenda for sustainable development goals (SDGs) consisting of 17 goals, the first of which was to end poverty worldwide (Resolution, General Assembly and others, 2015). For their first SDG, the UN made seven guidelines explicit, including the implementation of "poverty eradication policies" at a disaggregated level. To that end, producing reliable and fine-grained pictures of socioeconomic status and income inequality is fundamental to help decision makers prioritise and target certain areas. These detailed maps help local communities understand their situation compared to their neighbours, which also helps when planning interventions (Bedi et al., 2007). In Ghana, household surveys are collected every few years to measure the living conditions of households across Ghanaian regions and districts and to monitor poverty.


NBIAS: A Natural Language Processing Framework for Bias Identification in Text

arXiv.org Artificial Intelligence

Bias in textual data can lead to skewed interpretations and outcomes when the data is used. These biases could perpetuate stereotypes, discrimination, or other forms of unfair treatment. An algorithm trained on biased data may end up making decisions that disproportionately impact a certain group of people. Therefore, it is crucial to detect and remove these biases to ensure the fair and ethical use of data. To this end, we develop a comprehensive and robust framework NBIAS that consists of four main layers: data, corpus construction, model development and an evaluation layer. The dataset is constructed by collecting diverse data from various domains, including social media, healthcare, and job hiring portals. As such, we applied a transformer-based token classification model that is able to identify bias words/ phrases through a unique named entity BIAS. In the evaluation procedure, we incorporate a blend of quantitative and qualitative measures to gauge the effectiveness of our models. We achieve accuracy improvements ranging from 1% to 8% compared to baselines. We are also able to generate a robust understanding of the model functioning. The proposed approach is applicable to a variety of biases and contributes to the fair and ethical use of textual data.


Political Sentiment Analysis of Persian Tweets Using CNN-LSTM Model

arXiv.org Artificial Intelligence

Sentiment analysis is the process of identifying and categorizing people's emotions or opinions regarding various topics. The analysis of Twitter sentiment has become an increasingly popular topic in recent years. In this paper, we present several machine learning and a deep learning model to analysis sentiment of Persian political tweets. Our analysis was conducted using Bag of Words and ParsBERT for word representation. We applied Gaussian Naive Bayes, Gradient Boosting, Logistic Regression, Decision Trees, Random Forests, as well as a combination of CNN and LSTM to classify the polarities of tweets. The results of this study indicate that deep learning with ParsBERT embedding performs better than machine learning. The CNN-LSTM model had the highest classification accuracy with 89 percent on the first dataset and 71 percent on the second dataset. Due to the complexity of Persian, it was a difficult task to achieve this level of efficiency. The main objective of our research was to reduce the training time while maintaining the model's performance. As a result, several adjustments were made to the model architecture and parameters. In addition to achieving the objective, the performance was slightly improved as well.


Musk and Zuckerberg set to attend forum on future of AI

The Japan Times

U.S. Sen. Chuck Schumer plans to bring together several technology industry chiefs to discuss the ramifications of artificial intelligence, including Elon Musk and Mark Zuckerberg, who have been discussing whether to bring their rivalry to a cage match. Others invited to the closed-door meeting in September are Sundar Pichai, the chief executive officer of Alphabet's Google, Microsoft CEO Satya Nadella, Nvidia co-founder Jensen Huang and former Google CEO Eric Schmidt, according to Schumer's office. The gathering, which was reported earlier Monday by Axios, is intended as the first of Schumer's AI Insight Forums, and part of his strategy to give Congress more influence over the future of AI as it takes on a growing role in the professional and personal lives of Americans.


ChatGPT is easily exploited for political messaging despite OpenAI's policies

Engadget

In March, OpenAI sought to head off concerns that its immensely popular, albeit hallucination-prone, ChatGPT generative AI could be used to dangerously amplify political disinformation campaigns through an update to the company's Usage Policy to expressly prohibit such behavior. However, an investigation by The Washington Post shows that the chatbot is still easily incited to breaking those rules, with potentially grave repercussions for the 2024 election cycle. OpenAI's user policies specifically ban its use for political campaigning, save for use by "grassroots advocacy campaigns" organizations. This includes generating campaign materials in high volumes, targeting those materials at specific demographics, building campaign chatbots to disseminate information, engage in political advocacy or lobbying. Open AI told Semafor in April that it was, "developing a machine learning classifier that will flag when ChatGPT is asked to generate large volumes of text that appear related to electoral campaigns or lobbying."


Synchron's BCI implants may help paralyzed patients reconnect with the world

Engadget

"We're not building a BCI to control Spotify or to watch Netflix," the CEO of medical device startup Synchron tersely told Engadget via videocall last week. "There's all this hype and excitement about BCI, about where it might go," Oxley continued. "But the reality is, what's it gonna do for patients? We describe this problem for patients, not around wanting to super-augment their brain or body, but wanting to restore the fundamental agency and autonomy that [able-bodied people] take for granted." Around 31,000 Americans currently live with Amyotrophic lateral sclerosis (ALS) with another 5,000 diagnosed every year. Nearly 300,000 Americans suffer from spinal cord paralysis, and another approximately 18,000 people join those ranks annually.


UK airspace chaos explained: How a 'huge network failure' has sparked delays for thousands travellers - so could a CYBERATTACK be to blame?

Daily Mail - Science & tech

Britain's air traffic control systems have been hit by a'huge network failure' today -- prompting confusion, chaos and huge delays for thousands of holidaymakers. NATS, the national air traffic controllers, stressed that UK airspace is not closed but it has brought in traffic restrictions to'maintain safety'. Engineers are working hard to fix the fault but hundreds of flights in and out of the country have been delayed – some for'at least 12 hours' – and there are fears the knock-on effect could last days. No cause of the technical issue has been revealed but social media is rife with claims that a cyber attack might be to blame. It comes just months after all flights across America were grounded for the first time since 9/11, when an unexplained computer system failure prompted fears that hackers had targeted the network.


ChatGPT says no political targeting. It's easy to break the rules.

Washington Post - Technology News

Congress has yet to pass any laws regulating the use of generative AI in elections. The Federal Election Commission is reviewing a petition filed by the left-leaning advocacy group Public Citizen, which would ban politicians from deliberately misrepresenting their opponents in ads generated by AI. Commissioners from both parties have expressed concern that the agency may not have the authority to weigh in without direction from Congress, and any effort to create new AI rules could confront political hurdles.