Government
California legislative session to be dominated by AI regulations and state's struggling budget
AI technology is quickly creeping into every industry, prompting new questions about whether online content comes from a human or a computer. California lawmakers return to work on Wednesday for the start of an election-year legislative session dominated by decisions on artificial intelligence and the state's struggling budget. The budget is a big issue every year in California, which is the nation's most populous state and has an economy larger than that of all but four countries. But this year, lawmakers and Democratic Gov. Gavin Newsom will have to figure out how to cover an estimated $68 billion deficit -- a shortfall that is larger than the entire operating budgets of many states. And with California companies at the forefront of the artificial intelligence boom, a number of state lawmakers are eyeing new rules to govern the use of the technology before it can dominate daily life -- much like social media has.
Misinformation on Japan quake spreading on social media, government warns
False information concerning a powerful earthquake in central Japan on New Year's Day has been spreading on social media platforms, prompting the government on Wednesday to call for the public to exercise caution. Some posts have attributed the cause of the magnitude-7.6 A woman in her 40s in one of the disaster-hit areas had her address publicly disclosed in a post attributed to her that stated, "My son is trapped and cannot move." She said, "This is false information and my home's location is now known. I want the post to be removed."
On the hardness of learning under symmetries
Kiani, Bobak T., Le, Thien, Lawrence, Hannah, Jegelka, Stefanie, Weber, Melanie
In recent years, the purview of machine learning has expanded to non-traditional domains with geometric input types, from graphs to sets to point clouds. Correspondingly, it is now common practice to tailor neural architectures to the particular symmetries of the input - graph neural networks are invariant to permutations of the input nodes, for example, while networks operating on molecules and point clouds are invariant to permutation, translation, and rotation. Empirically, encoding such structure has led to computational benefits in applications [Wang et al., 2021, Batzner et al., 2022, Bronstein et al., 2021]. From the perspective of generalization, previous research has quantified the benefits of imposing symmetry during learning [Long and Sedghi, 2019, Bietti et al., 2021, Sannai et al., 2021, Mei et al., 2021], often achieving rather tight bounds for simple models [Elesedy, 2021, Tahmasebi and Jegelka, 2023]. At their core, these formal statements are bounds on sample complexity, i.e. how much data is needed to learn a given task. In contrast, the effect of symmetries on the computational complexity of learning algorithms has not been previously studied. Broadly speaking, generalization bounds are necessary but not sufficient to show efficiently learnability, as there can be exponentially large gaps between sample complexity and runtime lower bounds. Indeed, an active line of research in learning theory studies the hardness of learning fully-connected neural networks via "correlational statistical query" (CSQ) algorithms (defined in Sec.
The complementary contributions of academia and industry to AI research
Liang, Lizhen, Zhuang, Han, Zou, James, Acuna, Daniel E.
Artificial intelligence (AI) has seen tremendous development in industry and academia. However, striking recent advances by industry have stunned the world, inviting a fresh perspective on the role of academic research in this field. Here, we characterize the impact and type of AI produced by both environments over the last 25 years and establish several patterns. We find that articles published by teams consisting exclusively of industry researchers tend to get greater attention, with a higher chance of being highly cited and citation-disruptive, and several times more likely to produce state-of-the-art models. In contrast, we find that exclusively academic teams publish the bulk of AI research and tend to produce higher novelty work, with single papers having several times higher likelihood of being unconventional and atypical. The respective impact-novelty advantages of industry and academia are robust to controls for subfield, team size, seniority, and prestige. We find that academic-industry collaborations struggle to replicate the novelty of academic teams and tend to look similar to industry teams. Together, our findings identify the unique and nearly irreplaceable contributions that both academia and industry make toward the healthy progress of AI.
A Latent Dirichlet Allocation (LDA) Semantic Text Analytics Approach to Explore Topical Features in Charity Crowdfunding Campaigns
Muzumdar, Prathamesh, Kurian, George, Basyal, Ganga Prasad
Crowdfunding in the realm of the Social Web has received substantial attention, with prior research examining various aspects of campaigns, including project objectives, durations, and influential project categories for successful fundraising. These factors are crucial for entrepreneurs seeking donor support. However, the terrain of charity crowdfunding within the Social Web remains relatively unexplored, lacking comprehension of the motivations driving donations that often lack concrete reciprocation. Distinct from conventional crowdfunding that offers tangible returns, charity crowdfunding relies on intangible rewards like tax advantages, recognition posts, or advisory roles. Such details are often embedded within campaign narratives, yet, the analysis of textual content in charity crowdfunding is limited. This study introduces an inventive text analytics framework, utilizing Latent Dirichlet Allocation (LDA) to extract latent themes from textual descriptions of charity campaigns. The study has explored four different themes, two each in campaign and incentive descriptions. Campaign description themes are focused on child and elderly health mainly the ones who are diagnosed with terminal diseases. Incentive description themes are based on tax benefits, certificates, and appreciation posts. These themes, combined with numerical parameters, predict campaign success. The study was successful in using Random Forest Classifier to predict success of the campaign using both thematic and numerical parameters. The study distinguishes thematic categories, particularly medical need-based charity and general causes, based on project and incentive descriptions. In conclusion, this research bridges the gap by showcasing topic modelling utility in uncharted charity crowdfunding domains.
Locally Differentially Private Embedding Models in Distributed Fraud Prevention Systems
Perez, Iker, Wong, Jason, Skalski, Piotr, Burrell, Stuart, Mortier, Richard, McAuley, Derek, Sutton, David
Global financial crime activity is driving demand for machine learning solutions in fraud prevention. However, prevention systems are commonly serviced to financial institutions in isolation, and few provisions exist for data sharing due to fears of unintentional leaks and adversarial attacks. Collaborative learning advances in finance are rare, and it is hard to find real-world insights derived from privacy-preserving data processing systems. In this paper, we present a collaborative deep learning framework for fraud prevention, designed from a privacy standpoint, and awarded at the recent PETs Prize Challenges. We leverage latent embedded representations of varied-length transaction sequences, along with local differential privacy, in order to construct a data release mechanism which can securely inform externally hosted fraud and anomaly detection models. We assess our contribution on two distributed data sets donated by large payment networks, and demonstrate robustness to popular inference-time attacks, along with utility-privacy trade-offs analogous to published work in alternative application domains.
Mining Temporal Attack Patterns from Cyberthreat Intelligence Reports
Rahman, Md Rayhanur, Wroblewski, Brandon, Matthews, Quinn, Morgan, Brantley, Menzies, Tim, Williams, Laurie
Defending from cyberattacks requires practitioners to operate on high-level adversary behavior. Cyberthreat intelligence (CTI) reports on past cyberattack incidents describe the chain of malicious actions with respect to time. To avoid repeating cyberattack incidents, practitioners must proactively identify and defend against recurring chain of actions - which we refer to as temporal attack patterns. Automatically mining the patterns among actions provides structured and actionable information on the adversary behavior of past cyberattacks. The goal of this paper is to aid security practitioners in prioritizing and proactive defense against cyberattacks by mining temporal attack patterns from cyberthreat intelligence reports. To this end, we propose ChronoCTI, an automated pipeline for mining temporal attack patterns from cyberthreat intelligence (CTI) reports of past cyberattacks. To construct ChronoCTI, we build the ground truth dataset of temporal attack patterns and apply state-of-the-art large language models, natural language processing, and machine learning techniques. We apply ChronoCTI on a set of 713 CTI reports, where we identify 124 temporal attack patterns - which we categorize into nine pattern categories. We identify that the most prevalent pattern category is to trick victim users into executing malicious code to initiate the attack, followed by bypassing the anti-malware system in the victim network. Based on the observed patterns, we advocate organizations to train users about cybersecurity best practices, introduce immutable operating systems with limited functionalities, and enforce multi-user authentications. Moreover, we advocate practitioners to leverage the automated mining capability of ChronoCTI and design countermeasures against the recurring attack patterns.
Cross-target Stance Detection by Exploiting Target Analytical Perspectives
Ding, Daijun, Chen, Rong, Jing, Liwen, Zhang, Bowen, Huang, Xu, Dong, Li, Zhao, Xiaowen, Song, Ge
Cross-target stance detection (CTSD) is an important task, which infers the attitude of the destination target by utilizing annotated data derived from the source target. One important approach in CTSD is to extract domain-invariant features to bridge the knowledge gap between multiple targets. However, the analysis of informal and short text structure, and implicit expressions, complicate the extraction of domain-invariant knowledge. In this paper, we propose a Multi-Perspective Prompt-Tuning (MPPT) model for CTSD that uses the analysis perspective as a bridge to transfer knowledge. First, we develop a two-stage instruct-based chain-of-thought method (TsCoT) to elicit target analysis perspectives and provide natural language explanations (NLEs) from multiple viewpoints by formulating instructions based on large language model (LLM). Second, we propose a multi-perspective prompt-tuning framework (MultiPLN) to fuse the NLEs into the stance predictor. Extensive experiments results demonstrate the superiority of MPPT against the state-of-the-art baseline methods.
EPA: Neural Collapse Inspired Robust Out-of-Distribution Detector
Zhang, Jiawei, Chen, Yufan, Jin, Cheng, Zhu, Lei, Gu, Yuantao
Out-of-distribution (OOD) detection plays a crucial role in ensuring the security of neural networks. Existing works have leveraged the fact that In-distribution (ID) samples form a subspace in the feature space, achieving state-of-the-art (SOTA) performance. However, the comprehensive characteristics of the ID subspace still leave under-explored. Recently, the discovery of Neural Collapse ($\mathcal{NC}$) sheds light on novel properties of the ID subspace. Leveraging insight from $\mathcal{NC}$, we observe that the Principal Angle between the features and the ID feature subspace forms a superior representation for measuring the likelihood of OOD. Building upon this observation, we propose a novel $\mathcal{NC}$-inspired OOD scoring function, named Entropy-enhanced Principal Angle (EPA), which integrates both the global characteristic of the ID subspace and its inner property. We experimentally compare EPA with various SOTA approaches, validating its superior performance and robustness across different network architectures and OOD datasets.
A Cybersecurity Risk Analysis Framework for Systems with Artificial Intelligence Components
Camacho, Jose Manuel, Couce-Vieira, Aitor, Arroyo, David, Insua, David Rios
The introduction of the European Union Artificial Intelligence Act, the NIST Artificial Intelligence Risk Management Framework, and related norms demands a better understanding and implementation of novel risk analysis approaches to evaluate systems with Artificial Intelligence components. This paper provides a cybersecurity risk analysis framework that can help assessing such systems. We use an illustrative example concerning automated driving systems.