Goto

Collaborating Authors

 Government


Revisiting Large Language Models as Zero-shot Relation Extractors

arXiv.org Artificial Intelligence

Relation extraction (RE) consistently involves a certain degree of labeled or unlabeled data even if under zero-shot setting. Recent studies have shown that large language models (LLMs) transfer well to new tasks out-of-the-box simply given a natural language prompt, which provides the possibility of extracting relations from text without any data and parameter tuning. This work focuses on the study of exploring LLMs, such as ChatGPT, as zero-shot relation extractors. On the one hand, we analyze the drawbacks of existing RE prompts and attempt to incorporate recent prompt techniques such as chain-of-thought (CoT) to improve zero-shot RE. We propose the summarize-and-ask (\textsc{SumAsk}) prompting, a simple prompt recursively using LLMs to transform RE inputs to the effective question answering (QA) format. On the other hand, we conduct comprehensive experiments on various benchmarks and settings to investigate the capabilities of LLMs on zero-shot RE. Specifically, we have the following findings: (i) \textsc{SumAsk} consistently and significantly improves LLMs performance on different model sizes, benchmarks and settings; (ii) Zero-shot prompting with ChatGPT achieves competitive or superior results compared with zero-shot and fully supervised methods; (iii) LLMs deliver promising performance in extracting overlapping relations; (iv) The performance varies greatly regarding different relations. Different from small language models, LLMs are effective in handling challenge none-of-the-above (NoTA) relation.


Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph

arXiv.org Artificial Intelligence

Although large language models (LLMs) have achieved significant success in various tasks, they often struggle with hallucination problems, especially in scenarios requiring deep and responsible reasoning. These issues could be partially addressed by introducing external knowledge graphs (KG) in LLM reasoning. In this paper, we propose a new LLM-KG integrating paradigm ``$\hbox{LLM}\otimes\hbox{KG}$'' which treats the LLM as an agent to interactively explore related entities and relations on KGs and perform reasoning based on the retrieved knowledge. We further implement this paradigm by introducing a new approach called Think-on-Graph (ToG), in which the LLM agent iteratively executes beam search on KG, discovers the most promising reasoning paths, and returns the most likely reasoning results. We use a number of well-designed experiments to examine and illustrate the following advantages of ToG: 1) compared with LLMs, ToG has better deep reasoning power; 2) ToG has the ability of knowledge traceability and knowledge correctability by leveraging LLMs reasoning and expert feedback; 3) ToG provides a flexible plug-and-play framework for different LLMs, KGs and prompting strategies without any additional training cost; 4) the performance of ToG with small LLM models could exceed large LLM such as GPT-4 in certain scenarios and this reduces the cost of LLM deployment and application. As a training-free method with lower computational cost and better generality, ToG achieves overall SOTA in 6 out of 9 datasets where most previous SOTAs rely on additional training.


Predictive Modeling of Coronal Hole Areas Using Long Short-Term Memory Networks

arXiv.org Artificial Intelligence

In the era of space exploration, the implications of space weather have become increasingly evident. Central to this is the phenomenon of coronal holes, which can significantly influence the functioning of satellites and aircraft. These coronal holes, present on the sun, are distinguished by their open magnetic field lines and comparatively cooler temperatures, leading to the emission of solar winds at heightened rates. To anticipate the effects of these coronal holes on Earth, our study harnesses computer vision to pinpoint the coronal hole regions and estimate their dimensions using imagery from the Solar Dynamics Observatory (SDO). Further, we deploy deep learning methodologies, specifically the Long Short-Term Memory (LSTM) approach, to analyze the trends in the data related to the area of the coronal holes and predict their dimensions across various solar regions over a span of seven days. By evaluating the time series data concerning the area of the coronal holes, our research seeks to uncover patterns in the behavior of coronal holes and comprehend their potential influence on space weather occurrences. This investigation marks a pivotal stride towards bolstering our capacity to anticipate and brace for space weather events that could have ramifications for Earth and its technological apparatuses.


Visual Dexterity: In-Hand Reorientation of Novel and Complex Object Shapes

arXiv.org Artificial Intelligence

In-hand object reorientation is necessary for performing many dexterous manipulation tasks, such as tool use in less structured environments that remain beyond the reach of current robots. Prior works built reorientation systems assuming one or many of the following: reorienting only specific objects with simple shapes, limited range of reorientation, slow or quasistatic manipulation, simulation-only results, the need for specialized and costly sensor suites, and other constraints which make the system infeasible for real-world deployment. We present a general object reorientation controller that does not make these assumptions. It uses readings from a single commodity depth camera to dynamically reorient complex and new object shapes by any rotation in real-time, with the median reorientation time being close to seven seconds. The controller is trained using reinforcement learning in simulation and evaluated in the real world on new object shapes not used for training, including the most challenging scenario of reorienting objects held in the air by a downward-facing hand that must counteract gravity during reorientation. Our hardware platform only uses open-source components that cost less than five thousand dollars. Although we demonstrate the ability to overcome assumptions in prior work, there is ample scope for improving absolute performance. For instance, the challenging duck-shaped object not used for training was dropped in 56 percent of the trials. When it was not dropped, our controller reoriented the object within 0.4 radians (23 degrees) 75 percent of the time. Videos are available at: https://taochenshh.github.io/projects/visual-dexterity.


Early Detection of Bark Beetle Attack Using Remote Sensing and Machine Learning: A Review

arXiv.org Artificial Intelligence

This paper provides a comprehensive review of past and current advances in the early detection of bark beetle-induced tree mortality from three primary perspectives: bark beetle & host interactions, RS, and ML/DL. In contrast to prior efforts, this review encompasses all RS systems and emphasizes ML/DL methods to investigate their strengths and weaknesses. We parse existing literature based on multi- or hyper-spectral analyses and distill their knowledge based on: bark beetle species & attack phases with a primary emphasis on early stages of attacks, host trees, study regions, RS platforms & sensors, spectral/spatial/temporal resolutions, spectral signatures, spectral vegetation indices (SVIs), ML approaches, learning schemes, task categories, models, algorithms, classes/clusters, features, and DL networks & architectures. Although DL-based methods and the random forest (RF) algorithm showed promising results, highlighting their potential to detect subtle changes across visible, thermal, and short-wave infrared (SWIR) spectral regions, they still have limited effectiveness and high uncertainties. To inspire novel solutions to these shortcomings, we delve into the principal challenges & opportunities from different perspectives, enabling a deeper understanding of the current state of research and guiding future research directions.


Mind the box: $l_1$-APGD for sparse adversarial attacks on image classifiers

arXiv.org Artificial Intelligence

We show that when taking into account also the image domain $[0,1]^d$, established $l_1$-projected gradient descent (PGD) attacks are suboptimal as they do not consider that the effective threat model is the intersection of the $l_1$-ball and $[0,1]^d$. We study the expected sparsity of the steepest descent step for this effective threat model and show that the exact projection onto this set is computationally feasible and yields better performance. Moreover, we propose an adaptive form of PGD which is highly effective even with a small budget of iterations. Our resulting $l_1$-APGD is a strong white-box attack showing that prior works overestimated their $l_1$-robustness. Using $l_1$-APGD for adversarial training we get a robust classifier with SOTA $l_1$-robustness. Finally, we combine $l_1$-APGD and an adaptation of the Square Attack to $l_1$ into $l_1$-AutoAttack, an ensemble of attacks which reliably assesses adversarial robustness for the threat model of $l_1$-ball intersected with $[0,1]^d$.


'Huge egos are in play': behind the firing and rehiring of OpenAI's Sam Altman

The Guardian

OpenAI's messy firing and re-hiring of its powerful chief executive this week shocked the tech world. But the power struggle has implications beyond the company's boardroom, AI experts said. It throws into relief the greenness of the AI industry and the strong desire in Silicon Valley to be first, and raises urgent questions about the safety of the technology. "The AI that we're looking at now is immature. There are no standards, no professional body, no certifications. Everybody figures out how to do it, figures out their own internal norms," said Rayid Ghani, a professor of machine learning and public policy at Carnegie Mellon University.


Russian journalist Boris Maksudov dies in Ukraine drone attack

Al Jazeera

Russian journalist Boris Maksudov has died after sustaining injuries in a drone attack in southeastern Ukraine's Zaporizhia region. Maksudov, who worked for Russian state television Rossiya 24, was wounded on Wednesday and taken to hospital. Initially, defence officials said he was in stable condition. However, he later died of shrapnel wounds. "Boris Maksudov died a hero's death, like a brave fighter," Dmitry Kiselyov, the CEO of the Russian media group Rossia Segodnia, said, according to state-run news agency RIA Novosti.


Political Gabfest: Issue Polling is Broken

Slate

This week, Emily Bazelon, John Dickerson, and David Plotz discuss the problems with issue polling and issues with political journalism; the chaos and conflict of Sam Altman and OpenAI; and the failure of the Oslo Accords and perpetual struggle between Israel and Palestine. Send us your Conundrums: submit them at slate.com/conundrum. And join us in-person or online with our special guest โ€“ The Late Show's Steven Colbert โ€“ for Gabfest Live: The Conundrums Edition! December 7 at The 92nd Street Y, New York City. Here are some notes and references from this week's show: Nate Cohn for The New York Times: The Crisis in Issue Polling, and What We're Doing About It and We Did an Experiment to See How Much Democracy and Abortion Matter to Voters Eli Saslow for The New York Times: A Jan. 6 Defendant Pleads His Case to the Son Who Turned Him In John Dickerson and Jo Ling Kent for CBS News Prime Time: What Sam Altman's ouster from OpenAI could mean for the tech world Emily Bazelon for The New York Times Magazine: Was Peace Ever Possible? Ezra Klein for The New York Times's The Ezra Klein Show podcast: The Best Primer I've Heard on Israeli-Palestinian Peace Efforts John Dickerson for CBS Mornings: Former President Jimmy Carter: "America will learn from its mistakes" Here are this week's chatters: John: Julia Simon for NPR: 'It feels like I'm not crazy.'


US warship cruising Red Sea shoots down attack drones fired from Yemen

Al Jazeera

A US warship cruising the Red Sea has shot down drones fired from Houthi-held territory in Yemen, according to the US Central Command. The USS Thomas Hudner, a guided-missile destroyer, shot down "multiple one-way attack drones" launched on Thursday morning from Yemen's Houthi-controlled areas, CENTCOM said in a post on X, formerly Twitter. CENTCOM said there was no damage to the US vessel or injuries to its crew. On the morning (Yemen time) of November 23, the USS Thomas Hudner (DDG 116) shot down multiple one-way attack drones launched from Houthi controlled areas in Yemen. The drones were shot down while the U.S. warship was on patrol in the Red Sea.