Goto

Collaborating Authors

 focus area



Knowledge-Informed Automatic Feature Extraction via Collaborative Large Language Model Agents

Bradland, Henrik, Goodwin, Morten, Zadorozhny, Vladimir I., Andersen, Per-Arne

arXiv.org Artificial Intelligence

The performance of machine learning models on tabular data is critically dependent on high-quality feature engineering. While Large Language Models (LLMs) have shown promise in automating feature extraction (AutoFE), existing methods are often limited by monolithic LLM architectures, simplistic quantitative feedback, and a failure to systematically integrate external domain knowledge. This paper introduces Rogue One, a novel, LLM-based multi-agent framework for knowledge-informed automatic feature extraction. Rogue One operationalizes a decentralized system of three specialized agents-Scientist, Extractor, and Tester-that collaborate iteratively to discover, generate, and validate predictive features. Crucially, the framework moves beyond primitive accuracy scores by introducing a rich, qualitative feedback mechanism and a "flooding-pruning" strategy, allowing it to dynamically balance feature exploration and exploitation. By actively incorporating external knowledge via an integrated retrieval-augmented (RAG) system, Rogue One generates features that are not only statistically powerful but also semantically meaningful and interpretable. We demonstrate that Rogue One significantly outperforms state-of-the-art methods on a comprehensive suite of 19 classification and 9 regression datasets. Furthermore, we show qualitatively that the system surfaces novel, testable hypotheses, such as identifying a new potential biomarker in the myocardial dataset, underscoring its utility as a tool for scientific discovery.




CognArtive: Large Language Models for Automating Art Analysis and Decoding Aesthetic Elements

Khadangi, Afshin, Sartipi, Amir, Tchappi, Igor, Fridgen, Gilbert

arXiv.org Artificial Intelligence

Art, as a universal language, can be interpreted in diverse ways, with artworks embodying profound meanings and nuances. The advent of Large Language Models (LLMs) and the availability of Multimodal Large Language Models (MLLMs) raise the question of how these transformative models can be used to assess and interpret the artistic elements of artworks. While research has been conducted in this domain, to the best of our knowledge, a deep and detailed understanding of the technical and expressive features of artworks using LLMs has not been explored. In this study, we investigate the automation of a formal art analysis framework to analyze a high-throughput number of artworks rapidly and examine how their patterns evolve over time. We explore how LLMs can decode artistic expressions, visual elements, composition, and techniques, revealing emerging patterns that develop across periods. Finally, we discuss the strengths and limitations of LLMs in this context, emphasizing their ability to process vast quantities of art-related data and generate insightful interpretations. Due to the exhaustive and granular nature of the results, we have developed interactive data visualizations, available online https://cognartive.github.io/, to enhance understanding and accessibility.


SCoTT: Wireless-Aware Path Planning with Vision Language Models and Strategic Chains-of-Thought

Djuhera, Aladin, Andrei, Vlad C., Seffo, Amin, Boche, Holger, Saad, Walid

arXiv.org Artificial Intelligence

Path planning is a complex problem for many practical applications, particularly in robotics. Existing algorithms, however, are exhaustive in nature and become increasingly complex when additional side constraints are incorporated alongside distance minimization. In this paper, a novel approach using vision language models (VLMs) is proposed for enabling path planning in complex wireless-aware environments. To this end, insights from a digital twin (DT) with real-world wireless ray tracing data are explored in order to guarantee an average path gain threshold while minimizing the trajectory length. First, traditional approaches such as A* are compared to several wireless-aware extensions, and an optimal iterative dynamic programming approach (DP-WA*) is derived, which fully takes into account all path gains and distance metrics within the DT. On the basis of these baselines, the role of VLMs as an alternative assistant for path planning is investigated, and a strategic chain-of-thought tasking (SCoTT) approach is proposed. SCoTT divides the complex planning task into several subproblems and solves each with advanced CoT prompting. Results show that SCoTT achieves very close average path gains compared to DP-WA* while at the same time yielding consistently shorter path lengths. The results also show that VLMs can be used to accelerate DP-WA* by efficiently reducing the algorithm's search space and thus saving up to 62\% in execution time. This work underscores the potential of VLMs in future digital systems as capable assistants for solving complex tasks, while enhancing user interaction and accelerating rapid prototyping under diverse wireless constraints.


Using RL to Identify Divisive Perspectives Improves LLMs Abilities to Identify Communities on Social Media

Mehta, Nikhil, Goldwasser, Dan

arXiv.org Artificial Intelligence

The large scale usage of social media, combined with its significant impact, has made it increasingly important to understand it. In particular, identifying user communities, can be helpful for many downstream tasks. However, particularly when models are trained on past data and tested on future, doing this is difficult. In this paper, we hypothesize to take advantage of Large Language Models (LLMs), to better identify user communities. Due to the fact that many LLMs, such as ChatGPT, are fixed and must be treated as black-boxes, we propose an approach to better prompt them, by training a smaller LLM to do this. We devise strategies to train this smaller model, showing how it can improve the larger LLMs ability to detect communities. Experimental results show improvements on Reddit and Twitter data, on the tasks of community detection, bot detection, and news media profiling.


Guided AbsoluteGrad: Magnitude of Gradients Matters to Explanation's Localization and Saliency

Huang, Jun, Liu, Yan

arXiv.org Artificial Intelligence

This paper proposes a new gradient-based XAI method called Guided AbsoluteGrad for saliency map explanations. We utilize both positive and negative gradient magnitudes and employ gradient variance to distinguish the important areas for noise deduction. We also introduce a novel evaluation metric named ReCover And Predict (RCAP), which considers the Localization and Visual Noise Level objectives of the explanations. We propose two propositions for these two objectives and prove the necessity of evaluating them. We evaluate Guided AbsoluteGrad with seven gradient-based XAI methods using the RCAP metric and other SOTA metrics in three case studies: (1) ImageNet dataset with ResNet50 model; (2) International Skin Imaging Collaboration (ISIC) dataset with EfficientNet model; (3) the Places365 dataset with DenseNet161 model. Our method surpasses other gradient-based approaches, showcasing the quality of enhanced saliency map explanations through gradient magnitude.


Postdoctoral Researcher: NOLAI Ethical Aspects of AI in Education

#artificialintelligence

Are you a scientist with a keen interest in education, research and intelligent technologies? At the National Education Lab for Artificial Intelligence (NOLAI in Dutch), we develop innovative and intelligent technologies aimed at improving the quality of primary and secondary education. Over the next ten years, NOLAI teams up with schools, universities and companies to create new innovative examples of AI in education. As a postdoctoral researcher on ethical aspects of AI in education, you can contribute to NOLAI's goals in our scientific programme. The new National Education Lab AI (NOLAI), located at Radboud University in the Netherlands, is looking for a postdoctoral researcher to study the ethical and social implications of AI in education.


The top 100 AI startups of 2021: Where are they now? - CB Insights Research

#artificialintelligence

In April 2021, CB Insights announced our fifth annual AI 100 -- a list of the 100 most promising AI startups across the globe. We take a look at where these companies are now. In 2021, CBI analysts parsed through over 8,000 AI startups to determine the 100 most promising private AI companies. The winning cohort worked on a wide array of applications, from drug R&D and hospital revenue cycle management to autonomous beekeeping and municipal waste sortation -- highlighting the breadth and depth of AI's impact across industries. Get an excel file with the entire AI 100 list including each company's total funding, focus area, and more.