harmonic
The Math on AI Agents Doesn't Add Up
The Math on AI Agents Doesn't Add Up A research paper suggests AI agents are mathematically doomed to fail. The big AI companies promised us that 2025 would be "the year of the AI agents." It turned out to be the year of AI agents, and kicking the can for that transformational moment to 2026 or maybe later. But what if the answer to the question "When will our lives be fully automated by generative AI robots that perform our tasks for us and basically run the world?" is, like that New Yorker cartoon, "How about never?" That was basically the message of a paper published without much fanfare some months ago, smack in the middle of the overhyped year of "agentic AI." Entitled " Hallucination Stations: On Some Basic Limitations of Transformer-Based Language Models," it purports to mathematically show that "LLMs are incapable of carrying out computational and agentic tasks beyond a certain complexity."
- North America > United States > New York (0.25)
- North America > United States > California (0.14)
- Europe > Slovakia (0.05)
- Europe > Czechia (0.05)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Agents (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning > Generative AI (0.38)
HARMONIC: A Content-Centric Cognitive Robotic Architecture
Oruganti, Sanjay, Nirenburg, Sergei, McShane, Marjorie, English, Jesse, Roberts, Michael K., Arndt, Christian, Gonzalez, Carlos, Seo, Mingyo, Sentis, Luis
Our framework, HARMONIC (Human-AI Robotic Team Member Operating with Natural Intelligence and Communication, Figure 1), is an implemented dual-control cognitive robotic architecture featuring distinct layers of strategic reasoning and tactical, skill-level control [20]. This approach advances the hybrid control systems and architectures reviewed by Dennis et al. [21] and contrasts with DIARC's [22], [23] integration strategy, which embeds the strategic layer within the tactical layer to support concurrent operation. The strategic layer of HARMONIC adapts a mature cognitive architecture, OntoAgent [24], [25], [17] for high-level reasoning, leveraging explicit, structured knowledge representations that can be inspected, verified, and incre-mentally expanded.
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.14)
- North America > United States > Texas > Travis County > Austin (0.14)
- North America > United States > New York > Rensselaer County > Troy (0.04)
- (2 more...)
HARMONIC: Harnessing LLMs for Tabular Data Synthesis and Privacy Protection
Data serves as the fundamental basis for advancing deep learning. Therefore, exploring the methods for effectively using models like LLMs to generate synthetic tabular data, which is privacy-preserving but similar to original one, is urgent.In this paper, we introduce a new framework HARMONIC for tabular data generation and evaluation by LLMs. In the data generation part of our framework, we employ fine-tuning to generate tabular data and enhance privacy rather than continued pre-training which is often used by previous small-scale LLM-based methods. In particular, we construct an instruction fine-tuning dataset based on the idea of the k-nearest neighbors algorithm to inspire LLMs to discover inter-row relationships. By such fine-tuning, LLMs are trained to remember the format and connections of the data rather than the data itself, which reduces the risk of privacy leakage.
Generative Learning of Densities on Manifolds
Giovanis, Dimitris G., Crabtree, Ellis, Ghanem, Roger G., kevrekidis, Ioannis G.
A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent) spaces in the high-dimensional data (ambient) space. Two approaches for sampling from the latent data density are described. The first is a score-based diffusion model, which is trained to map a standard normal distribution to the latent data distribution using a neural network. The second one involves solving an It\^o stochastic differential equation in the latent space. Additional realizations of the data are generated by lifting the samples back to the ambient space using Double Diffusion Maps, a recently introduced technique typically employed in studying dynamical system reduction; here the focus lies in sampling densities rather than system dynamics. The proposed approaches enable sampling high dimensional data densities restricted to low-dimensional, a priori unknown manifolds. The efficacy of the proposed framework is demonstrated through a benchmark problem and a material with multiscale structure.
- Health & Medicine (0.68)
- Energy > Oil & Gas > Upstream (0.46)
HARMONIC: A Framework for Explanatory Cognitive Robots
Oruganti, Sanjay, Nirenburg, Sergei, McShane, Marjorie, English, Jesse, Roberts, Michael K., Arndt, Christian
We present HARMONIC, a framework for implementing cognitive robots that transforms general-purpose robots into trusted teammates capable of complex decision-making, natural communication and human-level explanation. The framework supports interoperability between a strategic (cognitive) layer for high-level decision-making and a tactical (robot) layer for low-level control and execution. We describe the core features of the framework and our initial implementation, in which HARMONIC was deployed on a simulated UGV and drone involved in a multi-robot search and retrieval task.
- North America > United States > New York > Rensselaer County > Troy (0.05)
- North America > United States > Maryland > Baltimore County (0.05)
- North America > United States > Maryland > Baltimore (0.05)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.05)
HARMONIC: Cognitive and Control Collaboration in Human-Robotic Teams
Oruganti, Sanjay, Nirenburg, Sergei, McShane, Marjorie, English, Jesse, Roberts, Michael K., Arndt, Christian
This paper presents a novel approach to multi-robot planning and collaboration. We demonstrate a cognitive strategy for robots in human-robot teams that incorporates metacognition, natural language communication, and explainability. The system is embodied using the HARMONIC architecture that flexibly integrates cognitive and control capabilities across the team. We evaluate our approach through simulation experiments involving a joint search task by a team of heterogeneous robots (a UGV and a drone) and a human. We detail the system's handling of complex, real-world scenarios, effective action coordination between robots with different capabilities, and natural human-robot communication. This work demonstrates that the robots' ability to reason about plans, goals, and attitudes, and to provide explanations for actions and decisions are essential prerequisites for realistic human-robot teaming.
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- North America > United States (0.04)
- Europe > United Kingdom > England > Merseyside > Liverpool (0.04)
- Europe > Slovenia > Central Slovenia > Municipality of Komenda > Komenda (0.04)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Agents (1.00)
- Information Technology > Artificial Intelligence > Robots > Humanoid Robots (0.76)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Planning & Scheduling (0.68)
- Information Technology > Artificial Intelligence > Cognitive Science > Cognitive Architectures (0.67)
HARMONIC: Harnessing LLMs for Tabular Data Synthesis and Privacy Protection
Wang, Yuxin, Feng, Duanyu, Dai, Yongfu, Chen, Zhengyu, Huang, Jimin, Ananiadou, Sophia, Xie, Qianqian, Wang, Hao
Data serves as the fundamental foundation for advancing deep learning, particularly tabular data presented in a structured format, which is highly conducive to modeling. However, even in the era of LLM, obtaining tabular data from sensitive domains remains a challenge due to privacy or copyright concerns. Hence, exploring how to effectively use models like LLMs to generate realistic and privacy-preserving synthetic tabular data is urgent. In this paper, we take a step forward to explore LLMs for tabular data synthesis and privacy protection, by introducing a new framework HARMONIC for tabular data generation and evaluation. In the tabular data generation of our framework, unlike previous small-scale LLM-based methods that rely on continued pre-training, we explore the larger-scale LLMs with fine-tuning to generate tabular data and enhance privacy. Based on idea of the k-nearest neighbors algorithm, an instruction fine-tuning dataset is constructed to inspire LLMs to discover inter-row relationships. Then, with fine-tuning, LLMs are trained to remember the format and connections of the data rather than the data itself, which reduces the risk of privacy leakage. In the evaluation part of our framework, we develop specific privacy risk metrics DLT for LLM synthetic data generation, as well as performance evaluation metrics LLE for downstream LLM tasks. Our experiments find that this tabular data generation framework achieves equivalent performance to existing methods with better privacy, which also demonstrates our evaluation framework for the effectiveness of synthetic data and privacy risks in LLM scenarios.
- Asia > China > Sichuan Province > Chengdu (0.04)
- Asia > Singapore (0.04)
- Asia > China > Hubei Province > Wuhan (0.04)
- (2 more...)
- Information Technology > Security & Privacy (1.00)
- Health & Medicine (1.00)
- Banking & Finance (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning > Nearest Neighbor Methods (0.88)
On Invariance, Equivariance, Correlation and Convolution of Spherical Harmonic Representations for Scalar and Vectorial Data
The mathematical representations of data in the Spherical Harmonic (SH) domain has recently regained increasing interest in the machine learning community. This technical report gives an in-depth introduction to the theoretical foundation and practical implementation of SH representations, summarizing works on rotation invariant and equivariant features, as well as convolutions and exact correlations of signals on spheres. In extension, these methods are then generalized from scalar SH representations to Vectorial Harmonics (VH), providing the same capabilities for 3d vector fields on spheres. NOTE 1: This document is a re-publication of a subset of works originally published in my PhD thesis (I changed my last name from Fehr to Keuper): Fehr, Janis.
- Europe > Germany (0.67)
- Europe > Austria > Vienna (0.14)
- North America > United States > New York (0.14)
- (5 more...)
- Research Report (0.50)
- Overview (0.46)
A Dataset and Baseline Approach for Identifying Usage States from Non-Intrusive Power Sensing With MiDAS IoT-based Sensors
Muppasani, Bharath, Anand, Cheyyur Jaya, Appajigowda, Chinmayi, Srivastava, Biplav, Johri, Lokesh
Authors in (Rajapaksha and The growth in the deployment of Internet of Things (IoT) Bergmeir 2022) focused on providing rule based explanations sensors across different industries has opened several opportunities for a particular forecast, considering the global forecasting for the economy. One of them is the collection of IoT model as a black-box model trained across multivariate data that companies can use to build smarter solutions.
- North America > United States > South Carolina > Richland County > Columbia (0.14)
- Asia > India (0.09)
- North America > Trinidad and Tobago > Trinidad > Arima > Arima (0.04)
- North America > United States > California > Santa Clara County > San Jose (0.04)