Goto

Collaborating Authors

 differentiator


Lamina

Neural Information Processing Systems

How different cell types in a neural system contribute to signal processing by the entire circuit is a prime question in neuroscience.



Beyond the model: Key differentiators in large language models and multi-agent services

Goyal, Muskaan, Bhasin, Pranav

arXiv.org Artificial Intelligence

With the launch of foundation models like DeepSeek, Manus AI, and Llama 4, it has become evident that large language models (LLMs) are no longer the sole defining factor in generative AI. As many now operate at comparable levels of capability, the real race is not about having the biggest model but optimizing the surrounding ecosystem, including data quality and management, computational efficiency, latency, and evaluation frameworks. This review article delves into these critical differentiators that ensure modern AI services are efficient and profitable.


Exact Leader Estimation: A New Approach for Distributed Differentiation

Aldana-Lopez, Rodrigo, Gomez-Gutierrez, David, Usai, Elio, Haimovich, Hernan

arXiv.org Artificial Intelligence

A novel strategy aimed at cooperatively differentiating a signal among multiple interacting agents is introduced, where none of the agents needs to know which agent is the leader, i.e. the one producing the signal to be differentiated. Every agent communicates only a scalar variable to its neighbors; except for the leader, all agents execute the same algorithm. The proposed strategy can effectively obtain derivatives up to arbitrary $m$-th order in a finite time under the assumption that the $(m+1)$-th derivative is bounded. The strategy borrows some of its structure from the celebrated homogeneous robust exact differentiator by A. Levant, inheriting its exact differentiation capability and robustness to measurement noise. Hence, the proposed strategy can be said to perform robust exact distributed differentiation. In addition, and for the first time in the distributed leader-observer literature, sampled-data communication and bounded measurement noise are considered, and corresponding steady-state worst-case accuracy bounds are derived. The effectiveness of the proposed strategy is verified numerically for second- and fourth-order systems, i.e., for estimating derivatives of up to first and third order, respectively.


Review for NeurIPS paper: Lamina-specific neuronal properties promote robust, stable signal propagation in feedforward networks

Neural Information Processing Systems

Weaknesses: Although I believe the intrinsic difference of neurons could benefit for information transmission, I have some conceptual questions. I think properly answer these questions in the Discussion or briefly mention some of them in author feedback could improve the impact of this work in general. Whether a network is an integrator of a differentiator is highly determined by the value of \beta. Is it possible with an intermediate value of \beta, the network's output is proportional to the input, i.e., the network simply relay the input but neither differentiating or integrating. In this case, we probably only need one layer to transmit the input without the cascade of an integrator and a differentiator.


ShadowGenes: Leveraging Recurring Patterns within Computational Graphs for Model Genealogy

Schulz, Kasimir, Evans, Kieran

arXiv.org Artificial Intelligence

Machine learning model genealogy enables practitioners to determine which architectural family a neural network belongs to. In this paper, we introduce ShadowGenes, a novel, signature-based method for identifying a given model's architecture, type, and family. Our method involves building a computational graph of the model that is agnostic of its serialization format, then analyzing its internal operations to identify unique patterns, and finally building and refining signatures based on these. We highlight important workings of the underlying engine and demonstrate the technique used to construct a signature and scan a given model. This approach to model genealogy can be applied to model files without the need for additional external information. We test ShadowGenes on a labeled dataset of over 1,400 models and achieve a mean true positive rate of 97.49% and a precision score of 99.51%; which validates the technique as a practical method for model genealogy. This enables practitioners to understand the use cases of a given model, the internal computational process, and identify possible security risks, such as the potential for model backdooring.


Rollover Prevention for Mobile Robots with Control Barrier Functions: Differentiator-Based Adaptation and Projection-to-State Safety

Das, Ersin, Ames, Aaron D., Burdick, Joel W.

arXiv.org Artificial Intelligence

This paper develops rollover prevention guarantees for mobile robots using control barrier function (CBF) theory, and demonstrates the method experimentally. We consider a safety measure based on a zero moment point condition through the lens of CBFs. However, these conditions depend on time-varying and noisy parameters. To address this issue, we present a differentiator-based safety-critical controller that estimates these parameters and pairs Input-to-State Stable (ISS) differentiator dynamics with CBFs to achieve rigorous safety guarantees. Additionally, to ensure safety in the presence of disturbances, we utilize a time-varying extension of Projection-to-State Safety (PSSf). The effectiveness of the proposed method is demonstrated via experiments on a tracked robot with a rollover potential on steep slopes.


Guarding Force: Safety-Critical Compliant Control for Robot-Environment Interaction

Wang, Xinming, Yang, Jun, Mao, Jianliang, Liang, Jinzhuo, Li, Shihua, Yan, Yunda

arXiv.org Artificial Intelligence

In this study, we propose a safety-critical compliant control strategy designed to strictly enforce interaction force constraints during the physical interaction of robots with unknown environments. The interaction force constraint is interpreted as a new force-constrained control barrier function (FC-CBF) by exploiting the generalized contact model and the prior information of the environment, i.e., the prior stiffness and rest position, for robot kinematics. The difference between the real environment and the generalized contact model is approximated by constructing a tracking differentiator, and its estimation error is quantified based on Lyapunov theory. By interpreting strict interaction safety specification as a dynamic constraint, restricting the desired joint angular rates in kinematics, the proposed approach modifies nominal compliant controllers using quadratic programming, ensuring adherence to interaction force constraints in unknown environments. The strict force constraint and the stability of the closed-loop system are rigorously analyzed. Experimental tests using a UR3e industrial robot with different environments verify the effectiveness of the proposed method in achieving the force constraints in unknown environments.


Distributed Finite-time Differentiator for Multi-agent Systems Under Directed Graph

Chen, Weile, Du, Haibo, Li, Shihua

arXiv.org Artificial Intelligence

This paper proposes a new distributed finite-time differentiator (DFD) for multi-agent systems (MAS) under directed graph, which extends the differentiator algorithm from the centralized case to the distributed case by only using relative/absolute position information. By skillfully constructing a Lyapunov function, the finite-time stability of the closed-loop system under DFD is proved. Inspired by the duality principle of control theory, a distributed continuous finite-time output consensus algorithm extended from DFD for a class of leader-follower MAS is provided, which not only completely suppresses disturbance, but also avoids chattering. Finally, several simulation examples are given to verify the effectiveness of the DFD.


Artificial intelligence: 3 trends to watch in 2023

#artificialintelligence

The artificial intelligence (AI) market has been on a swift growth path for several years – so much so that the industry is expected to reach $42.4 billion in 2023. This momentum will continue, and we're starting to realize it with the debut of powerful new AI-powered tools and services across industries. There has been a shift from the well-understood role of AI in analysis and prediction – helping data scientists and enterprises make sense of the world and chart their courses accordingly – to new and innovative systems, like DALL-E, that are producing entirely new artifacts that have never been seen before. But what's driving this exponential growth, and how will it affect the space in the coming year? AI is becoming a fundamental differentiator for business.