synergy
The Representational Limit of Scalar Interactions: An Interventional Decomposition
Aghilar, Potito, Roccotelli, Sabino, Fidanza, Stanislao, Anelli, Vito Walter, Stramaglia, Sebastiano, Di Noia, Tommaso
Signed pairwise interaction scores fundamentally conflate uniqueness (U), redundancy (R), and synergy (S). We prove this on a minimal 3-way XOR structural causal model: faithful indices such as Shapley-Taylor return zero per pair, whereas projective indices such as Shapley Interaction spread the third-order effect into pair scalars that conflate the three mechanisms. We introduce Stochastic Hi-Fi, a post-hoc, retraining-free predictability decomposition that estimates per-feature U/R/S profiles by interventional masked inference. The estimator provides exact interventional semantics, finite-sample Monte Carlo bounds, strict variance reduction from coupled diamond sampling, and uniform finite-vocabulary convergence. Across tabular SCMs, Stochastic Hi-Fi recovers structure missed by scalar baselines (up to 411x larger interaction-magnitude recovery ratios). It also separates redundant and synergistic heads in the GPT-2 IOI circuit. On NIH ChestX-ray14, Stochastic Hi-Fi matches GradCAM on Pointing Game and improves substantially on Deletion AUC.
Synergy over Discrepancy: APartition-Based Approach to Multi-Domain LLMFine-Tuning
Large language models (LLMs) demonstrate impressive generalization abilities, yet adapting them effectively across multiple heterogeneous domains remains challenging due to inter-domain interference. To overcome this challenge, we propose a partition-based multi-stage fine-tuning framework designed to exploit inter-domain synergies while minimizing negative transfer.
InfMasking: Unleashing Synergistic Information by Contrastive Multimodal Interactions
In multimodal representation learning, synergistic interactions between modalities not only provide complementary information but also create unique outcomes through specific interaction patterns that no single modality could achieve alone. Existing methods may struggle to effectively capture the full spectrum of synergistic information, leading to suboptimal performance in tasks where such interactions are critical. This is particularly problematic because synergistic information constitutes the fundamental value proposition of multimodal representation. To address this challenge, we introduce InfMasking, a contrastive synergistic information extraction method designed to enhance synergistic information through an Infinite Masking strategy. InfMasking stochastically occludes most features from each modality during fusion, preserving only partial information to create representations with varied synergistic patterns.
Evolving and Regularizing Meta-Environment Learner for Fine-Grained Few-Shot Class-Incremental Learning
Recently proposed Fine-Grained Few-Shot Class-Incremental Learning (FG-FSCIL) offers a practical and efficient solution for enabling models to incrementally learn new fine-grained categories under limited data conditions. However, existing methods still settle for the fine-grained feature extraction capabilities learned from the base classes.
Synergy over Discrepancy: A Partition-Based Approach to Multi-Domain LLM Fine-Tuning
Large language models (LLMs) demonstrate impressive generalization abilities, yet adapting them effectively across multiple heterogeneous domains remains challenging due to inter-domain interference. To overcome this challenge, we propose a partition-based multi-stage fine-tuning framework designed to exploit inter-domain synergies while minimizing negative transfer.
Quantifying Modeling Interactions An Information Decomposition Framework
The recent explosion of interest in multimodal applications has resulted in a wide selection of datasets and methods for representing and integrating information from different modalities. Despite these empirical advances, there remain fundamental research questions: How can we quantify the interactions that are necessary to solve a multimodal task? Subsequently, what are the most suitable multimodal models to capture these interactions? To answer these questions, we propose an information-theoretic approach to quantify the degree of redundancy, uniqueness, and synergy relating input modalities with an output task. We term these three measures as the PID statistics of a multimodal distribution (or PID for short), and introduce two new estimators for these PID statistics that scale to high-dimensional distributions. To validate PID estimation, we conduct extensive experiments on both synthetic datasets where the PID is known and on large-scale multimodal benchmarks where PID estimations are compared with human annotations. Finally, we demonstrate their usefulness in (1) quantifying interactions within multimodal datasets, (2) quantifying interactions captured by multimodal models, (3) principled approaches for model selection, and (4) three real-world case studies engaging with domain experts in pathology, mood prediction, and robotic perception where our framework helps to recommend strong multimodal models for each application.
What Is Missing For Graph Homophily? Disentangling Graph Homophily For Graph Neural Networks
Graph homophily refers to the phenomenon that connected nodes tend to share similar characteristics. Understanding this concept and its related metrics is crucial for designing effective Graph Neural Networks (GNNs). The most widely used homophily metrics, such as edge or node homophily, quantify such similarity as label consistency across the graph topology. These metrics are believed to be able to reflect the performance of GNNs, especially on node-level tasks. However, many recent studies have empirically demonstrated that the performance of GNNs does not always align with homophily metrics, and how homophily influences GNNs still remains unclear and controversial.
Revealed: The classic office words and phrases that Gen Z no longer understand - so, do you know your 'synergy' from your 'paradigm'?
Baffled Florida parents sue fertilization clinic after delivering someone else's baby Huge pancreatic cancer breakthrough as scientists achieve'permanent disappearance' of disease with new triple-threat approach tested in lab Bombshell new leaked audio that could sink Blake Lively: Listen to actress' four-minute voice note to Justin Baldoni The truth about the Sussexes at that Kardashian party is out - and it's a big, hot jelly of a mess: JAN MOIR Trump chooses'central casting' Kevin Warsh for Fed Chair Real estate tycoon accused of indecent proposal to realtor mom while enjoying an affair. Ryan Seacrest's gaunt face concerns fans as he congratulates Wheel Of Fortune co-host Vanna White on wedding Margot Robbie fans go wild over red carpet'slip-up' about her husband and joke she'must be in an open relationship' following red carpet moment Trump says'agitator Alex Pretti's stock has gone way down' after video of him spitting on and kicking an ICE vehicle emerged, saying he was'crazed and out of control' Boy, 5, in ICE custody after being detained in Minneapolis is'depressed, sad, and not doing great' Brooklyn Beckham is mocked by fans for showing off his'special' spaghetti bolognese recipe - but reveals he's run out of spaghetti - despite wife Nicola Peltz's $1m a month allowance from billionaire father Nelson Woke Democrats on verge of driving party's popularity off cliff again with this new slogan, former Obama advisor warns Nurse banned from working in his home state of Florida after saying he wouldn't anesthetize MAGA supporters Inside Kris Jenner's extremely risky surgery to transform the only remaining part of her body that betrays her true age Melania invited me to watch her new documentary inside the White House. Now I know why you wouldn't want to cross her: LINK LAUREN's movie review Full known list of Alex Pretti's battles with cops revealed before Minneapolis nurse was shot dead by DHS Lauren Sanchez has hit a despicable new low. I can't defend her any longer. Revealed: The classic office words and phrases that Gen Z no longer understand - so, do you know your'synergy' from your'paradigm'?
Design of an Adaptive Modular Anthropomorphic Dexterous Hand for Human-like Manipulation
Zhou, Zelong, Chen, Wenrui, Hu, Zeyun, Diao, Qiang, Gao, Qixin, Wang, Yaonan
Biological synergies have emerged as a widely adopted paradigm for dexterous hand design, enabling human-like manipulation with a small number of actuators. Nonetheless, excessive coupling tends to diminish the dexterity of hands. This paper tackles the trade-off between actuation complexity and dexterity by proposing an anthropomorphic finger topology with 4 DoFs driven by 2 actuators, and by developing an adaptive, modular dexterous hand based on this finger topology. We explore the biological basis of hand synergies and human gesture analysis, translating joint-level coordination and structural attributes into a modular finger architecture. Leveraging these biomimetic mappings, we design a five-finger modular hand and establish its kinematic model to analyze adaptive grasping and in-hand manipulation. Finally, we construct a physical prototype and conduct preliminary experiments, which validate the effectiveness of the proposed design and analysis.