Goto

Collaborating Authors

 salamander


SalaMAnder: Shapley-based Mathematical Expression Attribution and Metric for Chain-of-Thought Reasoning

Xin, Yue, Shen, Chen, Yan, Shaotian, Yuan, Xiaosong, Wang, Yaoming, Zhang, Xiaofeng, Huang, Chenxi, Ye, Jieping

arXiv.org Artificial Intelligence

Chain-of-Thought (CoT) prompting enhances the math reasoning capability of large language models (LLMs) to a large margin. However, the mechanism underlying such improvements remains unexplored. In this paper, we present \textbf{SalaMAnder} (\textbf{S}h\textbf{a}p\textbf{l}ey-b\textbf{a}sed \textbf{M}athematical Expression \textbf{A}ttribution a\textbf{nd} M\textbf{e}t\textbf{r}ic), a theoretically grounded methodology as well as a mathematically rigorous evaluation metric for quantifying component-level contributions in few-shot CoT reasoning. Concretely, we leverage the Shapley value for mathematical expression attribution and develop an efficient stratified sampling algorithm that significantly reduces the computational complexity. Besides, we develop the \textbf{CoSP} (\textbf{C}ardinality \textbf{o}f \textbf{S}hapley \textbf{P}ositives) metric through covariance analysis. Comprehensive validation across popular LLM models and diverse mathematical benchmarks demonstrates that the CoSP metric within our SalaMAnder framework exhibits a robust monotonic correlation with model performance, not only providing theoretical explanations for the empirical success of existing few-shot CoT but also establishing mathematically rigorous principles for prompt construction optimization. Furthermore, we verify the reliability of the explanation, based on which we unify the insights of previous work.


A chameleon's 'ballistic tongue' may inspire blood clot-clearing robots

Popular Science

Environment Animals Wildlife A chameleon's'ballistic tongue' may inspire blood clot-clearing robots Chameleons and salamanders can fire their tongues as fast as 16 feet/second. Breakthroughs, discoveries, and DIY tips sent every weekday. The sticky, slimy tongues of chameleons and salamanders may not sound like a great inspiration for engineering projects or medical innovations. But according to researchers at the University of South Florida, the same biological mechanics used to capture and devour bugs could accomplish similar feats inside your bloodstream--and even in outer space. Chameleons prefer to stick to warmer climates amid branchy trees and bushes, while salamanders mostly keep to moist, shaded environments such as decaying leaf debris and dark caves.


In-context Learning Generalizes, But Not Always Robustly: The Case of Syntax

Mueller, Aaron, Webson, Albert, Petty, Jackson, Linzen, Tal

arXiv.org Artificial Intelligence

In-context learning (ICL) is now a common method for teaching large language models (LLMs) new tasks: given labeled examples in the input context, the LLM learns to perform the task without weight updates. Do models guided via ICL infer the underlying structure of the task defined by the context, or do they rely on superficial heuristics that only generalize to identically distributed examples? We address this question using transformations tasks and an NLI task that assess sensitivity to syntax - a requirement for robust language understanding. We further investigate whether out-of-distribution generalization can be improved via chain-of-thought prompting, where the model is provided with a sequence of intermediate computation steps that illustrate how the task ought to be performed. In experiments with models from the GPT, PaLM, and Llama 2 families, we find large variance across LMs. The variance is explained more by the composition of the pre-training corpus and supervision methods than by model size; in particular, models pre-trained on code generalize better, and benefit more from chain-of-thought prompting.


It seems like everyone wants an axolotl since the salamander was added to Minecraft

NPR Technology

Lately, more and more people have been getting axolotls as pets. Lately, more and more people have been getting axolotls as pets. The axolotl, with its permanent grin and youthful-looking body, has captured hearts thanks to TikTok and the popular video game Minecraft, which added the salamander to its universe in 2021. More and more people have been getting them as pets. "I would attribute about 90% of axolotls' popularity to Minecraft and TikTok, but mostly Minecraft," Jake Pak told NPR over email.


David B. Wake (1936-2021)

Science

David B. Wake, a pioneer in the fields of evolutionary morphology, evolutionary developmental biology (evo-devo), and organismal diversification, died on 29 April. He was 84. Wake was a career-long visionary in organismal biology who led evolutionary biologists to examine not only how organisms are different but also how they become different. As a graduate student, he set the framework for his career by detailing the evolutionary relationships and morphological diversity of salamanders. He then delved into functional morphology (how organismal structures work), evolutionary development (how developmental pathways influence diversification of form), and speciation (how species come to be). One of the most influential and integrative biodiversity scientists of his era, Dave was boundlessly curious about all aspects of evolution and unusually open-minded about new techniques and analyses. Dave was born on 8 June 1936 and raised in South Dakota. He attended Pacific Lutheran College in Tacoma, Washington, where he became fascinated by salamanders after uncovering some while looking for insects for an entomology course. After receiving his BA in biology in 1958, he joined the lab of herpetologist Jay Savage at the University of Southern California (USC). At USC, he met Marvalee Hendricks, a fellow graduate student and scholar of caecilians, another understudied group of amphibians. Dave and Marvalee married in 1962 and became collaborators in life and in science. Dave completed his MS in 1960 and his PhD in 1964, both in biology at USC. He joined the faculty at the University of Chicago for 5 years and then moved to the University of California, Berkeley (UC Berkeley), where he was director of the Museum of Vertebrate Zoology from 1971 to 1998 and professor of integrative biology until his retirement in 2003. Marvalee joined the faculty at UC Berkeley as a tenure-track professor soon after Dave. From the time I first heard of them, they were known as “the Wakes,” and for many of us, they were an early model for successful dual careers in academia. An unapologetic organismal biologist, Dave used salamanders as a model taxon (as opposed to a model organism) to ask questions, answer some, and rework others, creating a cycle of ever-deepening inquiry into their evolution. Rather than focusing on a single model organism or particular evolutionary mechanisms, Dave developed extensive knowledge of many salamander species, enough to use the whole taxon as a model platform to inform his many research foci. In doing so, Dave achieved an unprecedented level of integration across approaches to address evolutionary mechanisms and their consequences for diversification. His exemplary integration inspired a series of papers by James Griesemer in the field of history and philosophy of science. Dave's salamander research transcended boundaries of methodologies, specialties, lines of inquiry, and disciplines. He developed a distinctive form of scientific problem-solving and iterative questioning that synergistically increased our general understanding of evolution. Dave developed expertise in phylogenetics, morphology, development, ecology, neurobiology, behavior, and physiology, and his discoveries were groundbreaking in many fields. Coupling knowledge of adult morphology, ontogeny, embryology, function, and selection, he developed predictions about the retention and/or loss of morphological structures during development and became one of the first to frame these findings as part of the nascent field of evo-devo. By combining detailed spatial knowledge of morphological variation, biogeography, behavior, and genomics, he contributed a classic example of speciation in action with his exploration of the salamander ring species Ensatina . These discoveries, none of which could have been made without integrating approaches, span micro- to macroevolution and are now classics in evolutionary biology. His accomplishments led to many accolades, including election to the American Philosophical Society, the American Academy of Arts and Sciences, and the National Academy of Sciences. In the late 1980s, Dave was an early proponent of action in response to the alarming global decline in amphibians. He chaired the first Declining Amphibian Populations Task Force and raised awareness of the predicament posed to amphibians by anthropogenic changes in climate and landscapes. As with his own research, he promoted diverse approaches in finding the causes of this large-scale biodiversity loss, to the benefit of both the scientific community and amphibians. I joined the Wake lab in 1996 as a postdoc. It was an exciting time, with many field trips and countless discussions of species concepts, salamander tongues, and amphibian declines. Dave had a work ethic that amazed everyone and often left us challenging our expectations of ourselves. His leadership style emphasized showing, not telling. That work ethic resulted in some humorous “Wakeisms”—when lab members took vacations that he perceived as just a bit long, he began lab meetings by naming those who were absent and stating that “they must be gallivanting around the world.” To this day, former Wake lab members refer to vacationing as doing just that. Dave set high standards for research and expected us to meet them. He was honest in his delivery of criticism but somehow made it feel like it was for our own good. He was an unwavering supporter of those who worked with him and incredibly loyal to his students and colleagues. No matter how busy, he eagerly welcomed visiting students and early-career scientists, always showing interest in their stories and offering advice about their research and professional development. Nearly 15 years ago, at a symposium organized around the potential of new genomic approaches in herpetology, Dave regaled the audience with what he saw as the biggest questions still to be answered by integrating this new approach. He genuinely reveled in witnessing the advancement of science, not only through his own work but also through that of his lab members and anyone else who stepped up to the plate. He concluded with a typically positive outlook on science: “I only wish I had another 50 years to live, just to see what you are all going to discover!”


I used facial recognition technology on birds

#artificialintelligence

As a birder, I had heard that if you paid careful attention to the head feathers on the downy woodpeckers that visited your bird feeders, you could begin to recognize individual birds. I even went so far as to try sketching birds at my own feeders and had found this to be true, up to a point. In the meantime, in my day job as a computer scientist, I knew that other researchers had used machine learning techniques to recognize individual faces in digital images with a high degree of accuracy. These projects got me thinking about ways to combine my hobby with my day job. Would it be possible to apply those techniques to identify individual birds?


Hands-On Machine Learning with Scikit-Learn and TensorFlow

#artificialintelligence

They have black skin featuring large yellow spots ontheir back and head. These spots are a warning coloration meant to keep predators atbay. Full-grown salamanders can be over a foot in length.Far eastern fire salamanders live in subtropical shrubland and forests near rivers orother freshwater bodies. They spend most of their life on land, but lay their eggs inthe water. They subsist mostly on a diet of insects, worms, and small crustaceans, butoccasionally eat other salamanders.


Watch this creepy robot salamander walk and swim

#artificialintelligence

For some, an image of a creepy robot that moves, walks and swims in the same way as a salamander will be the stuff of nightmares, but this bizarre looking bot does have a significant purpose. Created by researchers at École polytechnique fédérale de Lausanne, the 3D-printed robot copies the gait of the Pleurodeles waltl salamander. Dubbed Pleurobot, the engineers behind the work say it is "accurately based on the 3D motion of the animal's skeleton". The team created X-ray videos of a salamander moving and were able to copy its actions by tracking 64 points along the animal's body. The robot itself has 27 motors and 11 segments along its spine.



How EPFL Made Pleurobot the Most Salamanderish Robot Ever

IEEE Spectrum Robotics

EPFL's Pleurobot is, obviously, our favorite robot salamander. This is likely because it looks so much like a real salamander, but more importantly, it moves just like a real salamander. Or, to be more specific, EPFL has spent years trying to make sure that the way Pleurobot moves is as close to the way that a real salamander moves as possible. In a new paper just published in the Royal Society journal Interface, EPFL researchers describe how they've combined "high-speed cineradiography, optimization, dynamic scaling, three-dimensional printing, high-end servomotors, and a tailored dry-suit" to refine their robot to accurately capture the degrees of freedom, range of motion, and gait behaviors of the real animal. Primarily, it's because they're cute, but there are a variety of much less important considerations that make salamanders interesting to study as well.