royal society
Extracting ORR Catalyst Information for Fuel Cell from Scientific Literature
Htet, Hein, Ibrahim, Amgad Ahmed Ali, Sasaki, Yutaka, Asahi, Ryoji
The oxygen reduction reaction (ORR) catalyst plays a critical role in enhancing fuel cell efficiency, making it a key focus in material science research. However, extracting structured information about ORR catalysts from vast scientific literature remains a significant challenge due to the complexity and diversity of textual data. In this study, we propose a named entity recognition (NER) and relation extraction (RE) approach using DyGIE++ with multiple pre-trained BERT variants, including MatSciBERT and PubMedBERT, to extract ORR catalyst-related information from the scientific literature, which is compiled into a fuel cell corpus for materials informatics (FC-CoMIcs). A comprehensive dataset was constructed manually by identifying 12 critical entities and two relationship types between pairs of the entities. Our methodology involves data annotation, integration, and fine-tuning of transformer-based models to enhance information extraction accuracy. We assess the impact of different BERT variants on extraction performance and investigate the effects of annotation consistency. Experimental evaluations demonstrate that the fine-tuned PubMedBERT model achieves the highest NER F1-score of 82.19% and the MatSciBERT model attains the best RE F1-score of 66.10%. Furthermore, the comparison with human annotators highlights the reliability of fine-tuned models for ORR catalyst extraction, demonstrating their potential for scalable and automated literature analysis. The results indicate that domain-specific BERT models outperform general scientific models like BlueBERT for ORR catalyst extraction.
- Asia > Japan (0.04)
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- North America > United States (0.04)
- Europe > Netherlands > South Holland > Dordrecht (0.04)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Information Retrieval (0.91)
- Information Technology > Artificial Intelligence > Natural Language > Text Processing (0.87)
On the Adaptive Psychological Persuasion of Large Language Models
Ju, Tianjie, Chen, Yujia, Fei, Hao, Lee, Mong-Li, Hsu, Wynne, Cheng, Pengzhou, Wu, Zongru, Zhang, Zhuosheng, Liu, Gongshen
Previous work has showcased the intriguing capabilities of Large Language Models (LLMs) in instruction-following and rhetorical fluency. However, systematic exploration of their dual capabilities to autonomously persuade and resist persuasion, particularly in contexts involving psychological rhetoric, remains unexplored. In this paper, we first evaluate four commonly adopted LLMs by tasking them to alternately act as persuaders and listeners in adversarial dialogues. Empirical results show that persuader LLMs predominantly employ repetitive strategies, leading to low success rates. Then we introduce eleven comprehensive psychological persuasion strategies, finding that explicitly instructing LLMs to adopt specific strategies such as Fluency Effect and Repetition Effect significantly improves persuasion success rates. However, no ``one-size-fits-all'' strategy proves universally effective, with performance heavily dependent on contextual counterfactuals. Motivated by these observations, we propose an adaptive framework based on direct preference optimization that trains LLMs to autonomously select optimal strategies by leveraging persuasion results from strategy-specific responses as preference pairs. Experiments on three open-source LLMs confirm that the proposed adaptive psychological persuasion method effectively enables persuader LLMs to select optimal strategies, significantly enhancing their success rates while maintaining general capabilities. Our code is available at https://github.com/KalinaEine/PsychologicalPersuasion.
- Asia > Thailand > Bangkok > Bangkok (0.05)
- North America > United States > Florida > Miami-Dade County > Miami (0.04)
- Europe > Germany > Bavaria > Upper Bavaria > Munich (0.04)
- (8 more...)
ASKCOS: an open source software suite for synthesis planning
Tu, Zhengkai, Choure, Sourabh J., Fong, Mun Hong, Roh, Jihye, Levin, Itai, Yu, Kevin, Joung, Joonyoung F., Morgan, Nathan, Li, Shih-Cheng, Sun, Xiaoqi, Lin, Huiqian, Murnin, Mark, Liles, Jordan P., Struble, Thomas J., Fortunato, Michael E., Liu, Mengjie, Green, William H., Jensen, Klavs F., Coley, Connor W.
The advancement of machine learning and the availability of large-scale reaction datasets have accelerated the development of data-driven models for computer-aided synthesis planning (CASP) in the past decade. Here, we detail the newest version of ASKCOS, an open source software suite for synthesis planning that makes available several research advances in a freely available, practical tool. Four one-step retrosynthesis models form the basis of both interactive planning and automatic planning modes. Retrosynthetic planning is complemented by other modules for feasibility assessment and pathway evaluation, including reaction condition recommendation, reaction outcome prediction, and auxiliary capabilities such as solubility prediction and quantum mechanical descriptor prediction. ASKCOS has assisted hundreds of medicinal, synthetic, and process chemists in their day-to-day tasks, complementing expert decision making. It is our belief that CASP tools like ASKCOS are an important part of modern chemistry research, and that they offer ever-increasing utility and accessibility.
- North America > Canada > British Columbia (0.28)
- North America > United States > Massachusetts > Middlesex County > Cambridge (0.16)
- Research Report (1.00)
- Workflow (0.68)
- Materials > Chemicals > Commodity Chemicals > Petrochemicals (1.00)
- Information Technology (1.00)
- Health & Medicine > Pharmaceuticals & Biotechnology (1.00)
- (2 more...)
- Information Technology > Software > Programming Languages (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Search (1.00)
- Information Technology > Artificial Intelligence > Natural Language (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.46)
Cultural evolution in populations of Large Language Models
Perez, Jérémy, Léger, Corentin, Ovando-Tellez, Marcela, Foulon, Chris, Dussauld, Joan, Oudeyer, Pierre-Yves, Moulin-Frier, Clément
Research in cultural evolution aims at providing causal explanations for the change of culture over time. Over the past decades, this field has generated an important body of knowledge, using experimental, historical, and computational methods. While computational models have been very successful at generating testable hypotheses about the effects of several factors, such as population structure or transmission biases, some phenomena have so far been more complex to capture using agent-based and formal models. This is in particular the case for the effect of the transformations of social information induced by evolved cognitive mechanisms. We here propose that leveraging the capacity of Large Language Models (LLMs) to mimic human behavior may be fruitful to address this gap. On top of being an useful approximation of human cultural dynamics, multi-agents models featuring generative agents are also important to study for their own sake. Indeed, as artificial agents are bound to participate more and more to the evolution of culture, it is crucial to better understand the dynamics of machine-generated cultural evolution. We here present a framework for simulating cultural evolution in populations of LLMs, allowing the manipulation of variables known to be important in cultural evolution, such as network structure, personality, and the way social information is aggregated and transformed. The software we developed for conducting these simulations is open-source and features an intuitive user-interface, which we hope will help to build bridges between the fields of cultural evolution and generative artificial intelligence.
- North America > United States > New Mexico > Los Alamos County > Los Alamos (0.04)
- North America > United States > Illinois > Cook County > Chicago (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- (5 more...)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Agents (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning > Generative AI (0.34)
Semi-supervised machine learning model for analysis of nanowire morphologies from transmission electron microscopy images
Lu, Shizhao, Montz, Brian, Emrick, Todd, Jayaraman, Arthi
In the field of materials science, microscopy is the first and often only accessible method for structural characterization. There is a growing interest in the development of machine learning methods that can automate the analysis and interpretation of microscopy images. Typically training of machine learning models requires large numbers of images with associated structural labels, however, manual labeling of images requires domain knowledge and is prone to human error and subjectivity. To overcome these limitations, we present a semi-supervised transfer learning approach that uses a small number of labeled microscopy images for training and performs as effectively as methods trained on significantly larger image datasets. Specifically, we train an image encoder with unlabeled images using self-supervised learning methods and use that encoder for transfer learning of different downstream image tasks (classification and segmentation) with a minimal number of labeled images for training. We test the transfer learning ability of two self-supervised learning methods: SimCLR and Barlow-Twins on transmission electron microscopy (TEM) images. We demonstrate in detail how this machine learning workflow applied to TEM images of protein nanowires enables automated classification of nanowire morphologies (e.g., single nanowires, nanowire bundles, phase separated) as well as segmentation tasks that can serve as groundwork for quantification of nanowire domain sizes and shape analysis. We also extend the application of the machine learning workflow to classification of nanoparticle morphologies and identification of different type of viruses from TEM images.
- North America > United States > Massachusetts (0.04)
- Europe > Finland > North Karelia > Joensuu (0.04)
- Materials > Chemicals > Commodity Chemicals > Petrochemicals (1.00)
- Health & Medicine > Therapeutic Area > Infections and Infectious Diseases (0.68)
- Health & Medicine > Diagnostic Medicine (0.68)
- Education (0.68)
- Information Technology > Artificial Intelligence > Machine Learning > Inductive Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.94)
- Information Technology > Artificial Intelligence > Machine Learning > Performance Analysis > Accuracy (0.93)
When Bayes, Ockham, and Shannon come together to define machine learning - DataScienceCentral.com
This article was written by Tirthajyoti Sarkar. Thanks to my CS7641 class at Georgia Tech in my MS Analytics program, where I discovered this concept and was inspired to write about it. It is somewhat surprising that among all the high-flying buzzwords of machine learning, we don't hear much about the one phrase which fuses some of the core concepts of statistical learning, information theory, and natural philosophy into a single three-word-combo. Moreover, it is not just an obscure and pedantic phrase meant for machine learning (ML) Ph.Ds and theoreticians. It has a precise and easily accessible meaning for anyone interested to explore, and a practical pay-off for the practitioners of ML and data science.
Artificial intelligence and what it owes a man who never sits down
I first came across the legend of Hinton in a fabulous book by Cade Metz called Genius Makers, where he detailed the lives of those who shaped AI, foremost among them being Hinton. After studying psychology at Cambridge and AI at the University of Edinburgh, Hinton went back to something which had fascinated him even as a child: How the human brain stored memories, and how it worked. He was one of the first researchers who started working on'mimicking' the human brain with computer hardware and software, thus constructing a newer and purer form of AI, which we now call'deep learning'. He started doing this in the 1980s, along with an intrepid bunch of students. His PhD thesis, titled Deep Neural Networks for Acoustic Modelling in Speech Recognition, demonstrated how deep neural networks outclassed older machine learning models like Hidden Markovs and Gaussian Mixtures at identifying speech patterns.
Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences: Vol 379, No 2212
Recent developments in computational physiology have effectively exploited advanced signal processing and artificial intelligence tools for uncovering characteristic features of physiological and pathological states in humans. While these advanced tools have demonstrated better-than-human diagnostic capabilities, the high complexity of these computational'black boxes' may severely limit scientific inference, especially in terms of biological insights on disease mechanisms. This theme issue highlights challenges and opportunities of advanced computational tools for processing series comprehensive of autonomic nervous system dynamics, with a more specific focus on cardiovascular control physiology and pathology. Such a wide panoramic perspective highlights the issues of specificity in heartbeat-related features and fosters the transition from the black-box paradigm to interpretable and personalised clinical models in cardiology research. This issue will soon be available to buy in print.
On the Philosophical, Cognitive and Mathematical Foundations of Symbiotic Autonomous Systems (SAS)
Wang, Yingxu, Karray, Fakhri, Kwong, Sam, Plataniotis, Konstantinos N., Leung, Henry, Hou, Ming, Tunstel, Edward, Rudas, Imre J., Trajkovic, Ljiljana, Kaynak, Okyay, Kacprzyk, Janusz, Zhou, Mengchu, Smith, Michael H., Chen, Philip, Patel, Shushma
Symbiotic Autonomous Systems (SAS) are advanced intelligent and cognitive systems exhibiting autonomous collective intelligence enabled by coherent symbiosis of human-machine interactions in hybrid societies. Basic research in the emerging field of SAS has triggered advanced general AI technologies functioning without human intervention or hybrid symbiotic systems synergizing humans and intelligent machines into coherent cognitive systems. This work presents a theoretical framework of SAS underpinned by the latest advances in intelligence, cognition, computer, and system sciences. SAS are characterized by the composition of autonomous and symbiotic systems that adopt bio-brain-social-inspired and heterogeneously synergized structures and autonomous behaviors. This paper explores their cognitive and mathematical foundations. The challenge to seamless human-machine interactions in a hybrid environment is addressed. SAS-based collective intelligence is explored in order to augment human capability by autonomous machine intelligence towards the next generation of general AI, autonomous computers, and trustworthy mission-critical intelligent systems. Emerging paradigms and engineering applications of SAS are elaborated via an autonomous knowledge learning system that symbiotically works between humans and cognitive robots.
- North America > Canada > Ontario > Toronto (0.14)
- North America > Canada > Alberta > Census Division No. 6 > Calgary Metropolitan Region > Calgary (0.14)
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.06)
- (19 more...)
- Health & Medicine (0.94)
- Information Technology (0.93)