icot
Large Language Model-driven Security Assistant for Internet of Things via Chain-of-Thought
Zeng, Mingfei, Xie, Ming, Zheng, Xixi, Li, Chunhai, Zhang, Chuan, Zhu, Liehuang
The rapid development of Internet of Things (IoT) technology has transformed people's way of life and has a profound impact on both production and daily activities. However, with the rapid advancement of IoT technology, the security of IoT devices has become an unavoidable issue in both research and applications. Although some efforts have been made to detect or mitigate IoT security vulnerabilities, they often struggle to adapt to the complexity of IoT environments, especially when dealing with dynamic security scenarios. How to automatically, efficiently, and accurately understand these vulnerabilities remains a challenge. To address this, we propose an IoT security assistant driven by Large Language Model (LLM), which enhances the LLM's understanding of IoT security vulnerabilities and related threats. The aim of the ICoT method we propose is to enable the LLM to understand security issues by breaking down the various dimensions of security vulnerabilities and generating responses tailored to the user's specific needs and expertise level. By incorporating ICoT, LLM can gradually analyze and reason through complex security scenarios, resulting in more accurate, in-depth, and personalized security recommendations and solutions. Experimental results show that, compared to methods relying solely on LLM, our proposed LLM-driven IoT security assistant significantly improves the understanding of IoT security issues through the ICoT approach and provides personalized solutions based on the user's identity, demonstrating higher accuracy and reliability.
Random Forest-of-Thoughts: Uncertainty-aware Reasoning for Computational Social Science
Wu, Xiaohua, Tao, Xiaohui, Wu, Wenjie, Li, Yuefeng, Li, Lin
Social surveys in computational social science are well-designed by elaborate domain theories that can effectively reflect the interviewee's deep thoughts without concealing their true feelings. The candidate questionnaire options highly depend on the interviewee's previous answer, which results in the complexity of social survey analysis, the time, and the expertise required. The ability of large language models (LLMs) to perform complex reasoning is well-enhanced by prompting learning such as Chain-of-thought (CoT) but still confined to left-to-right decision-making processes or limited paths during inference. This means they can fall short in problems that require exploration and uncertainty searching. In response, a novel large language model prompting method, called Random Forest of Thoughts (RFoT), is proposed for generating uncertainty reasoning to fit the area of computational social science. The RFoT allows LLMs to perform deliberate decision-making by generating diverse thought space and randomly selecting the sub-thoughts to build the forest of thoughts. It can extend the exploration and prediction of overall performance, benefiting from the extensive research space of response. The method is applied to optimize computational social science analysis on two datasets covering a spectrum of social survey analysis problems. Our experiments show that RFoT significantly enhances language models' abilities on two novel social survey analysis problems requiring non-trivial reasoning.
MetaOpenFOAM 2.0: Large Language Model Driven Chain of Thought for Automating CFD Simulation and Post-Processing
Chen, Yuxuan, Zhu, Xu, Zhou, Hua, Ren, Zhuyin
Computational Fluid Dynamics (CFD) is widely used in aerospace, energy, and biology to model fluid flow, heat transfer, and chemical reactions. While Large Language Models (LLMs) have transformed various domains, their application in CFD remains limited, particularly for complex tasks like post-processing. To bridge this gap, we introduce MetaOpenFOAM 2.0, which leverages Chain of Thought (COT) decomposition and iterative verification to enhance accessibility for non-expert users through natural language inputs. Tested on a new benchmark covering simulation (fluid flow, heat transfer, combustion) and post-processing (extraction, visualization), MetaOpenFOAM 2.0 achieved an Executability score of 6.3/7 and a pass rate of 86.9%, significantly outperforming MetaOpenFOAM 1.0 (2.1/7, 0%). Additionally, it proved cost-efficient, averaging $0.15 per case. An ablation study confirmed that COT-driven decomposition and iterative refinement substantially improved task performance. Furthermore, scaling laws showed that increasing COT steps enhanced accuracy while raising token usage, aligning with LLM post-training scaling trends. These results highlight the transformative potential of LLMs in automating CFD workflows for industrial and research applications. Code is available at https://github.com/Terry-cyx/MetaOpenFOAM
Interleaved-Modal Chain-of-Thought
Gao, Jun, Li, Yongqi, Cao, Ziqiang, Li, Wenjie
Chain-of-Thought (CoT) prompting elicits large language models (LLMs) to produce a series of intermediate reasoning steps before arriving at the final answer. However, when transitioning to vision-language models (VLMs), their text-only rationales struggle to express the fine-grained associations with the original image. In this paper, we propose an image-incorporated multimodal Chain-of-Thought, named \textbf{Interleaved-modal Chain-of-Thought (ICoT)}, which generates sequential reasoning steps consisting of paired visual and textual rationales to infer the final answer. Intuitively, the novel ICoT requires VLMs to enable the generation of fine-grained interleaved-modal content, which is hard for current VLMs to fulfill. Considering that the required visual information is usually part of the input image, we propose \textbf{Attention-driven Selection (ADS)} to realize ICoT over existing VLMs. ADS intelligently inserts regions of the input image to generate the interleaved-modal reasoning steps with ignorable additional latency. ADS relies solely on the attention map of VLMs without the need for parameterization, and therefore it is a plug-and-play strategy that can be generalized to a spectrum of VLMs. We apply ADS to realize ICoT on two popular VLMs of different architectures. Extensive evaluations of three benchmarks have shown that ICoT prompting achieves substantial performance (up to 14\%) and interpretability improvements compared to existing multimodal CoT prompting methods.
Internalizing ASR with Implicit Chain of Thought for Efficient Speech-to-Speech Conversational LLM
Yuen, Robin Shing-Hei, Tse, Timothy Tin-Long, Zhu, Jian
Current Speech LLMs are predominantly trained on extensive ASR and TTS datasets, excelling in tasks related to these domains. However, their ability to handle direct speech-to-speech conversations remains notably constrained. We find that Speech LLMs often rely on an ASR-to-TTS chain-of-thought pipeline (A-T-T-A chain) to generate good responses. The pipeline first recognizes speech into text and generates corresponding text responses before generating speech responses, which introduces significant latency. We propose a method that implicitly internalizes ASR chain of thought into a Speech LLM (A-T-A chain), allowing it to bypass the ASR transcript generation but still maintain speech conversation capabilities. Our approach reduces latency and improves the model's native understanding of speech, paving the way for more efficient and natural real-time audio interactions. We also release a large-scale synthetic conversational dataset to facilitate further research.
R & D Cooperation in AI: Report on the U.S. and Japanese Panel, IJACI 1985
The author acknowledges the kind cooperation of Professor Aravind Joshi, IJCAI program chairman, in extending the opportunity to produce this timely panel discussion The panelists included Dr Jack Williams. His presentation pinpointed the world forces of change, the government role in fostering efficient technological innovation, and the need to adapt to flexible manufacturing quickly. In discussing the AI industry, he said, LLThere are many similarities between AI and biotechnology, namely, the entrepreneurship and many startup firms, few products yet, but much commercial potential, a shortage of qualified talent, and a potential to create vast social change. The aspects of world forces of change are serious in that they threaten the livelihood of the U.S. economy because 70% of the U.S. output is in world markets. Abstract The consensus of government, academic, and industry leaders widely supports the strategic positioning of U.S. and Japanese research and development in mutually beneficial, two-way flows of innovation This report is derived from the IJCAI panel titled U S and Japanese Cooperation in AI and R&D Opportunities, held August 23, 1985 at the University of California at Los Angeles This panel discussed the sensitive topic of alternatives to nationalistic competitive strategies that have contributed to an extreme trade deficit surpassing $40 billion in 1985 The ideas offered by the panelists shed light on ways our countries' respective scientific communities can blend talents to achieve the best results in reducing trade frictions Each country has designated AI research as a key to unlock years of generations of technology and has directed billions of dollars to fund this development The most recognized projects are the U.S. Microelectronics Technology Computer Consortium (MCC) and Japan's Fifth Generation Computer Project (ICOT).
583
An informal workshop on concurrent logic programming, metaprogramming, and open systems was held at Xerox Palo Alto Research Center (PARC) on 8-9 September 1987 with support from the American Association for Artificial Intelligence. The 50 workshop participants came from the Japanese Fifth Generation Project (ICOT), the Weizmann Institute of Science in Israel, Imperial College in London, the Swedish Institute of Computer Science, Stanford University, the Massachusetts Institute of Technology (MIT), Carnegie-Mellon University (CMU), Cal Tech, Science University of Tokyo, Melbourne University, Calgary University, University of Wisconsin, Case Western Reserve, University of Oregon, Korea Advanced Institute of Science and Technology (KAIST), Quintus, Symbolics, IBM, and Xerox PARC. No proceedings were generated; instead, participants distributed copies of drafts, slides, and recent papers. A shared vision emerged from the morning session with concurrent logic programming fulfilling the same role that C and Assembler do now. Languages such as Flat Concurrent Prolog and Guarded Horn Clauses are seen as general-purpose, parallel machine languages and interface languages between hardware and software and not, as a newcomer to this field might expect, as high-level, AI, problemsolving languages.
Knowledge-Based Systems Research and Applications in Japan, 1992
Feigenbaum, Edward A., Friedland, Peter E., Johnson, Bruce B., Nii, H. Penny, Schorr, Herbert, Shrobe, Howard, Engelmore, Robert S.
This article summarizes the findings of a 1992 study of knowledge-based systems research and applications in Japan. Representatives of universities and businesses were chosen by the Japan Technology Evaluation Center to investigate the state of the technology in Japan relative to the United States. The panel's report focused on applications, tools, and research and development in universities and industry and on major national projects.
Concurrent Logic Programming, Metaprogramming, and Open Systems
An informal workshop on concurrent logic programming, metaprogramming, and open systems was held at Xerox Palo Alto Research Center (PARC) on 8-9 September 1987 with support from the Association for the Advancement of Artificial Intelligence. The 50 workshop participants came from the Japanese Fifth Generation Project (ICOT), the Weizmann Institute of Sci-ence in Israel, Imperial College in London, the Swedish Institute of Computer Science, Stanford University, the Mas-sachusetts Institute of Technology (MIT), Carnegie Mellon University (CMU), Cal Tech, Science University of Tokyo, Melbourne University, Calgary University, University of Wisconsin, Case Western Reserve, University of Oregon, Korea Advanced Institute of Science and Technology (KAIST), Quintus, Symbolics, IBM, and Xerox PARC. No proceedings were generated; instead, participants distributed copies of drafts, slides, and recent papers.
Research and Development Cooperation in Artificial Intelligence: Report on the U.S. and Japanese Panel, IJCAI-85
The consensus of government, academic, and industry leaders widely supports the strategic positioning of U.S. and Japanese research and development in mutually beneficial, two-way flows of innovation. This report is derived from the IJCAI panel titled U.S and Japanese Cooperation in AI and R&D Opportunities, held August 23, 1986 at the University of California at Los Angeles. This panel discussed the sensitive topic of alternatives to nationalistic competitive strategies that have contributed to an extreme trade deficit surpassing $40 billion in 1986. The ideas offered by the panelists shed light on ways our countries' respective scientific communities can blend talents to achieve the best results in reducing trade frictions. Each country has designated AI research as a key to unlock years of generations of technology and has directed billions of dollars to fund this development. The most recognized projects are the U.S. Microelectronics Technology Computer Consortium (MCC) and Japan's Fifth Generation Computer Project (ICOT). Although noting the obstacles, the panelists encouraged specific, shared efforts to ensure the development of a closer working relationship to explore AI's benefits.