inherent risk
A Survey on Responsible LLMs: Inherent Risk, Malicious Use, and Mitigation Strategy
Wang, Huandong, Fu, Wenjie, Tang, Yingzhou, Chen, Zhilong, Huang, Yuxi, Piao, Jinghua, Gao, Chen, Xu, Fengli, Jiang, Tao, Li, Yong
While large language models (LLMs) present significant potential for supporting numerous real-world applications and delivering positive social impacts, they still face significant challenges in terms of the inherent risk of privacy leakage, hallucinated outputs, and value misalignment, and can be maliciously used for generating toxic content and unethical purposes after been jailbroken. Therefore, in this survey, we present a comprehensive review of recent advancements aimed at mitigating these issues, organized across the four phases of LLM development and usage: data collecting and pre-training, fine-tuning and alignment, prompting and reasoning, and post-processing and auditing. We elaborate on the recent advances for enhancing the performance of LLMs in terms of privacy protection, hallucination reduction, value alignment, toxicity elimination, and jailbreak defenses. In contrast to previous surveys that focus on a single dimension of responsible LLMs, this survey presents a unified framework that encompasses these diverse dimensions, providing a comprehensive view of enhancing LLMs to better serve real-world applications.
- Europe > United Kingdom (0.14)
- Asia > China > Beijing > Beijing (0.04)
- Asia > Singapore (0.04)
- (8 more...)
- Research Report (1.00)
- Overview (1.00)
- Law (1.00)
- Information Technology > Security & Privacy (1.00)
- Government (1.00)
- (2 more...)
SOTIF Entropy: Online SOTIF Risk Quantification and Mitigation for Autonomous Driving
Peng, Liang, Li, Boqi, Yu, Wenhao, Yang, Kai, Shao, Wenbo, Wang, Hong
Autonomous driving confronts great challenges in complex traffic scenarios, where the risk of Safety of the Intended Functionality (SOTIF) can be triggered by the dynamic operational environment and system insufficiencies. The SOTIF risk is reflected not only intuitively in the collision risk with objects outside the autonomous vehicles (AVs), but also inherently in the performance limitation risk of the implemented algorithms themselves. How to minimize the SOTIF risk for autonomous driving is currently a critical, difficult, and unresolved issue. Therefore, this paper proposes the "Self-Surveillance and Self-Adaption System" as a systematic approach to online minimize the SOTIF risk, which aims to provide a systematic solution for monitoring, quantification, and mitigation of inherent and external risks. The core of this system is the risk monitoring of the implemented artificial intelligence algorithms within the AV. As a demonstration of the Self-Surveillance and Self-Adaption System, the risk monitoring of the perception algorithm, i.e., YOLOv5 is highlighted. Moreover, the inherent perception algorithm risk and external collision risk are jointly quantified via SOTIF entropy, which is then propagated downstream to the decision-making module and mitigated. Finally, several challenging scenarios are demonstrated, and the Hardware-in-the-Loop experiments are conducted to verify the efficiency and effectiveness of the system. The results demonstrate that the Self-Surveillance and Self-Adaption System enables dependable online monitoring, quantification, and mitigation of SOTIF risk in real-time critical traffic environments.
- Asia > Middle East > Jordan (0.14)
- North America > United States > Michigan > Washtenaw County > Ann Arbor (0.14)
- Asia > China > Beijing > Beijing (0.04)
- (8 more...)
- Transportation > Ground > Road (1.00)
- Information Technology (1.00)
- Automobiles & Trucks (1.00)
- Government > Regional Government > North America Government > United States Government (0.46)
Artificial intelligence (AI) in banking: The double-edged sword
Artificial intelligence (AI) is proving to be a double-edged sword for the banking industry. Sifting through the chatter in the financial industry there are two main themes emerging. Firstly, the'BigTech' with their prowess in data, artificial intelligence (AI) and cloud could exert significant strain on banking profits and eventually on the stability of financial systems. Secondly, the use of AI algorithms and models bring risks that are not yet fully understood and appreciated by industry or regulators. In other words, damned if you do, damned if you don't.
- North America > United States (0.32)
- Europe > Switzerland > Basel-City > Basel (0.06)
- Banking & Finance (1.00)
- Government > Military (0.51)
- Information Technology > Security & Privacy (0.48)
- Government > Regional Government > North America Government > United States Government (0.32)
Artificial intelligence (AI) in banking: The double-edged sword
Artificial intelligence (AI) is proving to be a double-edged sword for the banking industry. Sifting through the chatter in the financial industry there are two main themes emerging. Firstly, the'BigTech' with their prowess in data, artificial intelligence (AI) and cloud could exert significant strain on banking profits and eventually on the stability of financial systems. Secondly, the use of AI algorithms and models bring risks that are not yet fully understood and appreciated by industry or regulators. In other words, damned if you do, damned if you don't.
- North America > United States (0.32)
- Europe > Switzerland > Basel-City > Basel (0.06)
- Banking & Finance (1.00)
- Government > Military (0.51)
- Information Technology > Security & Privacy (0.48)
- Government > Regional Government > North America Government > United States Government (0.32)
Accurate, Data-Efficient Learning from Noisy, Choice-Based Labels for Inherent Risk Scoring
Huang, W. Ronny, Perez, Miguel A.
Inherent risk scoring is an important function in anti-money laundering, used for determining the riskiness of an individual during onboarding $\textit{before}$ fraudulent transactions occur. It is, however, often fraught with two challenges: (1) inconsistent notions of what constitutes as high or low risk by experts and (2) the lack of labeled data. This paper explores a new paradigm of data labeling and data collection to tackle these issues. The data labeling is choice-based; the expert does not provide an absolute risk score but merely chooses the most/least risky example out of a small choice set, which reduces inconsistency because experts make only relative judgments of risk. The data collection is synthetic; examples are crafted using optimal experimental design methods, obviating the need for real data which is often difficult to obtain due to regulatory concerns. We present the methodology of an end-to-end inherent risk scoring algorithm that we built for a large financial institution. The system was trained on a small set of synthetic data (188 examples, 24 features) whose labels are obtained via the choice-based paradigm using an efficient number of expert labelers. The system achieves 89% accuracy on a test set of 52 examples, with an area under the ROC curve of 93%.
- Africa > Nigeria (0.05)
- Europe > Italy (0.05)
- North America > United States > New York > New York County > New York City (0.04)
- (3 more...)
Inherent Risks of Agriculture Drive AI Adoption
The cultivation and domestication of plants and animals first began around 12,000 years ago, making agriculture the oldest of all enterprises. It is still among the largest. Despite this heritage, the timeless uncertainties of weather, land, and demand are driving the industry to adopt artificial intelligence (AI) technologies – at least in the developed world. One example is the Western Growers Center for Innovation & Technology (WGCIT) in Salinas, California. The WGCIT was created to discover new technologies, set up testing, facilitate industry feedback, and communicate progress to produce farmers in California, Arizona, and Colorado.
- North America > United States > Colorado (0.26)
- North America > United States > California > Monterey County > Salinas (0.26)
- North America > United States > Arizona (0.26)
A Knowledge-Based Model of Audit Risk
Dhar, Vasant, Lewis, Barry, Peters, James
Within the academic and professional auditing communities, there has been growing concern about how to accurately assess the various risks associated with performing an audit. These risks are difficult to conceptualize in terms of numeric estimates. This article discusses the development of a prototype computational model (computer program) that assesses one of the major audit risks -- inherent risk. This program bases most of its inferencing activities on a qualitative model of a typical business enterprise.
- North America > United States > Oklahoma > Payne County > Cushing (0.04)
- North America > United States > Colorado > Boulder County > Boulder (0.04)
- Research Report (0.66)
- Overview (0.48)