certification process
A Comparative Evaluation of Prominent Methods in Autonomous Vehicle Certification
Kırmızıgül, Mustafa Erdem, Doğruyol, Hasan Feyzi, Bayram, Haluk
The "Vision Zero" policy, introduced by the Swedish Parliament in 1997, aims to eliminate fatalities and serious injuries resulting from traffic accidents. To achieve this goal, the use of self-driving vehicles in traffic is envisioned and a roadmap for the certification of self-driving vehicles is aimed to be determined. However, it is still unclear how the basic safety requirements that autonomous vehicles must meet will be verified and certified, and which methods will be used. This paper focuses on the comparative evaluation of the prominent methods planned to be used in the certification process of autonomous vehicles. It examines the prominent methods used in the certification process, develops a pipeline for the certification process of autonomous vehicles, and determines the stages, actors, and areas where the addressed methods can be applied.
- Europe > Germany (0.14)
- Asia > Singapore (0.14)
- Europe > Middle East > Republic of Türkiye > Istanbul Province > Istanbul (0.04)
- (6 more...)
- Transportation > Ground > Road (1.00)
- Government > Regional Government (0.93)
- Transportation > Passenger (0.93)
- (3 more...)
Practical Application and Limitations of AI Certification Catalogues in the Light of the AI Act
Autischer, Gregor, Waxnegger, Kerstin, Kowald, Dominik
In this work-in-progress, we investigate the certification of AI systems, focusing on the practical application and limitations of existing certification catalogues in the light of the AI Act by attempting to certify a publicly available AI system. We aim to evaluate how well current approaches work to effectively certify an AI system, and how publicly accessible AI systems, that might not be actively maintained or initially intended for certification, can be selected and used for a sample certification process. Our methodology involves leveraging the Fraunhofer AI Assessment Catalogue as a comprehensive tool to systematically assess an AI model's compliance with certification standards. We find that while the catalogue effectively structures the evaluation process, it can also be cumbersome and time-consuming to use. We observe the limitations of an AI system that has no active development team anymore and highlighted the importance of complete system documentation. Finally, we identify some limitations of the certification catalogues used and proposed ideas on how to streamline the certification process.
- Europe > United Kingdom (0.14)
- Europe > Austria > Styria > Graz (0.04)
- North America > United States > New York > New York County > New York City (0.04)
- (3 more...)
- Health & Medicine (1.00)
- Information Technology > Security & Privacy (0.93)
- Law > Statutes (0.68)
- (3 more...)
The Contribution of XAI for the Safe Development and Certification of AI: An Expert-Based Analysis
Fresz, Benjamin, Göbels, Vincent Philipp, Omri, Safa, Brajovic, Danilo, Aichele, Andreas, Kutz, Janika, Neuhüttler, Jens, Huber, Marco F.
Developing and certifying safe - or so-called trustworthy - AI has become an increasingly salient issue, especially in light of upcoming regulation such as the EU AI Act. In this context, the black-box nature of machine learning models limits the use of conventional avenues of approach towards certifying complex technical systems. As a potential solution, methods to give insights into this black-box - devised in the field of eXplainable AI (XAI) - could be used. In this study, the potential and shortcomings of such methods for the purpose of safe AI development and certification are discussed in 15 qualitative interviews with experts out of the areas of (X)AI and certification. We find that XAI methods can be a helpful asset for safe AI development, as they can show biases and failures of ML-models, but since certification relies on comprehensive and correct information about technical systems, their impact is expected to be limited.
- North America > United States > New York > New York County > New York City (0.05)
- Europe > Germany > Baden-Württemberg > Stuttgart Region > Stuttgart (0.04)
- North America > United States > Virginia > Fairfax County > Reston (0.04)
- (5 more...)
- Research Report (1.00)
- Questionnaire & Opinion Survey (0.93)
- Personal > Interview (0.46)
Fairness Certification for Natural Language Processing and Large Language Models
Freiberger, Vincent, Buchmann, Erik
Natural Language Processing (NLP) plays an important role in our daily lives, particularly due to the enormous progress of Large Language Models (LLM). However, NLP has many fairness-critical use cases, e.g., as an expert system in recruitment or as an LLM-based tutor in education. Since NLP is based on human language, potentially harmful biases can diffuse into NLP systems and produce unfair results, discriminate against minorities or generate legal issues. Hence, it is important to develop a fairness certification for NLP approaches. We follow a qualitative research approach towards a fairness certification for NLP. In particular, we have reviewed a large body of literature on algorithmic fairness, and we have conducted semi-structured expert interviews with a wide range of experts from that area. We have systematically devised six fairness criteria for NLP, which can be further refined into 18 sub-categories. Our criteria offer a foundation for operationalizing and testing processes to certify fairness, both from the perspective of the auditor and the audited organization.
- Europe > Germany > Saxony > Leipzig (0.04)
- North America > United States > Texas > Kleberg County (0.04)
- North America > United States > Texas > Chambers County (0.04)
- Asia > China (0.04)
- Research Report (1.00)
- Overview (1.00)
- Personal > Interview (0.87)
- Law (1.00)
- Information Technology > Security & Privacy (1.00)
- Banking & Finance (1.00)
Framework for Certification of AI-Based Systems
Gariel, Maxime, Shimanuki, Brian, Timpe, Rob, Wilson, Evan
The current certification process for aerospace software is not adapted to "AI-based" algorithms such as deep neural networks. Unlike traditional aerospace software, the precise parameters optimized during neural network training are as important as (or more than) the code processing the network and they are not directly mathematically understandable. Despite their lack of explainability such algorithms are appealing because for some applications they can exhibit high performance unattainable with any traditional explicit line-by-line software methods. This paper proposes a framework and principles that could be used to establish certification methods for neural network models for which the current certification processes such as DO-178 cannot be applied. While it is not a magic recipe, it is a set of common sense steps that will allow the applicant and the regulator increase their confidence in the developed software, by demonstrating the capabilities to bring together, trace, and track the requirements, data, software, training process, and test results.
- Transportation > Air (1.00)
- Aerospace & Defense (1.00)
IIT Professor's ePlane Company aims to ferry Indians in flying air taxi in 2023 - Express Computer
As urban mobility giants like Boeing, Hyundai, Airbus, Toyota, Uber and Joby Aviation plan to soon ferry passengers in air taxis, the homegrown ePlane Company is all set to to build India's first flying electric taxi to make passenger commute and cargo transport up to 10 times faster, says its founder and CTO Satya Chakravarthy The startup is in the final stages of building a sub-scale version of the flying aircraft and expects to commence its flight trials in the next couple of months. "We are developing the full-scale prototype, the ePlane e200, and aim to have the e200 cargo variant built towards the end of 2022 and undergo the certification process through the next year for it to be ready for commercial deployment approximately by late 2023," Chakravarthy told IANS. The passenger version of the ePlane e200 would undergo additional development and flight tests for a more rigorous certification process, "which would take us until 2024 for its certification and their commercialisation as air taxis will happen subsequently," he noted. The market for flying cars, now known as electric air taxis, can reach $1.5 trillion globally by 2040, according to a recent study by Morgan Stanley Research. Earlier this year, the ePlane company that aims to develop electric planes for short-range intra-city commutes, raised $5 million in a pre-series A round.
- Transportation > Passenger (1.00)
- Transportation > Air (1.00)
Certifiable Artificial Intelligence Through Data Fusion
Blasch, Erik, Bin, Junchi, Liu, Zheng
This paper reviews and proposes concerns in adopting, fielding, and maintaining artificial intelligence (AI) systems. While the AI community has made rapid progress, there are challenges in certifying AI systems. Using procedures from design and operational test and evaluation, there are opportunities towards determining performance bounds to manage expectations of intended use. A notional use case is presented with image data fusion to support AI object recognition certifiability considering precision versus distance.
- North America > United States > District of Columbia > Washington (0.04)
- North America > Canada > British Columbia > Regional District of Central Okanagan > Kelowna (0.04)
- Transportation > Air (1.00)
- Aerospace & Defense (1.00)
- Government > Military (0.94)
- (2 more...)
- Information Technology > Data Science > Data Integration (1.00)
- Information Technology > Artificial Intelligence > Vision (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Information Fusion (1.00)
- Information Technology > Artificial Intelligence > Machine Learning (1.00)
Trusted Artificial Intelligence: Towards Certification of Machine Learning Applications
Winter, Philip Matthias, Eder, Sebastian, Weissenböck, Johannes, Schwald, Christoph, Doms, Thomas, Vogt, Tom, Hochreiter, Sepp, Nessler, Bernhard
Artificial Intelligence is one of the fastest growing technologies of the 21st century and accompanies us in our daily lives when interacting with technical applications. However, reliance on such technical systems is crucial for their widespread applicability and acceptance. The societal tools to express reliance are usually formalized by lawful regulations, i.e., standards, norms, accreditations, and certificates. Therefore, the T\"UV AUSTRIA Group in cooperation with the Institute for Machine Learning at the Johannes Kepler University Linz, proposes a certification process and an audit catalog for Machine Learning applications. We are convinced that our approach can serve as the foundation for the certification of applications that use Machine Learning and Deep Learning, the techniques that drive the current revolution in Artificial Intelligence. While certain high-risk areas, such as fully autonomous robots in workspaces shared with humans, are still some time away from certification, we aim to cover low-risk applications with our certification procedure. Our holistic approach attempts to analyze Machine Learning applications from multiple perspectives to evaluate and verify the aspects of secure software development, functional requirements, data quality, data protection, and ethics. Inspired by existing work, we introduce four criticality levels to map the criticality of a Machine Learning application regarding the impact of its decisions on people, environment, and organizations. Currently, the audit catalog can be applied to low-risk applications within the scope of supervised learning as commonly encountered in industry. Guided by field experience, scientific developments, and market demands, the audit catalog will be extended and modified accordingly.
- Europe (1.00)
- North America > United States > California (0.28)
- Overview (1.00)
- Instructional Material (0.92)
- Research Report > New Finding (0.67)
- Research Report > Experimental Study (0.45)
- Leisure & Entertainment > Games (1.00)
- Law (1.00)
- Information Technology > Security & Privacy (1.00)
- (4 more...)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Performance Analysis > Accuracy (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
- (3 more...)
Six barriers to digital transformation; CIO strategies to conquer them
That led to an aggressive pace of change over the past few years, said Merim Becirovic, Accenture's managing director of core infrastructure and business operations. Consider, for instance, this measure of success: Three years ago, Accenture had only 10% of its infrastructure and compute needs in the cloud, but now it has 90% in the cloud. Such gains didn't come without challenges, Becirovic said. Accenture leaders discovered a number of potential barriers to digital transformation, ranging from new skill requirements to security to just how fast the organization can keep changing. Accenture is far from alone in its quest for transformation.
- Professional Services (1.00)
- Information Technology > Security & Privacy (0.96)
- Information Technology > Artificial Intelligence (1.00)
- Information Technology > Security & Privacy (0.70)
- Information Technology > Data Science > Data Mining (0.48)
AI needs a certification process, not legislation
Artificial intelligence is quickly becoming a part of daily life. Enterprise implementations of AI-based technologies tripled in 2018, according to Gartner. At the same time, it's reaching ubiquity in consumer-facing applications, helping us write our emails, discover new music, and get on-demand customer support. At every touchpoint, our data is being collected and used to make machines faster and smarter, and that's driving calls for regulation from global citizens, governments, and companies who want to ensure deployments of machine and deep learning algorithms are safe and ethical. While implementing laws to protect consumers from "AI-gone-wild" may seem like a reasonable proposition, it's one that's doomed to fail.
- North America > United States (0.50)
- Asia > China (0.05)
- Information Technology > Security & Privacy (1.00)
- Law > Statutes (0.72)
- Government > Regional Government > North America Government > United States Government (0.31)