Goto

Collaborating Authors

 aicrowd


Performance, Opaqueness, Consequences, and Assumptions: Simple questions for responsible planning of machine learning solutions

Biecek, Przemyslaw

arXiv.org Artificial Intelligence

The data revolution has generated a huge demand for data-driven solutions. This demand propels a growing number of easy-to-use tools and training for aspiring data scientists that enable the rapid building of predictive models. Today, weapons of math destruction can be easily built and deployed without detailed planning and validation. This rapidly extends the list of AI failures, i.e. deployments that lead to financial losses or even violate democratic values such as equality, freedom and justice. The lack of planning, rules and standards around the model development leads to the ,,anarchisation of AI". This problem is reported under different names such as validation debt, reproducibility crisis, and lack of explainability. Post-mortem analysis of AI failures often reveals mistakes made in the early phase of model development or data acquisition. Thus, instead of curing the consequences of deploying harmful models, we shall prevent them as early as possible by putting more attention to the initial planning stage. In this paper, we propose a quick and simple framework to support planning of AI solutions. The POCA framework is based on four pillars: Performance, Opaqueness, Consequences, and Assumptions. It helps to set the expectations and plan the constraints for the AI solution before any model is built and any data is collected. With the help of the POCA method, preliminary requirements can be defined for the model-building process, so that costly model misspecification errors can be identified as soon as possible or even avoided. AI researchers, product owners and business analysts can use this framework in the initial stages of building AI solutions.


CMU's Roborace Team Launches Virtual, Autonomous Racing Challenge

CMU School of Computer Science

A virtual, autonomous racing challenge launching this week will enable aspiring racers to head to the track without building a car, knowing how to brake and accelerate through a corner, or leaving their computer. And as teams tackle the demands of high-speed and safe driving that pushes race cars to their limits, they will improve the safety of autonomous vehicles and the learning algorithms teaching them to drive. The Learn-to-Race Autonomous Racing Virtual Challenge started Monday, Dec. 6. Competitors use the Learn-to-Race environment to teach an artificially intelligent agent how to race. The challenge is coupled with a workshop on Safe Learning for Autonomous Driving, which is accepting research paper submissions.


Flatland-RL : Multi-Agent Reinforcement Learning on Trains

Mohanty, Sharada, Nygren, Erik, Laurent, Florian, Schneider, Manuel, Scheller, Christian, Bhattacharya, Nilabha, Watson, Jeremy, Egli, Adrian, Eichenberger, Christian, Baumberger, Christian, Vienken, Gereon, Sturm, Irene, Sartoretti, Guillaume, Spigler, Giacomo

arXiv.org Artificial Intelligence

Efficient automated scheduling of trains remains a major challenge for modern railway systems. The underlying vehicle rescheduling problem (VRSP) has been a major focus of Operations Research (OR) since decades. Traditional approaches use complex simulators to study VRSP, where experimenting with a broad range of novel ideas is time consuming and has a huge computational overhead. In this paper, we introduce a two-dimensional simplified grid environment called "Flatland" that allows for faster experimentation. Flatland does not only reduce the complexity of the full physical simulation, but also provides an easy-to-use interface to test novel approaches for the VRSP, such as Reinforcement Learning (RL) and Imitation Learning (IL). In order to probe the potential of Machine Learning (ML) research on Flatland, we (1) ran a first series of RL and IL experiments and (2) design and executed a public Benchmark at NeurIPS 2020 to engage a large community of researchers to work on this problem. Our own experimental results, on the one hand, demonstrate that ML has potential in solving the VRSP on Flatland. On the other hand, we identify key topics that need further research. Overall, the Flatland environment has proven to be a robust and valuable framework to investigate the VRSP for railway networks. Our experiments provide a good starting point for further research and for the participants of the NeurIPS 2020 Flatland Benchmark. All of these efforts together have the potential to have a substantial impact on shaping the mobility of the future.