Modern intelligent systems researchers form hypotheses about system behavior and then run experiments using one or more independent variables to test their hypotheses. We present SIERRA, a novel framework structured around that idea for accelerating research development and improving reproducibility of results. SIERRA accelerates research by automating the process of generating executable experiments from queries over independent variables(s), executing experiments, and processing the results to generate deliverables such as graphs and videos. It shifts the paradigm for testing hypotheses from procedural ("Do these steps to answer the query") to declarative ("Here is the query to test--GO!"), reducing the burden on researchers. It employs a modular architecture enabling easy customization and extension for the needs of individual researchers, thereby eliminating manual configuration and processing via throw-away scripts. SIERRA improves reproducibility of research by providing automation independent of the execution environment (HPC hardware, real robots, etc.) and targeted platform (arbitrary simulator or real robots). This enables exact experiment replication, up to the limit of the execution environment and platform, as well as making it easy for researchers to test hypotheses in different computational environments.

The proceedings series Advances in Intelligent Systems Research aims to publish proceedings from conferences on all disciplines dealing with and affecting the issue of understanding and reproducing intelligence in artificial systems. All proceedings in this series are open access, i.e. the articles published in them are immediately and permanently free to read, download, copy & distribute. Each volume is published under the CC BY-NC 4.0 user license which defines the permitted 3rd-party reuse of its articles. The online publication of each proceedings is sponsored by the conference organizers and hence no additional publication fees are required. Should you wish to publish a proceedings in this series, then please request a proceedings proposal form by sending an email to contact@atlantis-press.com.

Big Data Lab (BDL) BDL is led by Dr. Tong Zhang. BDL focuses on large-scale machine learning algorithms and applications in areas such as predictive analytics, large data structure algorithms, and intelligent systems research. BDL's mission is to make people's lives better through big data. Institute of Deep Learning (IDL) Baidu launched the Institute of Deep Learning in 2013. The team's focus areas include image recognition, machine learning, robotics, human-computer interaction, 3D vision and heterogeneous computing.

The Center for Automation and Intelligent Systems Research at Case Western Reserve University, founded in 1984, provides the setting and the administrative and funding mechanisms for coordinating and focusing the capabilities of faculty members and students from many disciplines and departments to deal with significant realworld problems encountered in the automation of production. The center serves as an interface between separate basic research efforts in the various disciplines and academic departments and the multidisciplinary group efforts needed to deal effectively with nontrivial real problems.