I have spent years investigating serious criminals. From human traffickers and gunrunners to contract killers and cocaine smugglers. One thing I never thought I'd end up investigating was whisky. BBC Producer Liam McDougall told me of a source he had – a whistleblower – who said that organised crime had infiltrated the whisky industry, that he had compiled a hitlist of suspect whisky investment companies, and would we be interested in looking into it? One of those on the list was a company called Cask Whisky Ltd.

Limited diversity in standardized benchmarks for evaluating audio representation learning (ARL) methods may hinder systematic comparison of current methods' capabilities. We present ARCH, a comprehensive benchmark for evaluating ARL methods on diverse audio classification domains, covering acoustic events, music, and speech. ARCH comprises 12 datasets, that allow us to thoroughly assess pre-trained SSL models of different sizes. ARCH streamlines benchmarking of ARL techniques through its unified access to a wide range of domains and its ability to readily incorporate new datasets and models. To address the current lack of open-source, pre-trained models for non-speech audio, we also release new pre-trained models that demonstrate strong performance on non-speech datasets. We argue that the presented wide-ranging evaluation provides valuable insights into state-of-the-art ARL methods, and is useful to pinpoint promising research directions.

Ant colonies can descend several metres underground, house millions of insects and last for decades, despite being made without the benefit of machinery and reinforcing material. The secrets of these impressive architectural structures are being revealed by three-dimensional X-ray imaging and computer simulations, and could be used to develop robotic mining machines. José Andrade at the California Institute of Technology and his colleagues set up miniature ant colonies in a container holding 500 millilitres of soil and 15 western harvester ants (Pogonomyrmex occidentalis). The position of every ant and every grain of soil was then captured by high-resolution X-ray scans every 10 minutes for 20 hours. The X-ray results gave researchers exact details about the shape of each tunnel and which grains were being removed to create it.

We present ARCH, a computational pathology (CP) multiple instance captioning dataset to facilitate dense supervision of CP tasks. Existing CP datasets focus on narrow tasks; ARCH on the other hand contains dense diagnostic and morphological descriptions for a range of stains, tissue types and pathologies. Using intrinsic dimensionality estimation, we show that ARCH is the only CP dataset to (ARCH-)rival its computer vision analog MS-COCO Captions. We conjecture that an encoder pre-trained on dense image captions learns transferable representations for most CP tasks. We support the conjecture with evidence that ARCH representation transfers to a variety of pathology sub-tasks better than ImageNet features or representations obtained via self-supervised or multi-task learning on pathology images alone. We release our best model and invite other researchers to test it on their CP tasks.

Neural networks have become an increasingly popular tool for solving many real-world problems. They are a general framework for differentiable optimization which includes many other machine learning approaches as special cases. In this thesis we build a category-theoretic formalism around a class of neural networks exemplified by CycleGAN. CycleGAN is a collection of neural networks, closed under composition, whose inductive bias is increased by enforcing composition invariants, i.e. cycle-consistencies. Inspired by Functorial Data Migration, we specify the interconnection of these networks using a categorical schema, and network instances as set-valued functors on this schema. We also frame neural network architectures, datasets, models, and a number of other concepts in a categorical setting and thus show a special class of functors, rather than functions, can be learned using gradient descent. We use the category-theoretic framework to conceive a novel neural network architecture whose goal is to learn the task of object insertion and object deletion in images with unpaired data. We test the architecture on three different datasets and obtain promising results.

Neural networks are increasingly employed in safety-critical domains. This has prompted interest in verifying or certifying logically encoded properties of neural networks. Prior work has largely focused on checking existential properties, wherein the goal is to check whether there exists any input that violates a given property of interest. However, neural network training is a stochastic process, and many questions arising in their analysis require probabilistic and quantitative reasoning, i.e., estimating how many inputs satisfy a given property. To this end, our paper proposes a novel and principled framework to quantitative verification of logical properties specified over neural networks. Our framework is the first to provide PAC-style soundness guarantees, in that its quantitative estimates are within a controllable and bounded error from the true count. We instantiate our algorithmic framework by building a prototype tool called NPAQ that enables checking rich properties over binarized neural networks. We show how emerging security analyses can utilize our framework in 3 concrete point applications: quantifying robustness to adversarial inputs, efficacy of trojan attacks, and fairness/bias of given neural networks.

GENE_ARCH is a Generative Design System that combines Pareto Genetic Algorithms with an advanced energy simulation engine. This work explores its integration with a Shape Grammar, acting as GENE_ARCH’s shape generation module. The islamic patio house typology is readdressed in a contemporary context, by improving its energy-efficiency, and rethinking its role in the genesis of high-density urban areas, while respecting its specific spatial organization and cultural grounding. Field work was carried out in Marrakesh, surveying a number of patio houses, becoming the Corpus of Design, from where a shape grammar was generated. The computational implementation of the patio house grammar was done within GENE_ARCH. The resulting program was able to generate new, alternative patio houses designs that were more energy efficient, while respecting the traditional rules captured from the analysis of existing houses. After the computational system was fully implemented, it was possible to realise a large number of experiments. The first experiments kept more restrained rules, thus generating new designs that closer resembled the existing ones. The progressive relaxation of rules and constraints allowed for a larger number of variations to emerge. Analysis of energy results provide insight into the main patterns resulting from the GA search processes.