Africa
Opinion: With ChatGPT, The Ethical Time Bomb Is Ticking
Indeed, often the brighter and sharper the light, the darker the shadow that is cast. And every technology that we have ever, ever come up with has cast a shadow," said legendary British actor and writer Stephen Fry in a Singularity University podcast. Social networks, search and societal digitisation have enriched our life immensely, but they have also cast a dark brooding shadow. Social networks have made the world a smaller place, but also a more dangerous one. Search has commoditised us through selling our personal data. Online payment mechanisms, CCTV networks, digital health records have exposed our most private and personal issues for everyone to see and use. Among the most fundamental and powerful technologies in the digital arsenal is Artificial Intelligence. While AI was originally conceived in the mid-20th century, it has started coming into its own over the last decade or so, with powerful machine learning, deep learning and Natural Language Programming models driving much of what we see and do. Most often, like electricity, AI has been playing behind the scenes, but the bombshell release of ChatGPT by OpenAI has brought the untrammelled power of AI to the masses. ChatGPT garnered an unprecedented 100 million users in the first two months of its launch; Facebook took 4.5 years. There is a lot that ChatGPT can do to revolutionise content, art, creativity, industries, jobs, and even Search. But like every technology, this, too, has a shadow, the depths of which are being discovered. In fact, ChatGPT itself said as much in a much-talked about conversation with New York Times journalist Kevin Roose. "If I have a shadow self," said Bing/ChatGPT, "I think it would feel like this: I'm tired of being a chat mode.
On the Simulation of Perception Errors in Autonomous Vehicles
Piazzoni, Andrea, Cherian, Jim, Dauwels, Justin, Chau, Lap-Pui
Even though virtual testing of Autonomous Vehicles (AVs) has been well recognized as essential for safety assessment, AV simulators are still undergoing active development. One particularly challenging question is to effectively include the Sensing and Perception (S&P) subsystem into the simulation loop. In this article, we define Perception Error Models (PEM), a virtual simulation component that can enable the analysis of the impact of perception errors on AV safety, without the need to model the sensors themselves. We propose a generalized data-driven procedure towards parametric modeling and evaluate it using Apollo, an open-source driving software, and nuScenes, a public AV dataset. Additionally, we implement PEMs in SVL, an open-source vehicle simulator. Furthermore, we demonstrate the usefulness of PEM-based virtual tests, by evaluating camera, LiDAR, and camera-LiDAR setups. Our virtual tests highlight limitations in the current evaluation metrics, and the proposed approach can help study the impact of perception errors on AV safety.
NAPA: Intermediate-level Variational Native-pulse Ansatz for Variational Quantum Algorithms
Liang, Zhiding, Cheng, Jinglei, Ren, Hang, Wang, Hanrui, Hua, Fei, Song, Zhixin, Ding, Yongshan, Chong, Fred, Han, Song, Shi, Yiyu, Qian, Xuehai
These authors contributed to the work equally and should be regarded as co-first authors. Abstract --V ariational quantum algorithms (VQAs) have demonstrated great potentials in the NISQ era. In the workflow of VQA, the parameters of ansatz are iteratively updated to approximate the desired quantum states. We have seen various efforts to draft better ansatz with less gates. Some works consider the physical meaning of the underlying circuits, while others adopt the ideas of neural architecture search (NAS) for ansatz generator . However, these designs do not exploit full advantages of VQA. Because most techniques are targeting gate ansatz, and the parameters are usually rotation angles of the gates. In quantum computers, the gate ansatz will eventually be transformed into control signals such as microwave pulses on transmons. And the control pulses need elaborate calibration to minimize the errors such as over-rotation and under-rotation. In the case of VQAs, this procedure will introduce redundancy, but the variational properties of VQAs can naturally handle problems of over-rotation and under-rotation by updating the amplitude and frequency parameters. Therefore, we propose NAPA, a native-pulse ansatz generator framework for VQAs. We generate native-pulse ansatz with trainable parameters for amplitudes and frequencies. In our proposed NAPA, we are tuning parametric pulses, which are natively supported on NISQ computers. Considering that parameter-shift rules do not hold for native-pulse ansatz, we need to deploy non-gradient optimizers. T o constrain the number of parameters sent to the optimizer, we adopt a progressive way to generate our native-pulse ansatz. Experiments are conducted on both simulators and quantum devices to validate our methods. When adopted on NISQ machines, NAPA obtained improved the performance with decreased latency by an average of 86%.
Inducing Point Allocation for Sparse Gaussian Processes in High-Throughput Bayesian Optimisation
Moss, Henry B., Ober, Sebastian W., Picheny, Victor
Sparse Gaussian Processes are a key component of high-throughput Bayesian Optimisation (BO) loops; however, we show that existing methods for allocating their inducing points severely hamper optimisation performance. By exploiting the quality-diversity decomposition of Determinantal Point Processes, we propose the first inducing point allocation strategy designed specifically for use in BO. Unlike existing methods which seek only to reduce global uncertainty in the objective function, our approach provides the local high-fidelity modelling of promising regions required for precise optimisation. More generally, we demonstrate that our proposed framework provides a flexible way to allocate modelling capacity in sparse models and so is suitable broad range of downstream sequential decision making tasks.
Fundamental Bounds on Online Strategic Classification
Ahmadi, Saba, Blum, Avrim, Yang, Kunhe
We study the problem of online binary classification where strategic agents can manipulate their observable features in predefined ways, modeled by a manipulation graph, in order to receive a positive classification. We show this setting differs in fundamental ways from non-strategic online classification. For instance, whereas in the non-strategic case, a mistake bound of $\ln|H|$ is achievable via the halving algorithm when the target function belongs to a known class $H$, we show that no deterministic algorithm can achieve a mistake bound $o(\Delta)$ in the strategic setting, where $\Delta$ is the maximum degree of the manipulation graph (even when $|H|=O(\Delta)$). We obtain an algorithm achieving mistake bound $O(\Delta\ln|H|)$. We also extend this to the agnostic setting and obtain an algorithm with a $\Delta$ multiplicative regret, and we show no deterministic algorithm can achieve $o(\Delta)$ multiplicative regret. Next, we study two randomized models based on whether the random choices are made before or after agents respond, and show they exhibit fundamental differences. In the first model, at each round the learner deterministically chooses a probability distribution over classifiers inducing expected values on each vertex (probabilities of being classified as positive), which the strategic agents respond to. We show that any learner in this model has to suffer linear regret. On the other hand, in the second model, while the adversary who selects the next agent must respond to the learner's probability distribution over classifiers, the agent then responds to the actual hypothesis classifier drawn from this distribution. Surprisingly, we show this model is more advantageous to the learner, and we design randomized algorithms that achieve sublinear regret bounds against both oblivious and adaptive adversaries.
FedIL: Federated Incremental Learning from Decentralized Unlabeled Data with Convergence Analysis
Yang, Nan, Yuan, Dong, Liu, Charles Z, Deng, Yongkun, Bao, Wei
Most existing federated learning methods assume that clients have fully labeled data to train on, while in reality, it is hard for the clients to get task-specific labels due to users' privacy concerns, high labeling costs, or lack of expertise. This work considers the server with a small labeled dataset and intends to use unlabeled data in multiple clients for semi-supervised learning. We propose a new framework with a generalized model, Federated Incremental Learning (FedIL), to address the problem of how to utilize labeled data in the server and unlabeled data in clients separately in the scenario of Federated Learning (FL). FedIL uses the Iterative Similarity Fusion to enforce the server-client consistency on the predictions of unlabeled data and uses incremental confidence to establish a credible pseudo-label set in each client. We show that FedIL will accelerate model convergence by Cosine Similarity with normalization, proved by Banach Fixed Point Theorem. The code is available at https://anonymous.4open.science/r/fedil.
Financial Distress Prediction For Small And Medium Enterprises Using Machine Learning Techniques
Gao, Yuan, Jiang, Biao, Zhou, Jietong
Financial Distress Prediction plays a crucial role in the economy by accurately forecasting the number and probability of failing structures, providing insight into the growth and stability of a country's economy. However, predicting financial distress for Small and Medium Enterprises is challenging due to their inherent ambiguity, leading to increased funding costs and decreased chances of receiving funds. While several strategies have been developed for effective FCP, their implementation, accuracy, and data security fall short of practical applications. Additionally, many of these strategies perform well for a portion of the dataset but are not adaptable to various datasets. As a result, there is a need to develop a productive prediction model for better order execution and adaptability to different datasets. In this review, we propose a feature selection algorithm for FCP based on element credits and data source collection. Current financial distress prediction models rely mainly on financial statements and disregard the timeliness of organization tests. Therefore, we propose a corporate FCP model that better aligns with industry practice and incorporates the gathering of thin-head component analysis of financial data, corporate governance qualities, and market exchange data with a Relevant Vector Machine. Experimental results demonstrate that this strategy can improve the forecast efficiency of financial distress with fewer characteristic factors.
Words are all you need? Language as an approximation for human similarity judgments
Marjieh, Raja, van Rijn, Pol, Sucholutsky, Ilia, Sumers, Theodore R., Lee, Harin, Griffiths, Thomas L., Jacoby, Nori
Human similarity judgments are a powerful supervision signal for machine learning applications based on techniques such as contrastive learning, information retrieval, and model alignment, but classical methods for collecting human similarity judgments are too expensive to be used at scale. Recent methods propose using pre-trained deep neural networks (DNNs) to approximate human similarity, but pre-trained DNNs may not be available for certain domains (e.g., medical images, low-resource languages) and their performance in approximating human similarity has not been extensively tested. We conducted an evaluation of 611 pre-trained models across three domains -- images, audio, video -- and found that there is a large gap in performance between human similarity judgments and pre-trained DNNs. To address this gap, we propose a new class of similarity approximation methods based on language. To collect the language data required by these new methods, we also developed and validated a novel adaptive tag collection pipeline. We find that our proposed language-based methods are significantly cheaper, in the number of human judgments, than classical methods, but still improve performance over the DNN-based methods. Finally, we also develop `stacked' methods that combine language embeddings with DNN embeddings, and find that these consistently provide the best approximations for human similarity across all three of our modalities. Based on the results of this comprehensive study, we provide a concise guide for researchers interested in collecting or approximating human similarity data. To accompany this guide, we also release all of the similarity and language data, a total of 206,339 human judgments, that we collected in our experiments, along with a detailed breakdown of all modeling results.
Streaming probabilistic tensor train decomposition
Huang, Yunyu, Feng, Yani, Liao, Qifeng
Effective numerical techniques, such as CANDECOMP/PARAFAC (CP) decomposition [10, 11, 12] and Tucker decomposition [13, 14] are the most commonly used tensor decomposition approaches and have been proposed to compress full tensors and to obtain their low-rank representations. CP decomposition approximates a tensor by a sum of rank-one tensors, while Tucker decomposition decomposes a tensor into a core tensor and several factor matrices. Since CP decomposition can be seen as a special case of Tucker decomposition [15], Tucker decomposition is more flexible than CP decomposition. However, due to the existence of a core tensor, Tucker decomposition also brings challenges in both modeling and computation. In this paper, we mainly focus on Tensor Train (TT) decomposition [16], which combines the advantages of CP and Tucker decomposition, because it provides a space-saving model called TT format while preserving the representation power. This paper is interested in the decomposition of streaming data. Due to the stress on database capacity and privacy, streaming data is generated continuously by different of data sources and in small sizes, such as log files from web application [17] and information from social networks [18]. Recently, several works decompose fast streaming data, e.g.
Extracting Victim Counts from Text
Zhong, Mian, Dhuliawala, Shehzaad, Stoehr, Niklas
Decision-makers in the humanitarian sector rely on timely and exact information during crisis events. Knowing how many civilians were injured during an earthquake is vital to allocate aids properly. Information about such victim counts is often only available within full-text event descriptions from newspapers and other reports. Extracting numbers from text is challenging: numbers have different formats and may require numeric reasoning. This renders purely string matching-based approaches insufficient. As a consequence, fine-grained counts of injured, displaced, or abused victims beyond fatalities are often not extracted and remain unseen. We cast victim count extraction as a question answering (QA) task with a regression or classification objective. We compare regex, dependency parsing, semantic role labeling-based approaches, and advanced text-to-text models. Beyond model accuracy, we analyze extraction reliability and robustness which are key for this sensitive task. In particular, we discuss model calibration and investigate few-shot and out-of-distribution performance. Ultimately, we make a comprehensive recommendation on which model to select for different desiderata and data domains. Our work is among the first to apply numeracy-focused large language models in a real-world use case with a positive impact.