Goto

Collaborating Authors

 Government


NASA: Neural Architecture Search and Acceleration for Hardware Inspired Hybrid Networks

arXiv.org Artificial Intelligence

To this end, we propose a Neural Architecture DNN-powered solutions in numerous real-world applications. Search and Acceleration framework dubbed NASA, which However, the extensively used multiplications in DNNs enables automated multiplication-reduced DNN development dominate their energy consumption and have largely challenged and integrates a dedicated multiplication-reduced accelerator DNNs' achievable hardware efficiency, motivating for boosting DNNs' achievable efficiency. Specifically, multiplication-free DNNs that adopt hardware-friendly operators, NASA adopts neural architecture search (NAS) spaces that such as additions and bit-wise shifts, which require a augment the state-of-the-art one with hardware inspired smaller unit energy and area cost as compared to multiplications multiplication-free operators, such as shift and adder, armed [26]. In particular, pioneering works of multiplicationfree with a novel progressive pretrain strategy (PGP) together DNNs include (1) DeepShift [6] which proposes to adopt with customized training recipes to automatically search for merely shift layers for DNNs, (2) AdderNet [20] which advocates optimal multiplication-reduced DNNs; On top of that, NASA using adder layers to implement DNNs for trading the further develops a dedicated accelerator, which advocates a massive multiplications with lower-cost additions, and (3) chunk-based template and auto-mapper dedicated for NASA-ShiftAddNet [26] which combines both shift and adder layers NAS resulting DNNs to better leverage their algorithmic to construct DNNs for better trading-off the achievable properties for boosting hardware efficiency.


Shtetl-Optimized ยป Blog Archive ยป My AI Safety Lecture for UT Effective Altruism

#artificialintelligence

Two weeks ago, I gave a lecture setting out my current thoughts on AI safety, halfway through my year at OpenAI. I was asked to speak by UT Austin's Effective Altruist club. You can watch the lecture on YouTube here (I recommend 2x speed). The timing turned out to be weird, coming immediately after the worst disaster to hit the Effective Altruist movement in its history, as I acknowledged in the talk. I then spent 20 minutes taking questions. For those who (like me) prefer text over video, below I've produced an edited transcript, by starting with YouTube's automated transcript and then, well, editing it. Thank you so much for inviting me here. I do feel a little bit sheepish to be lecturing you about AI safety, as someone who's worked on this subject for all of five months. But this past spring, I accepted an extremely interesting opportunity to go on leave for a year to think about what theoretical computer science can do for AI safety. I'm doing this at OpenAI, which is one of the world's leading AI startups, based in San Francisco although I'm mostly working from Austin. Despite its name, OpenAI is famously not 100% open โ€ฆ so there are certain topics that I'm not allowed to talk about, like the capabilities of the very latest systems and whether or not they'll blow people's minds when released. By contrast, OpenAI is very happy for me to talk about AI safety: what it is and and what if anything can we do about it. So what I thought I'd do is to tell you a little bit about the specific projects that I've been working on at OpenAI, but also just, as an admitted newcomer, share some general thoughts about AI safety and how Effective Altruists might want to think about it. I'll try to leave plenty of time for discussion. Maybe I should mention that the thoughts that I'll tell you today are ones that, until last week, I had considered writing up for an essay contest run by something called the FTX Future Fund. Unfortunately, the FTX Future Fund no longer exists. It was founded by someone named Sam Bankman-Fried, whose a net worth went from 15 billion dollars to some negative number of dollars in the space of two days, in one of the biggest financial scandals in memory. This is obviously a calamity for the EA community, which had been counting on funding from this individual. I feel terrible about all the projects left in the lurch, to say nothing of FTX's customers. Let's start with this: raise your hand if you've tried GPT-3.


ChatGPT has a devastating sense of humour

#artificialintelligence

ChatGPT makes an irresistible first impression. It's got a devastating sense of humour, a stunning capacity for dead-on mimicry, and it can rhyme like nobody's business. Then there is its overwhelming reasonableness. When ChatGPT fails the Turing test, it's usually because it refuses to offer its own opinion on just about anything. When was the last time real people on the internet declined to tell you what they really think?


How the Rise of Artificial Intelligence Could Impact Job Trends

#artificialintelligence

Artificial intelligence (AI), just like any other technology, has its merits and demerits. While many people are excited about the increasing use of AI and how it simplifies our lives, they also feel threatened by the idea of robots taking over day-to-day tasks -- especially in the employment sector. This blog offers you insights into how the rise of artificial intelligence is disrupting the world, and what the future holds. Artificial intelligence is the simulation of human intelligence in machines that enables efficient decision-making and problem-solving. Simply put, it's a technology that enables computer systems to replicate human intelligence to perform advanced functions. The most popular examples of AI are autonomous cars, facial recognition, autocorrect options for texts, and chatbots.


Enhancing Cyber Resilience of Networked Microgrids using Vertical Federated Reinforcement Learning

arXiv.org Artificial Intelligence

This paper presents a novel federated reinforcement learning (Fed-RL) methodology to enhance the cyber resiliency of networked microgrids. We formulate a resilient reinforcement learning (RL) training setup which (a) generates episodic trajectories injecting adversarial actions at primary control reference signals of the grid forming (GFM) inverters and (b) trains the RL agents (or controllers) to alleviate the impact of the injected adversaries. To circumvent data-sharing issues and concerns for proprietary privacy in multi-party-owned networked grids, we bring in the aspects of federated machine learning and propose a novel Fed-RL algorithm to train the RL agents. To this end, the conventional horizontal Fed-RL approaches using decoupled independent environments fail to capture the coupled dynamics in a networked microgrid, which leads us to propose a multi-agent vertically federated variation of actor-critic algorithms, namely federated soft actor-critic (FedSAC) algorithm. We created a customized simulation setup encapsulating microgrid dynamics in the GridLAB-D/HELICS co-simulation platform compatible with the OpenAI Gym interface for training RL agents. Finally, the proposed methodology is validated with numerical examples of modified IEEE 123-bus benchmark test systems consisting of three coupled microgrids.


Neuromorphic Computing and Sensing in Space

arXiv.org Artificial Intelligence

The term ``neuromorphic'' refers to systems that are closely resembling the architecture and/or the dynamics of biological neural networks. Typical examples are novel computer chips designed to mimic the architecture of a biological brain, or sensors that get inspiration from, e.g., the visual or olfactory systems in insects and mammals to acquire information about the environment. This approach is not without ambition as it promises to enable engineered devices able to reproduce the level of performance observed in biological organisms -- the main immediate advantage being the efficient use of scarce resources, which translates into low power requirements. The emphasis on low power and energy efficiency of neuromorphic devices is a perfect match for space applications. Spacecraft -- especially miniaturized ones -- have strict energy constraints as they need to operate in an environment which is scarce with resources and extremely hostile. In this work we present an overview of early attempts made to study a neuromorphic approach in a space context at the European Space Agency's (ESA) Advanced Concepts Team (ACT).


Selected Trends in Artificial Intelligence for Space Applications

arXiv.org Artificial Intelligence

The development and adoption of artificial intelligence (AI) technologies in space applications is growing quickly as the consensus increases on the potential benefits introduced. As more and more aerospace engineers are becoming aware of new trends in AI, traditional approaches are revisited to consider the applications of emerging AI technologies. Already at the time of writing, the scope of AI-related activities across academia, the aerospace industry and space agencies is so wide that an in-depth review would not fit in these pages. In this chapter we focus instead on two main emerging trends we believe capture the most relevant and exciting activities in the field: differentiable intelligence and on-board machine learning. Differentiable intelligence, in a nutshell, refers to works making extensive use of automatic differentiation frameworks to learn the parameters of machine learning or related models. Onboard machine learning considers the problem of moving inference as well as learning of machine learning models onboard. Within these fields, we discuss a few selected projects originating from the European Space Agency's (ESA) Advanced Concepts Team (ACT), giving priority to advanced topics going beyond the transposition of established AI techniques and practices to the space domain, thus necessarily leaving out interesting activities with a possibly higher technology readiness level. We start with the topic of differentiable intelligence by introducing Guidance and Control Networks (G&CNets), Eclipse Networks (EclipseNETs), Neural Density Fields (geodesyNets) as well as the use of implicit representations to learn differentiable models for the shapes of asteroids and comets from LiDAR data.


OpenRAN Gym: AI/ML Development, Data Collection, and Testing for O-RAN on PAWR Platforms

arXiv.org Artificial Intelligence

Open Radio Access Network (RAN) architectures will enable interoperability, openness and programmable data-driven control in next generation cellular networks. However, developing and testing efficient solutions that generalize across heterogeneous cellular deployments and scales, and that optimize network performance in such diverse environments is a complex task that is still largely unexplored. In this paper we present OpenRAN Gym, a unified, open, and O-RAN-compliant experimental toolbox for data collection, design, prototyping and testing of end-to-end data-driven control solutions for next generation Open RAN systems. OpenRAN Gym extends and combines into a unique solution several software frameworks for data collection of RAN statistics and RAN control, and a lightweight O-RAN near-real-time RAN Intelligent Controller (RIC) tailored to run on experimental wireless platforms. We first provide an overview of the various architectural components of OpenRAN Gym and describe how it is used to collect data and design, train and test artificial intelligence and machine learning O-RAN-compliant applications (xApps) at scale. We then describe in detail how to test the developed xApps on softwarized RANs and provide an example of two xApps developed with OpenRAN Gym that are used to control a network with 7 base stations and 42 users deployed on the Colosseum testbed. Finally, we show how solutions developed with OpenRAN Gym on Colosseum can be exported to real-world, heterogeneous wireless platforms, such as the Arena testbed and the POWDER and COSMOS platforms of the PAWR program. OpenRAN Gym and its software components are open-source and publicly-available to the research community. By guiding the readers through running experiments with OpenRAN Gym, we aim at providing a key reference for researchers and practitioners working on experimental Open RAN systems.


Bounding Membership Inference

arXiv.org Artificial Intelligence

Differential Privacy (DP) is the de facto standard for reasoning about the privacy guarantees of a training algorithm. Despite the empirical observation that DP reduces the vulnerability of models to existing membership inference (MI) attacks, a theoretical underpinning as to why this is the case is largely missing in the literature. In practice, this means that models need to be trained with DP guarantees that greatly decrease their accuracy. In this paper, we provide a tighter bound on the positive accuracy (i.e., attack precision) of any MI adversary when a training algorithm provides $(\varepsilon, \delta)$-DP. Our bound informs the design of a novel privacy amplification scheme: an effective training set is sub-sampled from a larger set prior to the beginning of training. We find this greatly reduces the bound on MI positive accuracy. As a result, our scheme allows the use of looser DP guarantees to limit the success of any MI adversary; this ensures that the model's accuracy is less impacted by the privacy guarantee. While this clearly benefits entities working with far more data than they need to train on, it can also improve the accuracy-privacy trade-off on benchmarks studied in the academic literature. Consequently, we also find that subsampling decreases the effectiveness of a state-of-the-art MI attack (LiRA) much more effectively than training with stronger DP guarantees on MNIST and CIFAR10. We conclude by discussing implications of our MI bound on the field of machine unlearning.


'If you build they will come': Automatic Identification of News-Stakeholders to detect Party Preference in News Coverage

arXiv.org Artificial Intelligence

The coverage of different stakeholders mentioned in the news articles significantly impacts the slant or polarity detection of the concerned news publishers. For instance, the pro-government media outlets would give more coverage to the government stakeholders to increase their accessibility to the news audiences. In contrast, the anti-government news agencies would focus more on the views of the opponent stakeholders to inform the readers about the shortcomings of government policies. In this paper, we address the problem of stakeholder extraction from news articles and thereby determine the inherent bias present in news reporting. Identifying potential stakeholders in multi-topic news scenarios is challenging because each news topic has different stakeholders. The research presented in this paper utilizes both contextual information and external knowledge to identify the topic-specific stakeholders from news articles. We also apply a sequential incremental clustering algorithm to group the entities with similar stakeholder types. We carried out all our experiments on news articles on four Indian government policies published by numerous national and international news agencies. We also further generalize our system, and the experimental results show that the proposed model can be extended to other news topics.