Education
Hard Choices in Artificial Intelligence
Dobbe, Roel, Gilbert, Thomas Krendl, Mintz, Yonatan
As AI systems are integrated into high stakes social domains, researchers now examine how to design and operate them in a safe and ethical manner. However, the criteria for identifying and diagnosing safety risks in complex social contexts remain unclear and contested. In this paper, we examine the vagueness in debates about the safety and ethical behavior of AI systems. We show how this vagueness cannot be resolved through mathematical formalism alone, instead requiring deliberation about the politics of development as well as the context of deployment. Drawing from a new sociotechnical lexicon, we redefine vagueness in terms of distinct design challenges at key stages in AI system development. The resulting framework of Hard Choices in Artificial Intelligence (HCAI) empowers developers by 1) identifying points of overlap between design decisions and major sociotechnical challenges; 2) motivating the creation of stakeholder feedback channels so that safety issues can be exhaustively addressed. As such, HCAI contributes to a timely debate about the status of AI development in democratic societies, arguing that deliberation should be the goal of AI Safety, not just the procedure by which it is ensured.
Fair Normalizing Flows
Balunoviฤ, Mislav, Ruoss, Anian, Vechev, Martin
Fair representation learning is an attractive approach that promises fairness of downstream predictors by encoding sensitive data. Unfortunately, recent work has shown that strong adversarial predictors can still exhibit unfairness by recovering sensitive attributes from these representations. In this work, we present Fair Normalizing Flows (FNF), a new approach offering more rigorous fairness guarantees for learned representations. Specifically, we consider a practical setting where we can estimate the probability density for sensitive groups. The key idea is to model the encoder as a normalizing flow trained to minimize the statistical distance between the latent representations of different groups. The main advantage of FNF is that its exact likelihood computation allows us to obtain guarantees on the maximum unfairness of any potentially adversarial downstream predictor. We experimentally demonstrate the effectiveness of FNF in enforcing various group fairness notions, as well as other attractive properties such as interpretability and transfer learning, on a variety of challenging real-world datasets.
Programming Puzzles
Schuster, Tal, Kalyan, Ashwin, Polozov, Oleksandr, Kalai, Adam Tauman
We introduce a new type of programming challenge called programming puzzles, as an objective and comprehensive evaluation of program synthesis, and release an open-source dataset of Python Programming Puzzles (P3). Each puzzle is defined by a short Python program $f$, and the goal is to find an input $x$ which makes $f$ output "True". The puzzles are objective in that each one is specified entirely by the source code of its verifier $f$, so evaluating $f(x)$ is all that is needed to test a candidate solution $x$. They do not require an answer key or input/output examples, nor do they depend on natural language understanding. The dataset is comprehensive in that it spans problems of a range of difficulties and domains, ranging from trivial string manipulation problems that are immediately obvious to human programmers (but not necessarily to AI), to classic programming puzzles (e.g., Towers of Hanoi), to interview/competitive-programming problems (e.g., dynamic programming), to longstanding open problems in algorithms and mathematics (e.g., factoring). The objective nature of P3 readily supports self-supervised bootstrapping. We develop baseline enumerative program synthesis and GPT-3 solvers that are capable of solving easy puzzles -- even without access to any reference solutions -- by learning from their own past solutions. Based on a small user study, we find puzzle difficulty to correlate between human programmers and the baseline AI solvers.
Does Knowledge Distillation Really Work?
Stanton, Samuel, Izmailov, Pavel, Kirichenko, Polina, Alemi, Alexander A., Wilson, Andrew Gordon
Large, deep networks can learn representations that generalize well. While smaller, more efficient networks lack the inductive biases to find these representations from training data alone, they may have the capacity to represent these solutions [e.g., 1, 16, 27, 39]. Influential work on knowledge distillation [19] argues that Bucilฤ et al. [4] "demonstrate convincingly that the knowledge acquired by a large ensemble of models [the teacher] can be transferred to a single small model [the student]". Indeed this quote encapsulates the conventional narrative of knowledge distillation: a student model learns a high-fidelity representation of a larger teacher, enabled by the teacher's soft labels. Conversely, in Figure 1 we show that with modern architectures knowledge distillation can lead to students with very different predictions from their teachers, even when the student has the capacity to perfectly match the teacher.
NewsCenter
A rising senior at San Diego State University, computer engineering major James Bunnell will soon have the distinction of having contributed to five scientific papers as an undergraduate. He is now focused on machine learning to assess the best options for materials to be used in sensors that will be embedded in the brain to help patients with debilitating movement disorders such as Parkinson's Disease. Bunnell is a first-generation college student whose parents worked for the Federal Aviation Administration. Their experience changed his own career trajectory, leading him to embark on a pathway to research. When Bunnell transferred to SDSU from Palomar College, he benefited from two programs designed to provide academic support and opportunities for students looking to pursue STEM career pathways: Advancing Navy STEM Workforce through Education and Research (ANSWER) and Math, Engineering, Science Achievement (MESA) programs.
Machine Learning & Deep Learning in Python & R
In this section we will learn - What does Machine Learning mean. What are the meanings or different terms associated with machine learning? You will see some examples so that you understand what machine learning actually is. It also contains steps involved in building a machine learning model, not just linear models, any machine learning model.
Python Programming - From Basics to Advanced level [2021]
We will start with Python Installation and a few basics of Python. Once you reach here you can start the new journey to learn domain-specific python libraries like NumPy, Pandas, Matplotlib, Scikit-learn, TensorFlow, Keras for machine learning. By the end of the course, you'll be able to apply in confidence for Python programming jobs with the right skills which you will learn in this course. Here's what a few students have told us about the Python programming course after going through it "This course is so recommended to anyone who wants to learn python. It clearly teaches you several important things even experts fail to deliver. It also teaches so many different ways and how to tackle some interview questions. Very thorough and easy to understand. "That was a very thorough and informative course.
The Math you need for Machine Learning
I never cared much about machine learning. If we were playing the blame game, I'd certainly point to the "math is not my thing" excuse. I had seen it with my own eyes, and it seemed daunting. Back then, we had to write training loops from scratch, beg large universities for cluster time, and deal with parallel libraries and remote debugging. That was a long time ago.
#cloudcomputing_2021-06-09_07-26-57.xlsx
The graph represents a network of 1,360 Twitter users whose tweets in the requested range contained "#cloudcomputing", or who were replied to or mentioned in those tweets. The network was obtained from the NodeXL Graph Server on Wednesday, 09 June 2021 at 14:35 UTC. The requested start date was Monday, 07 June 2021 at 00:01 UTC and the maximum number of days (going backward) was 14. The maximum number of tweets collected was 7,500. The tweets in the network were tweeted over the 4-day, 5-hour, 24-minute period from Wednesday, 02 June 2021 at 18:36 UTC to Monday, 07 June 2021 at 00:00 UTC.