Personal
Challenges and Practices of Deep Learning Model Reengineering: A Case Study on Computer Vision
Jiang, Wenxin, Banna, Vishnu, Vivek, Naveen, Goel, Abhinav, Synovic, Nicholas, Thiruvathukal, George K., Davis, James C.
Many engineering organizations are reimplementing and extending deep neural networks from the research community. We describe this process as deep learning model reengineering. Deep learning model reengineering - reusing, reproducing, adapting, and enhancing state-of-the-art deep learning approaches - is challenging for reasons including under-documented reference models, changing requirements, and the cost of implementation and testing. In addition, individual engineers may lack expertise in software engineering, yet teams must apply knowledge of software engineering and deep learning to succeed. Prior work has examined on DL systems from a "product" view, examining defects from projects regardless of the engineers' purpose. Our study is focused on reengineering activities from a "process" view, and focuses on engineers specifically engaged in the reengineering process. Our goal is to understand the characteristics and challenges of deep learning model reengineering. We conducted a case study of this phenomenon, focusing on the context of computer vision. Our results draw from two data sources: defects reported in open-source reeengineering projects, and interviews conducted with open-source project contributors and the leaders of a reengineering team. Our results describe how deep learning-based computer vision techniques are reengineered, analyze the distribution of defects in this process, and discuss challenges and practices. Integrating our quantitative and qualitative data, we proposed a novel reengineering workflow. Our findings inform several future directions, including: measuring additional unknown aspects of model reengineering; standardizing engineering practices to facilitate reengineering; and developing tools to support model reengineering and model reuse.
Mom speaks out after baby dies from swallowing water bead, plus ethical AI use in classrooms
Esther Jo Bethard loved playing with her siblings and going to the zoo. She died at 10 months of age after accidentally swallowing a water bead. HEARTBREAKING LOSS – Mom from Wisconsin calls for change after her 10-month-old daughter dies from swallowing a water bead. 'WATCH FOR INACCURACIES' – Here's how parents and teachers can ensure an ethical use of AI by kids during this back-to-school season. AVIATION TRAILBLAZER – Amelia Earhart becomes first woman to fly solo coast-to-coast on this day in history, 1932.
Controversial new AI app allows you to text with Jesus – and Satan
CyberGuy shows you how to save money with these apps. Welcome to the world of "Text With Jesus," where you're just a tap away from a conversation with the holy – and, for a price, the not-so-holy. CLICK TO GET KURT'S FREE CYBERGUY NEWSLETTER WITH SECURITY ALERTS, QUICK TIPS, TECH REVIEWS AND EASY HOW-TO'S TO MAKE YOU SMARTER For those longing for a more personal connection to their faith, this app might be the digital salvation they're seeking. Designed with devoted Christians in mind, "Text With Jesus" promises interaction with figures like Jesus, Mary, Joseph, Peter and Matthew. This app wears its spirituality on its screen, guiding you through its queries with responses mined from the depths of the Bible's rich text.
Congratulations to the winners of the the #IJCAI2023 distinguished paper awards
The IJCAI distinguished paper awards recognise some of the best papers presented at the conference each year. This year, three articles were named as distinguished papers. Abstract: Levin Tree Search (LTS) is a search algorithm that makes use of a policy (a probability distribution over actions) and comes with a theoretical guarantee on the number of expansions before reaching a goal node, depending on the quality of the policy. This guarantee can be used as a loss function, which we call the LTS loss, to optimize neural networks representing the policy (LTS NN). In this work we show that the neural network can be substituted with parameterized context models originating from the online compression literature (LTS CM). We show that the LTS loss is convex under this new model, which allows for using standard convex optimization tools, and obtain convergence guarantees to the optimal parameters in an online setting for a given set of solution trajectories -- guarantees that cannot be provided for neural networks.
Back to school with AI: How parents and educators can ensure its ethical use in the classroom
AI technology is quickly creeping into every industry, prompting new questions about whether online content comes from a human or a computer. The presence of advanced technology in the classroom may require conversations with students during this new school year. As artificial intelligence finds its way into more families' day-to-day routines, parents and teachers alike should be wary of how their kids are interacting with generative AI. This is according to SmartNews' head of trust and safety Arjun Narayan, who shared concerns during an interview with Fox News Digital. "As with any new technology, when it is very new, it's important to understand how you're engaging with that tech," said Narayan, who is based in Japan.
911 AI operator weeds out non-emergency calls to free up first responders
Former Chicago 911 dispatcher Keith Thornton Jr. joined "Fox & Friends First" to discuss how the crime surge is affecting law enforcement and communities nationwide. Understaffed 911 call centers across the country field non-emergency calls about stray animals or noise complaints on top of their workload of answering serious reports of medical emergencies, crimes and even death. Officials in Charleston County, South Carolina, however, are now leveraging artificial intelligence to streamline non-emergency calls in an effort to free up 911 operators to focus on getting first responders to the scene of emergency incidents as quickly as possible. "Our job is to serve the public the best way we can. So, I am not in any way demeaning anyone from the public, but someone who has their favorite cat stuck in a tree, that's an emergency for them as compared to someone's just been shot," Jim Lake, director of the Charleston County Consolidated Emergency Communications Center, told Fox News Digital in a recent phone interview.
Nonparametric Spatio-Temporal Joint Probabilistic Data Association Coupled Filter and Interfering Extended Target Tracking
Akbari, Behzad, Zhu, Haibin, Pan, Ya-Jun, Tharmarasa, R.
Extended target tracking estimates the centroid and shape of the target in space and time. In various situations where extended target tracking is applicable, the presence of multiple targets can lead to interference, particularly when they maneuver behind one another in a sensor like a camera. Nonetheless, when dealing with multiple extended targets, there's a tendency for them to share similar shapes within a group, which can enhance their detectability. For instance, the coordinated movement of a cluster of aerial vehicles might cause radar misdetections during their convergence or divergence. Similarly, in the context of a self-driving car, lane markings might split or converge, resulting in inaccurate lane tracking detections. A well-known joint probabilistic data association coupled (JPDAC) filter can address this problem in only a single-point target tracking. A variation of JPDACF was developed by introducing a nonparametric Spatio-Temporal Joint Probabilistic Data Association Coupled Filter (ST-JPDACF) to address the problem for extended targets. Using different kernel functions, we manage the dependency of measurements in space (inside a frame) and time (between frames). Kernel functions are able to be learned using a limited number of training data. This extension can be used for tracking the shape and dynamics of nonparametric dependent extended targets in clutter when targets share measurements. The proposed algorithm was compared with other well-known supervised methods in the interfering case and achieved promising results.
The Right to Not Have Your Mind Read
Jared Genser in many ways fits a certain Washington, D.C., type. He wears navy suits and keeps his hair cut short. He graduated from a top law school, joined a large firm, and made partner at 40. Eventually, he became disenchanted with big law and started his own boutique practice with offices off--where else--Dupont Circle. What distinguishes Genser from the city's other 50-something lawyers is his unusual clientele: He represents high-value political prisoners.
What's the Problem, Linda? The Conjunction Fallacy as a Fairness Problem
The field of Artificial Intelligence (AI) is focusing on creating automated decision-making (ADM) systems that operate as close as possible to human-like intelligence. This effort has pushed AI researchers into exploring cognitive fields like psychology. The work of Daniel Kahneman and the late Amos Tversky on biased human decision-making, including the study of the conjunction fallacy, has experienced a second revival because of this. Under the conjunction fallacy a human decision-maker will go against basic probability laws and rank as more likely a conjunction over one of its parts. It has been proven overtime through a set of experiments with the Linda Problem being the most famous one. Although this interdisciplinary effort is welcomed, we fear that AI researchers ignore the driving force behind the conjunction fallacy as captured by the Linda Problem: the fact that Linda must be stereotypically described as a woman. In this paper we revisit the Linda Problem and formulate it as a fairness problem. In doing so we introduce perception as a parameter of interest through the structural causal perception framework. Using an illustrative decision-making example, we showcase the proposed conceptual framework and its potential impact for developing fair ADM systems.
RLCD: Reinforcement Learning from Contrast Distillation for Language Model Alignment
Yang, Kevin, Klein, Dan, Celikyilmaz, Asli, Peng, Nanyun, Tian, Yuandong
We propose Reinforcement Learning from Contrast Distillation (RLCD), a method for aligning language models to follow natural language principles without using human feedback. RLCD trains a preference model using simulated preference pairs that contain both a high-quality and low-quality example, generated using contrasting positive and negative prompts. The preference model is then used to improve a base unaligned language model via reinforcement learning. Empirically, RLCD outperforms RLAIF (Bai et al., 2022b) and context distillation (Huang et al., 2022) baselines across three diverse alignment tasks--harmlessness, helpfulness, and story outline generation--and on both 7B and 30B model scales for preference data simulation. Reinforcement Learning from Human Feedback (RLHF) has recently been used to great effect to align pretrained large language models (LLMs) to human preferences, optimizing for desirable qualities like harmlessness and helpfulness (Bai et al., 2022a) and achieving ...