Oceania
Can 'we the people' keep AI in check? • TechCrunch
Technologist and researcher Aviv Ovadya isn't sure that generative AI can be governed, but he thinks the most plausible means of keeping it in check might just be entrusting those who will be impacted by AI to collectively decide on the ways to curb it. That means you; it means me. It's the power of large networks of individuals to problem solve faster and more equitably than a small group of individuals might do alone (including, say, in Washington). In Taiwan, for example, civic-minded hackers in 2015 formed a platform -- "virtual Taiwan" -- that "brings together representatives from the public, private and social sectors to debate policy solutions to problems primarily related to the digital economy," as explained in 2019 by Taiwan's digital minister, Audrey Tang in the New York Times. Since then, vTaiwan, as it's known, has tackled dozens of issues by "relying on a mix of online debate and face-to-face discussions with stakeholders," Tang wrote at the time.
Scaling Dimension
Ganter, Bernhard, Hanika, Tom, Hirth, Johannes
Conceptual Scaling is a useful standard tool in Formal Concept Analysis and beyond. Its mathematical theory, as elaborated in the last chapter of the FCA monograph, still has room for improvement. As it stands, even some of the basic definitions are in flux. Our contribution was triggered by the study of concept lattices for tree classifiers and the scaling methods used there. We extend some basic notions, give precise mathematical definitions for them and introduce the concept of scaling dimension. In addition to a detailed discussion of its properties, including an example, we show theoretical bounds related to the order dimension of concept lattices. We also study special subclasses, such as the ordinal and the interordinal scaling dimensions, and show for them first results and examples.
Wizard of Errors: Introducing and Evaluating Machine Learning Errors in Wizard of Oz Studies
When designing Machine Learning (ML) enabled solutions, designers often need to simulate ML behavior through the Wizard of Oz (WoZ) approach to test the user experience before the ML model is available. Although reproducing ML errors is essential for having a good representation, they are rarely considered. We introduce Wizard of Errors (WoE), a tool for conducting WoZ studies on ML-enabled solutions that allows simulating ML errors during user experience assessment. We explored how this system can be used to simulate the behavior of a computer vision model. We tested WoE with design students to determine the importance of considering ML errors in design, the relevance of using descriptive error types instead of confusion matrix, and the suitability of manual error control in WoZ studies. Our work identifies several challenges, which prevent realistic error representation by designers in such studies. We discuss the implications of these findings for design.
On the Sparse DAG Structure Learning Based on Adaptive Lasso
Xu, Danru, Gao, Erdun, Huang, Wei, Wang, Menghan, Song, Andy, Gong, Mingming
Learning the underlying Bayesian Networks (BNs), represented by directed acyclic graphs (DAGs), of the concerned events from purely-observational data is a crucial part of evidential reasoning. This task remains challenging due to the large and discrete search space. A recent flurry of developments followed NOTEARS[1] recast this combinatorial problem into a continuous optimization problem by leveraging an algebraic equality characterization of acyclicity. However, the continuous optimization methods suffer from obtaining non-spare graphs after the numerical optimization, which leads to the inflexibility to rule out the potentially cycle-inducing edges or false discovery edges with small values. To address this issue, in this paper, we develop a completely data-driven DAG structure learning method without a predefined value to post-threshold small values. We name our method NOTEARS with adaptive Lasso (NOTEARS-AL), which is achieved by applying the adaptive penalty method to ensure the sparsity of the estimated DAG. Moreover, we show that NOTEARS-AL also inherits the oracle properties under some specific conditions. Extensive experiments on both synthetic and a real-world dataset demonstrate that our method consistently outperforms NOTEARS.
Bounding the Capabilities of Large Language Models in Open Text Generation with Prompt Constraints
Lu, Albert, Zhang, Hongxin, Zhang, Yanzhe, Wang, Xuezhi, Yang, Diyi
The limits of open-ended generative models are unclear, yet increasingly important. What causes them to succeed and what causes them to fail? In this paper, we take a prompt-centric approach to analyzing and bounding the abilities of open-ended generative models. We present a generic methodology of analysis with two challenging prompt constraint types: structural and stylistic. These constraint types are categorized into a set of well-defined constraints that are analyzable by a single prompt. We then systematically create a diverse set of simple, natural, and useful prompts to robustly analyze each individual constraint. Using the GPT-3 text-davinci-002 model as a case study, we generate outputs from our collection of prompts and analyze the model's generative failures. We also show the generalizability of our proposed method on other large models like BLOOM and OPT. Our results and our in-context mitigation strategies reveal open challenges for future research. We have publicly released our code at https://github.com/SALT-NLP/Bound-Cap-LLM.
Competent but Rigid: Identifying the Gap in Empowering AI to Participate Equally in Group Decision-Making
Zheng, Chengbo, Wu, Yuheng, Shi, Chuhan, Ma, Shuai, Luo, Jiehui, Ma, Xiaojuan
Existing research on human-AI collaborative decision-making focuses mainly on the interaction between AI and individual decision-makers. There is a limited understanding of how AI may perform in group decision-making. This paper presents a wizard-of-oz study in which two participants and an AI form a committee to rank three English essays. One novelty of our study is that we adopt a speculative design by endowing AI equal power to humans in group decision-making.We enable the AI to discuss and vote equally with other human members. We find that although the voice of AI is considered valuable, AI still plays a secondary role in the group because it cannot fully follow the dynamics of the discussion and make progressive contributions. Moreover, the divergent opinions of our participants regarding an "equal AI" shed light on the possible future of human-AI relations.
Multimodal Propaganda Processing
Propaganda campaigns have long been used to influence public opinion via disseminating biased and/or misleading information. Despite the increasing prevalence of propaganda content on the Internet, few attempts have been made by AI researchers to analyze such content. We introduce the task of multimodal propaganda processing, where the goal is to automatically analyze propaganda content. We believe that this task presents a long-term challenge to AI researchers and that successful processing of propaganda could bring machine understanding one important step closer to human understanding. We discuss the technical challenges associated with this task and outline the steps that need to be taken to address it.
Conveying the Predicted Future to Users: A Case Study of Story Plot Prediction
Huang, Chieh-Yang, Naphade, Saniya, Karanam, Kavya Laalasa, Huang, Ting-Hao 'Kenneth'
Creative writing is hard: Novelists struggle with writer's block daily. While automatic story generation has advanced recently, it is treated as a "toy task" for advancing artificial intelligence rather than helping people. In this paper, we create a system that produces a short description that narrates a predicted plot using existing story generation approaches. Our goal is to assist writers in crafting a consistent and compelling story arc. We conducted experiments on Amazon Mechanical Turk (AMT) to examine the quality of the generated story plots in terms of consistency and storiability. The results show that short descriptions produced by our frame-enhanced GPT-2 (FGPT-2) were rated as the most consistent and storiable among all models; FGPT-2's outputs even beat some random story snippets written by humans. Next, we conducted a preliminary user study using a story continuation task where AMT workers were given access to machine-generated story plots and asked to write a follow-up story. FGPT-2 could positively affect the writing process, though people favor other baselines more. Our study shed some light on the possibilities of future creative writing support systems beyond the scope of completing sentences. Our code is available at: https://github.com/appleternity/Story-Plot-Generation.
Robots Enter the Race to Help Save Dying Coral Reefs
Taryn Foster believes Australia's dying coral reefs can still be rescued--if she can speed up efforts to save them. For years, biologists like her have been lending a hand to reefs struggling with rising temperatures and ocean acidity: They've collected coral fragments and cut them into pieces to propagate and grow them in nurseries on land; they've crossbred species to build in heat-resistance; they've experimented with probiotics as a defense against deadly diseases. But even transplanting thousands of these healthy and upgraded corals onto damaged reefs will not be enough to save entire ecosystems, Foster says. "We need some way of deploying corals at scale." Sounds like a job for some robots.
AI can track bees on camera. Here's how that will help farmers
Artificial intelligence (AI) offers a new way to track the insect pollinators essential to farming. In a new study, we installed miniature digital cameras and computers inside a greenhouse at a strawberry farm in Victoria, Australia, to track bees and other insects as they flew from plant to plant pollinating flowers. Using custom AI software, we analysed several days' video footage from our system to build a picture of pollination behaviour over a wide area. In the same way that monitoring roads can help traffic run smoothly, our system promises to make pollination more efficient. This will enable better use of resources and increased food production.