South America
Co-designing an AI Impact Assessment Report Template with AI Practitioners and AI Compliance Experts
Bogucka, Edyta, Constantinides, Marios, Šćepanović, Sanja, Quercia, Daniele
In the evolving landscape of AI regulation, it is crucial for companies to conduct impact assessments and document their compliance through comprehensive reports. However, current reports lack grounding in regulations and often focus on specific aspects like privacy in relation to AI systems, without addressing the real-world uses of these systems. Moreover, there is no systematic effort to design and evaluate these reports with both AI practitioners and AI compliance experts. To address this gap, we conducted an iterative co-design process with 14 AI practitioners and 6 AI compliance experts and proposed a template for impact assessment reports grounded in the EU AI Act, NIST's AI Risk Management Framework, and ISO 42001 AI Management System. We evaluated the template by producing an impact assessment report for an AI-based meeting companion at a major tech company. A user study with 8 AI practitioners from the same company and 5 AI compliance experts from industry and academia revealed that our template effectively provides necessary information for impact assessments and documents the broad impacts of AI systems. Participants envisioned using the template not only at the pre-deployment stage for compliance but also as a tool to guide the design stage of AI uses.
Belgian researchers found a huge privacy hole in six dating apps
TechCrunch reported that a group of researchers from the university KU Leuven in Belgium identified six popular dating apps that malicious users can use to pinpoint the near-exact location of other users. Dating apps including Hinge, Happn, Bumble, Grindr, Badoo and Hily all exhibited some form of "trilateration" that could expose users' approximate locations, which prompted some of the apps to take action and tighten their security, according to the published paper. The term "trilateration" refers to a three-point measurement used in GPS to determine the relative distance to a target. The six named apps fell into one of three categories of trilateration" including "exact distance trilateration" in which a target is accurate to "at least a 111m by 111m square (at the equator)," "round distance trilateration" or "oracle trilateration" in which distance filters are used to approximate a rounded area much like a Venn diagram. Grindr is "susceptible to exact distance trilateration" while Happn falls under "rounded distance trilateration."
Canada qualify despite six-point deduction
Canada qualified for the quarter-finals of the Olympics women's football tournament - hours after losing their appeal against a six-point deduction after a drone was used to spy on a rival team's training session. The Canadians were docked six points while coach Bev Priestman and officials Joseph Lombardi and Jasmine Mander were banned from any football-related activity for one year after New Zealand lodged a complaint about drones flying over their training sessions. While Canada accepted the bans for their backroom staff, they argued the points deduction was too severe. But the Court of Arbitration for Sport dismissed the appeal on Wednesday. However, Canada - who won Olympic gold in Tokyo three years ago - won all three matches to advance as Group A runners-up, behind leaders France.
Enabling Quick, Accurate Crowdsourced Annotation for Elevation-Aware Flood Extent Mapping
Dyken, Landon, Adhikari, Saugat, Poudel, Pravin, Petruzza, Steve, Yan, Da, Usher, Will, Kumar, Sidharth
In order to assess damage and properly allocate relief efforts, mapping the extent of flood events is a necessary and important aspect of disaster management. In recent years, deep learning methods have evolved as an effective tool to quickly label high-resolution imagery and provide necessary flood extent mappings. These methods, though, require large amounts of annotated training data to create models that are accurate and robust to new flooded imagery. In this work, we provide FloodTrace, an application that enables effective crowdsourcing for flooded region annotation for machine learning training data, removing the requirement for annotation to be done solely by researchers. We accomplish this through two orthogonal methods within our application, informed by requirements from domain experts. First, we utilize elevation-guided annotation tools and 3D rendering to inform user annotation decisions with digital elevation model data, improving annotation accuracy. For this purpose, we provide a unique annotation method that uses topological data analysis to outperform the state-of-the-art elevation-guided annotation tool in efficiency. Second, we provide a framework for researchers to review aggregated crowdsourced annotations and correct inaccuracies using methods inspired by uncertainty visualization. We conducted a user study to confirm the application effectiveness in which 266 graduate students annotated high-resolution aerial imagery from Hurricane Matthew in North Carolina. Experimental results show the accuracy and efficiency benefits of our application apply even for untrained users. In addition, using our aggregation and correction framework, flood detection models trained on crowdsourced annotations were able to achieve performance equal to models trained on expert-labeled annotations, while requiring a fraction of the time on the part of the researcher.
A Culturally-Aware Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work Styles
Toxtli, Carlos, Curtis, Christopher, Savage, Saiph
This issue usually stems from the assumption that crowdworkers are a homogeneous group [56], neglecting their diverse cultural backgrounds [90]. Moreover, a notable trend in design has emerged advocating for minimizing cultural impact in work interfaces, aiming for global uniformity in their design rather than customizing these systems to accommodate cultural nuances [133, 134, 193]. Consequently, many work interfaces have strived for uniform standards, and have ignored worker diversity [76, 84, 88]. However, interfaces often reflect the cultural biases of their designers [18], inadvertently embedding their cultural norms [146, 150, 177]. This can lead to designs that unintentionally require "outside workers" to adapt or modify their behaviors [126, 177], potentially hindering their success and effectiveness in their jobs [24, 60, 64, 85]. A solution can be to create culturally aware tools for crowdworkers, yet research into integrating culture theory into such designs remains limited [108, 118, 163]. Further research is crucial to assess these systems' effectiveness and their potential benefits for crowdworkers from varied cultural backgrounds. To address this knowledge gap, we focus on designing a tool that aims to enhance crowdworkers' experiences by incorporating cultural considerations.
UnPaSt: unsupervised patient stratification by differentially expressed biclusters in omics data
Hartung, Michael, Maier, Andreas, Delgado-Chaves, Fernando, Burankova, Yuliya, Isaeva, Olga I., Patroni, Fábio Malta de Sá, He, Daniel, Shannon, Casey, Kaufmann, Katharina, Lohmann, Jens, Savchik, Alexey, Hartebrodt, Anne, Chervontseva, Zoe, Firoozbakht, Farzaneh, Probul, Niklas, Zotova, Evgenia, Tsoy, Olga, Blumenthal, David B., Ester, Martin, Laske, Tanja, Baumbach, Jan, Zolotareva, Olga
Most complex diseases, including cancer and non-malignant diseases like asthma, have distinct molecular subtypes that require distinct clinical approaches. However, existing computational patient stratification methods have been benchmarked almost exclusively on cancer omics data and only perform well when mutually exclusive subtypes can be characterized by many biomarkers. Here, we contribute with a massive evaluation attempt, quantitatively exploring the power of 22 unsupervised patient stratification methods using both, simulated and real transcriptome data. From this experience, we developed UnPaSt (https://apps.cosy.bio/unpast/) optimizing unsupervised patient stratification, working even with only a limited number of subtype-predictive biomarkers. We evaluated all 23 methods on real-world breast cancer and asthma transcriptomics data. Although many methods reliably detected major breast cancer subtypes, only few identified Th2-high asthma, and UnPaSt significantly outperformed its closest competitors in both test datasets. Essentially, we showed that UnPaSt can detect many biologically insightful and reproducible patterns in omic datasets.
GOProteinGNN: Leveraging Protein Knowledge Graphs for Protein Representation Learning
Kalifa, Dan, Singer, Uriel, Radinsky, Kira
Proteins play a vital role in biological processes and are indispensable for living organisms. Accurate representation of proteins is crucial, especially in drug development. Recently, there has been a notable increase in interest in utilizing machine learning and deep learning techniques for unsupervised learning of protein representations. However, these approaches often focus solely on the amino acid sequence of proteins and lack factual knowledge about proteins and their interactions, thus limiting their performance. In this study, we present GOProteinGNN, a novel architecture that enhances protein language models by integrating protein knowledge graph information during the creation of amino acid level representations. Our approach allows for the integration of information at both the individual amino acid level and the entire protein level, enabling a comprehensive and effective learning process through graph-based learning. By doing so, we can capture complex relationships and dependencies between proteins and their functional annotations, resulting in more robust and contextually enriched protein representations. Unlike previous fusion methods, GOProteinGNN uniquely learns the entire protein knowledge graph during training, which allows it to capture broader relational nuances and dependencies beyond mere triplets as done in previous work. We perform a comprehensive evaluation on several downstream tasks demonstrating that GOProteinGNN consistently outperforms previous methods, showcasing its effectiveness and establishing it as a state-of-the-art solution for protein representation learning.
XMeCap: Meme Caption Generation with Sub-Image Adaptability
Chen, Yuyan, Yan, Songzhou, Zhu, Zhihong, Li, Zhixu, Xiao, Yanghua
Humor, deeply rooted in societal meanings and cultural details, poses a unique challenge for machines. While advances have been made in natural language processing, real-world humor often thrives in a multi-modal context, encapsulated distinctively by memes. This paper poses a particular emphasis on the impact of multi-images on meme captioning. After that, we introduce the \textsc{XMeCap} framework, a novel approach that adopts supervised fine-tuning and reinforcement learning based on an innovative reward model, which factors in both global and local similarities between visuals and text. Our results, benchmarked against contemporary models, manifest a marked improvement in caption generation for both single-image and multi-image memes, as well as different meme categories. \textsc{XMeCap} achieves an average evaluation score of 75.85 for single-image memes and 66.32 for multi-image memes, outperforming the best baseline by 3.71\% and 4.82\%, respectively. This research not only establishes a new frontier in meme-related studies but also underscores the potential of machines in understanding and generating humor in a multi-modal setting.
LAPIS: Language Model-Augmented Police Investigation System
Kim, Heedou, Kim, Dain, Lee, Jiwoo, Yoon, Chanwoong, Choi, Donghee, Gim, Mogan, Kang, Jaewoo
Crime situations are race against time. An AI-assisted criminal investigation system, providing prompt but precise legal counsel is in need for police officers. We introduce LAPIS (Language Model Augmented Police Investigation System), an automated system that assists police officers to perform rational and legal investigative actions. We constructed a finetuning dataset and retrieval knowledgebase specialized in crime investigation legal reasoning task. We extended the dataset's quality by incorporating manual curation efforts done by a group of domain experts. We then finetuned the pretrained weights of a smaller Korean language model to the newly constructed dataset and integrated it with the crime investigation knowledgebase retrieval approach. Experimental results show LAPIS' potential in providing reliable legal guidance for police officers, even better than the proprietary GPT-4 model. Qualitative analysis on the rationales generated by LAPIS demonstrate the model's reasoning ability to leverage the premises and derive legally correct conclusions.
Black box meta-learning intrinsic rewards for sparse-reward environments
Pappalardo, Octavio, Ramele, Rodrigo, Santos, Juan Miguel
Despite the successes and progress of deep reinforcement learning over the last decade, several challenges remain that hinder its broader application. Some fundamental aspects to improve include data efficiency, generalization capability, and ability to learn in sparse-reward environments, which often require human-designed dense rewards. Meta-learning has emerged as a promising approach to address these issues by optimizing components of the learning algorithm to meet desired characteristics. Additionally, a different line of work has extensively studied the use of intrinsic rewards to enhance the exploration capabilities of algorithms. This work investigates how meta-learning can improve the training signal received by RL agents. The focus is on meta-learning intrinsic rewards under a framework that doesn't rely on the use of meta-gradients. We analyze and compare this approach to the use of extrinsic rewards and a meta-learned advantage function. The developed algorithms are evaluated on distributions of continuous control tasks with both parametric and non-parametric variations, and with only sparse rewards accessible for the evaluation tasks.