South America
Cohere vs. OpenAI in the Enterprise: Which Will CIOs Choose? - The New Stack
OpenAI has just announced an enterprise version of its popular generative AI product, ChatGPT. But in this case, OpenAI is a fast follower -- not the first-to-market. Cohere, a Toronto-based company with close ties to Google, is already bringing generative AI to businesses. I spoke with Cohere's President and COO, Martin Kon, about how its machine learning models are being used within enterprise companies. Cohere is only a few years old, but it has an impressive pedigree.
Meta's newest AI fairness benchmark measures even more granular bias markers
As a white man in America with no discernible regional accent, I can simply assume that modern consumer technologies -- virtual assistants like Siri, Alexa or Assistant, and my phones' camera -- will work seamlessly out of the box. I assume this because, well, they do. That's namely because the nerds who design and program these devices overwhelmingly both look and sound just like me -- if even a little whiter. Folks with more melanin in their skin and extra twang on their tongue don't enjoy that same privilege. Tomorrow's chatbots and visual AIs will only serve to exacerbate this bias unless steps are taken today to ensure a benchmark standard of fairness and equitable behavior from these systems.
Opinion: ChatGPT's educational benefits, applications far outweigh criticisms
What if every student had a personal tutor and study tool that could provide tailored answers to their questions at any time? ChatGPT can serve that purpose. Created by Open AI, ChatGPT is an artificial intelligence chatbot that can accurately answer a broad range of questions and generate long, humanlike conversations, among other requested tasks. Critics regard ChatGPT as a threat to classroom integrity, but they fail to realize the educational potential that the free service offers. ChatGPT can be used like a search engine, but it remembers questions in previous conversation threads and can generate personal replies, unlike Google and other engines that only provide direct answers to questions.
Knowledge-augmented Risk Assessment (KaRA): a hybrid-intelligence framework for supporting knowledge-intensive risk assessment of prospect candidates
Mendes, Carlos Raoni, Brazil, Emilio Vital, Segura, Vinicius, Cerqueira, Renato
Evaluating the potential of a prospective candidate is a common task in multiple decision-making processes in different industries. We refer to a prospect as something or someone that could potentially produce positive results in a given context, e.g., an area where an oil company could find oil, a compound that, when synthesized, results in a material with required properties, and so on. In many contexts, assessing the Probability of Success (PoS) of prospects heavily depends on experts' knowledge, often leading to biased and inconsistent assessments. We have developed the framework named KARA (Knowledge-augmented Risk Assessment) to address these issues. It combines multiple AI techniques that consider SMEs (Subject Matter Experts) feedback on top of a structured domain knowledge-base to support risk assessment processes of prospect candidates in knowledge-intensive contexts.
Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedback
Kirk, Hannah Rose, Vidgen, Bertie, Röttger, Paul, Hale, Scott A.
Large language models (LLMs) are used to generate content for a wide range of tasks, and are set to reach a growing audience in coming years due to integration in product interfaces like ChatGPT or search engines like Bing. This intensifies the need to ensure that models are aligned with human preferences and do not produce unsafe, inaccurate or toxic outputs. While alignment techniques like reinforcement learning with human feedback (RLHF) and red-teaming can mitigate some safety concerns and improve model capabilities, it is unlikely that an aggregate fine-tuning process can adequately represent the full range of users' preferences and values. Different people may legitimately disagree on their preferences for language and conversational norms, as well as on values or ideologies which guide their communication. Personalising LLMs through micro-level preference learning processes may result in models that are better aligned with each user. However, there are several normative challenges in defining the bounds of a societally-acceptable and safe degree of personalisation. In this paper, we ask how, and in what ways, LLMs should be personalised. First, we review literature on current paradigms for aligning LLMs with human feedback, and identify issues including (i) a lack of clarity regarding what alignment means; (ii) a tendency of technology providers to prescribe definitions of inherently subjective preferences and values; and (iii) a 'tyranny of the crowdworker', exacerbated by a lack of documentation in who we are really aligning to. Second, we present a taxonomy of benefits and risks associated with personalised LLMs, for individuals and society at large. Finally, we propose a three-tiered policy framework that allows users to experience the benefits of personalised alignment, while restraining unsafe and undesirable LLM-behaviours within (supra-)national and organisational bounds.
Position Paper on Dataset Engineering to Accelerate Science
Brazil, Emilio Vital, Soares, Eduardo, Real, Lucas Villa, Azevedo, Leonardo, Segura, Vinicius, Zerkowski, Luiz, Cerqueira, Renato
Data is a critical element in any discovery process. In the last decades, we observed exponential growth in the volume of available data and the technology to manipulate it. However, data is only practical when one can structure it for a well-defined task. For instance, we need a corpus of text broken into sentences to train a natural language machine-learning model. In this work, we will use the token \textit{dataset} to designate a structured set of data built to perform a well-defined task. Moreover, the dataset will be used in most cases as a blueprint of an entity that at any moment can be stored as a table. Specifically, in science, each area has unique forms to organize, gather and handle its datasets. We believe that datasets must be a first-class entity in any knowledge-intensive process, and all workflows should have exceptional attention to datasets' lifecycle, from their gathering to uses and evolution. We advocate that science and engineering discovery processes are extreme instances of the need for such organization on datasets, claiming for new approaches and tooling. Furthermore, these requirements are more evident when the discovery workflow uses artificial intelligence methods to empower the subject-matter expert. In this work, we discuss an approach to bringing datasets as a critical entity in the discovery process in science. We illustrate some concepts using material discovery as a use case. We chose this domain because it leverages many significant problems that can be generalized to other science fields.
The Power of Regularization in Solving Extensive-Form Games
Liu, Mingyang, Ozdaglar, Asuman, Yu, Tiancheng, Zhang, Kaiqing
In this paper, we investigate the power of {\it regularization}, a common technique in reinforcement learning and optimization, in solving extensive-form games (EFGs). We propose a series of new algorithms based on regularizing the payoff functions of the game, and establish a set of convergence results that strictly improve over the existing ones, with either weaker assumptions or stronger convergence guarantees. In particular, we first show that dilated optimistic mirror descent (DOMD), an efficient variant of OMD for solving EFGs, with adaptive regularization can achieve a fast $\tilde O(1/T)$ last-iterate convergence in terms of duality gap and distance to the set of Nash equilibrium (NE) without uniqueness assumption of the NE. Second, we show that regularized counterfactual regret minimization (\texttt{Reg-CFR}), with a variant of optimistic mirror descent algorithm as regret-minimizer, can achieve $O(1/T^{1/4})$ best-iterate, and $O(1/T^{3/4})$ average-iterate convergence rate for finding NE in EFGs. Finally, we show that \texttt{Reg-CFR} can achieve asymptotic last-iterate convergence, and optimal $O(1/T)$ average-iterate convergence rate, for finding the NE of perturbed EFGs, which is useful for finding approximate extensive-form perfect equilibria (EFPE). To the best of our knowledge, they constitute the first last-iterate convergence results for CFR-type algorithms, while matching the state-of-the-art average-iterate convergence rate in finding NE for non-perturbed EFGs. We also provide numerical results to corroborate the advantages of our algorithms.
A Variable Autonomy approach for an Automated Weeding Platform
Moraru, Ionut, Zhivkov, Tsvetan, Coutts, Shaun, Li, Dom, Sklar, Elizabeth I.
Climate change, increase in world population and the war in Ukraine have led nations such as the UK to put a larger focus on food security, while simultaneously trying to halt declines in biodiversity and reduce risks to human health posed by chemically-reliant farming practices. Achieving these goals simultaneously will require novel approaches and accelerating the deployment of Agri-Robotics from the lab and into the field. In this paper we describe the ARWAC robot platform for mechanical weeding. We explain why the mechanical weeding approach is beneficial compared to the use of pesticides for removing weeds from crop fields. Thereafter, we present the system design and processing pipeline for generating a course of action for the robot to follow, such that it removes as many weeds as possible. Finally, we end by proposing a trust-based ladder of autonomy that will be used, based on the users' confidence in the robot system.
Logic Against Bias: Textual Entailment Mitigates Stereotypical Sentence Reasoning
Due to their similarity-based learning objectives, pretrained sentence encoders often internalize stereotypical assumptions that reflect the social biases that exist within their training corpora. In this paper, we describe several kinds of stereotypes concerning different communities that are present in popular sentence representation models, including pretrained next sentence prediction and contrastive sentence representation models. We compare such models to textual entailment models that learn language logic for a variety of downstream language understanding tasks. By comparing strong pretrained models based on text similarity with textual entailment learning, we conclude that the explicit logic learning with textual entailment can significantly reduce bias and improve the recognition of social communities, without an explicit de-biasing process