roo
Reveal-or-Obscure: A Differentially Private Sampling Algorithm for Discrete Distributions
Tasnim, Naima, Gilani, Atefeh, Sankar, Lalitha, Kosut, Oliver
--We introduce a differentially private (DP) algorithm called reveal-or-obscure (ROO) to generate a single representative sample from a dataset of n observations drawn i.i.d. Unlike methods that add explicit noise to the estimated empirical distribution, ROO achieves ฯต - differential privacy by randomly choosing whether to "reveal" or "obscure" the empirical distribution. While ROO is structurally identical to Algorithm 1 proposed by Cheu and Nayak [1], we prove a strictly better bound on the sampling complexity than that extablished in Theorem 12 of [1]. T o further improve the privacy-utility trade-off, we propose a novel generalized sampling algorithm called Data-Specific ROO (DS-ROO), where the probability of obscuring the empirical distribution of the dataset is chosen adaptively. We prove that DS-ROO satisfies ฯต - DP, and provide empirical evidence that DS-ROO can achieve better utility under the same privacy budget of vanilla ROO. The widespread use of sensitive data across various domains, including healthcare, finance, law enforcement, and social sciences, has heightened the importance of privacy-preserving data analysis.
Countering Reward Over-optimization in LLM with Demonstration-Guided Reinforcement Learning
Rita, Mathieu, Strub, Florian, Chaabouni, Rahma, Michel, Paul, Dupoux, Emmanuel, Pietquin, Olivier
While Reinforcement Learning (RL) has been proven essential for tuning large language models (LLMs), it can lead to reward over-optimization (ROO). Existing approaches address ROO by adding KL regularization, requiring computationally expensive hyperparameter tuning. Additionally, KL regularization focuses solely on regularizing the language policy, neglecting a potential source of regularization: the reward function itself. Inspired by demonstration-guided RL, we here introduce the Reward Calibration from Demonstration (RCfD), which leverages human demonstrations and a reward model to recalibrate the reward objective. Formally, given a prompt, the RCfD objective minimizes the distance between the demonstrations' and LLM's rewards rather than directly maximizing the reward function. This objective shift avoids incentivizing the LLM to exploit the reward model and promotes more natural and diverse language generation. We show the effectiveness of RCfD on three language tasks, which achieves comparable performance to carefully tuned baselines while mitigating ROO.
Council Post: To Give Humans The Help They Need, AI Needs Human Help
Mike de la Cruz is the CEO of Directly. He is a technology visionary in how software and AI can improve the customer experience. The growth of AI has brought the emerging technology to a wide range of professions, including those that have traditionally required "the human touch." In the past, high-touch professions have been considered "robot proof," but that is no longer the case. Recently AI technology has inspired numerous think pieces that explore whether AI can do the work of social workers, counselors, guest services specialists, doctors and even babysitters. In the majority of cases today, the AI systems that have made their way into these professions perform very simple tasks.
Finland offers crash course in artificial intelligence to EU
HELSINKI (AP) - Finland is offering a techy Christmas gift to all European Union citizens - a free-of-charge online course in artificial intelligence in their own language, officials said Tuesday. The tech-savvy Nordic nation, led by the 34-year-old Prime Minister Sanna Marin, is marking the end of its rotating presidency of the EU at the end of the year with a highly ambitious goal. Instead of handing out the usual ties and scarves to EU officials and journalists, the Finnish government has opted to give practical understanding of AI to 1% of EU citizens, or about 5 million people, through a basic online course by the end of 2021. TOP STORIES Ricky Gervais blasts Hollywood figures as unprincipled, ignorant at Golden Globes'We'll do it for half': George Lopez doubles down on Iran's bounty on Trump Black Americans are coming home to the GOP It is teaming up with the University of Helsinki, Finland's largest and oldest academic institution, and the Finland-based tech consultancy Reaktor. Teemu Roos, a University of Helsinki associate professor in the department of computer science, described the nearly $2 million project as "a civics course in AI" to help EU citizens cope with society's ever-increasing digitalization and the possibilities AI offers in the jobs market.
Finland offers crash course in artificial intelligence to European Union
Finland is offering a techy Christmas gift to European Union citizens -- a free-of-charge online course in artificial intelligence in their own language, officials said Tuesday. The tech-savvy Nordic nation, led by the 34-year-old Prime Minister Sanna Marin, is marking the end of its rotating presidency of the EU at the end of the year with a highly ambitious goal. Instead of handing out the usual ties and scarves to EU officials and journalists, the Finnish government has opted to give practical understanding of AI to 1% of EU citizens, or about 5 million people, through a basic online course by the end of 2021. It is teaming up with the University of Helsinki, Finland's largest and oldest academic institution, and the Finland-based tech consultancy Reaktor. Teemu Roos, a University of Helsinki associate professor in the department of computer science, described the nearly $2 million project as "a civics course in AI" to help EU citizens cope with society's ever-increasing digitalization and the possibilities AI offers in the jobs market.
Finland offers Artificial Intelligence course as 'Christmas gift' News
Finland is offering a hi-tech Christmas gift to all European Union citizens - a free-of-charge online course in artificial intelligence, in their own language, officials said on Tuesday. The tech-savvy Nordic nation, led by the 34-year-old Prime Minister Sanna Marin, is marking the end of its rotating presidency of the EU at the end of the year with a highly ambitious goal. Instead of handing out the usual ties and scarves to EU officials and journalists, the Finnish government has opted to give practical understanding of AI to 1 percent of all EU citizens - about five million people - through a basic online course by the end of 2021. It is teaming up with the University of Helsinki, Finland's largest and oldest academic institution, and the Finland-based tech consultancy Reaktor. Teemu Roos, a University of Helsinki associate professor in the department of computer science, described the nearly $2m project as "a civics course in AI" to help EU citizens cope with society's ever-increasing digitisation and the possibilities AI offers in the jobs market.
EU presidency extends access to free AI course across EU
EU presidency extends access to free AI course across EU Jan Petter Myklebust 13 December 2019 European Union employment ministers have endorsed a proposal from Finland's Presidency of the Council of the EU to provide European citizens with free access to a successful online course on basic artificial intelligence (AI), developed and run by the University of Helsinki in partnership with private firm Reaktor. To achieve this, the course on "Elements of AI" will be made available in all official EU languages. The Finnish government will fund the project with โฌ1.7 million (US$1.9 million) from Finland's Ministry of Economic Affairs and Employment as part of the EU Council presidency's effort to democratise awareness of AI and develop people's skills for jobs of the future. At the launch of the initiative in Brussels on 10 December, Finland's Minister of Employment Timo Harakka said: "Our investment has three goals: we want to equip EU citizens with digital skills for the future; we wish to increase practical understanding of what artificial intelligence is; and by doing so, we want to give a boost to the digital leadership of Europe." "As our presidency ends, we want to offer something concrete. It's about one of the most pressing challenges facing Europe and Finland today: how to develop our digital literacy," Harakka said.
Finland offering crash course in artificial intelligence - Independent.ie
The Nordic nation, headed by the world's youngest head of government, Sanna Marin, will mark the end of its rotating presidency of the EU with a highly ambitious goal. Finland is aiming to give practical understanding of AI to 1% of EU citizens -- or about five million people -- through a basic online course by the end of 2021. As its presidency gift to Europeans, the Finnish state provides the free online course by us and @ReaktorNow, translated to all official EU languages. It is teaming up with the University of Helsinki, Finland's largest and oldest academic institution, and the Finland-based tech consultancy Reaktor. Teemu Roos, a University of Helsinki associate professor in the department of computer science, described the near ยฃ1.5 million project as "Finland's gift to Europe" and "a civics course in AI" for every EU citizen to cope with the society's ever-increasing digitalisation and the possibilities AI offers to the job market and elsewhere.
Finland offers crash course in artificial intelligence to EU
Finland is offering a techy Christmas gift to all European Union citizens -- a free-of-charge online course in artificial intelligence in their own language, officials said Tuesday. The tech-savvy Nordic nation, led by the 34-year-old Prime Minister Sanna Marin, is marking the end of its rotating presidency of the EU at the end of the year with a highly ambitious goal. Instead of handing out the usual ties and scarves to EU officials and journalists, the Finnish government has opted to give practical understanding of AI to 1% of EU citizens, or about 5 million people, through a basic online course by the end of 2021. It is teaming up with the University of Helsinki, Finland's largest and oldest academic institution, and the Finland-based tech consultancy Reaktor. Teemu Roos, a University of Helsinki associate professor in the department of computer science, described the nearly $2 million project as "a civics course in AI" to help EU citizens cope with society's ever-increasing digitalization and the possibilities AI offers in the jobs market.
Artificial intelligence needs people: Three reasons to learn the basics now University of Helsinki
The pace of AI development has been exaggerated. The applications of artificial intelligence are not smart yet, claims Teemu Roos. He leads a University of Helsinki research group on machine learning, which focuses on big data and applications of AI in quantum physics and medicine. When a computer wins a game of chess against a human, it does not mean that artificial intelligence has surpassed human intelligence. It just means that the programme has been optimised for chess.