Goto

Collaborating Authors

 Large Language Model


Automatic Generation of Factual News Headlines in Finnish

arXiv.org Artificial Intelligence

We present a novel approach to generating news headlines in Finnish for a given news story. We model this as a summarization task where a model is given a news article, and its task is to produce a concise headline describing the main topic of the article. Because there are no openly available GPT-2 models for Finnish, we will first build such a model using several corpora. The model is then fine-tuned for the headline generation task using a massive news corpus. The system is evaluated by 3 expert journalists working in a Finnish media house. The results showcase the usability of the presented approach as a headline suggestion tool to facilitate the news production process.


ChatGPT: The New Frontier of Artificial Intelligence

#artificialintelligence

InkWater Atlas is about sharing your ideas and passion in a positive way impacting the whole world. You can write about any topic as long as you think it will be beneficial to everyone around the world.


AI bot ChatGPT stuns academics with essay-writing skills and usability

The Guardian

Professors, programmers and journalists could all be out of a job in just a few years, after the latest chatbot from the Elon Musk-founded OpenAI foundation stunned onlookers with its writing ability, proficiency at complex tasks, and ease of use. The system, called ChatGPT, is the latest evolution of the GPT family of text-generating AIs. Two years ago, the team's previous AI, GPT3, was able to generate an opinion piece for the Guardian, and ChatGPT has significant further capabilities. In the days since it was released, academics have generated responses to exam queries that they say would result in full marks if submitted by an undergraduate, and programmers have used the tool to solve coding challenges in obscure programming languages in a matter of seconds – before writing limericks explaining the functionality. Dan Gillmor, a journalism professor at Arizona State University, asked the AI to handle one of the assignments he gives his students: writing a letter to a relative giving advice regarding online security and privacy.


ChatGPT - Optimizing language models for dialogue

#artificialintelligence

OpenAI has released a model called ChatGPT which interacts in a conversational way. The dialogue format makes it possible for ChatGPT to answer followup questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests.


We Need Efficient and Transparent Language Models

#artificialintelligence

Efficient Methods for Natural Language Processing: Roy Schwartz is Professor of NLP at The Hebrew University of Jerusalem. We discuss an important survey paper (co-written by Roy) that presents a broad overview of existing methods to improve NLP efficiency through the lens of NLP pipelines. Building a premier industrial AI research and product group .. in three years: Hung Bui is the CEO of Vietnam-based, VinAI, explains the process of building a team that within a span of three years found itself listed among the Top 20 Global Companies in AI Research. Stanford researchers recently introduced tools to help users and developers understand large language models (LLM) in their totality. Given the central role of LLMs in NLP and in GenerativeAI, this suite of tools is an important step towards better transparency for language models.


The Dawn of Mediocre Computing - by Venkatesh Rao

#artificialintelligence

Well, we all knew it was coming. Computers already easily overwhelm the best humans at chess and Go. Now they have done something far harder: achieved parity with David Brooks at writing. OpenAI's ChatGPT, released as a research beta two days ago, has done to the standard high-school essay what cameras did to photorealistic painting and pocket calculators did to basic arithmetic. It is open sign-up and free for now, but I suspect not for much longer, so go try it; and make sure to trawl social media for interesting and revealing examples being posted by people. As an open-world, real-ish (I'll define real-ish in a minute) domain, the correct standard for judging an AI on writing is not beating the "best" humans1 in a stylized closed-world competition (the existence of such competitions is a mark of a certain kind of simplicity), but achieving indistinguishability from mediocre humans. And when it comes to writing, nobody does mediocre more mediocrely than David Brooks.


What is ChatGPT, the AI Chatbot That's Taking The Internet By Storm - Slashdot

#artificialintelligence

A reader submits a report: Artificial Intelligence (AI) research company OpenAI on Wednesday announced ChatGPT, a prototype dialogue-based AI chatbot capable of understanding natural language and responding in natural language. It has since taken the internet by storm, with people marvelling at how intelligent the AI-powered bot sounds. Some even called it a replacement for Google, since it's capable of giving solutions to complex problems directly," almost like a personal know-all teacher. "We've trained a model called ChatGPT which interacts in a conversational way. The dialogue format makes it possible for ChatGPT to answer follow-up questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests," OpenAI wrote on its announcement page for ChatGPT. ChatGPT is based on GPT-3.5, a language model that uses deep learning to produce human-like text.


Meet GPT-JT, the Closest Open Source Alternative to GPT-3

#artificialintelligence

Recently, Together, an open source community led by researchers and technocrats, released a new version of GPT-JT trained on six billion parameters. This new model has been built using recently published open source techniques and datasets. It has been trained with its decentralised approach on the Together Research Computer, a local, in-house network developed by the team. Unlike GPT-3, which is available on-demand/request, GPT-JT is now available as open source. Click here to access the code and datasets.


Creating a Cover Letter Generator Using Python and GPT-3

#artificialintelligence

With the Great Resignation looming over 2022, more and more workers are also estimated to be on the job hunt. A record number of people have quit their jobs since the beginning of the COVID-19 pandemic, and while this trend does not seem to be slowing down any time soon, it is clear that this worker revolution also necessitates the need for appropriate tools to help these newly-displaced workers find more fulfilling jobs. That's why I set out to build a cover letter generator as a quick weekend project. One of the most tedious parts of applying for jobs is writing a cover letter. Despite how much job seekers would want to share how their skills and experience are a good fit for a role, it is often a very stressful and tiring experience to write multiple cover letters for each job and each employer that a job seeker is applying to.


Two new AI systems beat humans at complex games of Stratego and Diplomacy

#artificialintelligence

Two new papers from AI powerhouses DeepMind and Meta describe how AI systems are notching wins against human players in complex games involving deception, negotiation and cooperation. Why it matters: Machine contenders have struggled with games where information is incomplete or hidden from players -- similar to the intentions of humans in daily life and interactions. Driving the news: Researchers from DeepMind outline a new autonomous agent called "DeepNash" that learned to play the game Stratego in a paper published today in Science. How they did it: The DeepMind team combined an algorithm for learning the game through self-play and another that steers that learning toward an optimal strategy. Meta researchers last week described an AI system called "Cicero" that they report can play the game Diplomacy at the level of humans.