Goto

Collaborating Authors

 small step


Interview with Minji Park: humans in the loop to keep language models up to date

AIHub

Minji Park is a PhD candidate at the Korea Institute of Energy Technology (KENTECH). In her paper, with co-authors Seunghyun Yoon and Hyuk Lim, she introduces a framework which aims to help make large language models stay more up-to-date when pieces of information change. We hear from Minji about inspired her work, how the framework operates, and her plans to further develop this research. What is the topic of the research in your paper and why is it an interesting area for study? The paper is fun, because we are challenging the norm.




Small steps no more: Global convergence of stochastic gradient bandits for arbitrary learning rates

Neural Information Processing Systems

We provide a new understanding of the stochastic gradient bandit algorithm by showing that it converges to a globally optimal policy almost surely using \emph{any} constant learning rate. This result demonstrates that the stochastic gradient algorithm continues to balance exploration and exploitation appropriately even in scenarios where standard smoothness and noise control assumptions break down. The proofs are based on novel findings about action sampling rates and the relationship between cumulative progress and noise, and extend the current understanding of how simple stochastic gradient methods behave in bandit settings.


One Small Step for Generative AI, One Giant Leap for AGI: A Complete Survey on ChatGPT in AIGC Era

arXiv.org Artificial Intelligence

OpenAI has recently released GPT-4 (a.k.a. ChatGPT plus), which is demonstrated to be one small step for generative AI (GAI), but one giant leap for artificial general intelligence (AGI). Since its official release in November 2022, ChatGPT has quickly attracted numerous users with extensive media coverage. Such unprecedented attention has also motivated numerous researchers to investigate ChatGPT from various aspects. According to Google scholar, there are more than 500 articles with ChatGPT in their titles or mentioning it in their abstracts. Considering this, a review is urgently needed, and our work fills this gap. Overall, this work is the first to survey ChatGPT with a comprehensive review of its underlying technology, applications, and challenges. Moreover, we present an outlook on how ChatGPT might evolve to realize general-purpose AIGC (a.k.a. AI-generated content), which will be a significant milestone for the development of AGI.


Elon Musk says Tesla's Optimus humanoid robot will eventually cost 'less than a car'

Daily Mail - Science & tech

Elon Musk shared new details about Tesla's Optimus humanoid robot - including information about the cost and likely uses for it - in an essay published online. The robot, which is intended for industrial and domestic uses, will debut at AI Day September 30 after first being announced at AI Day in August 2021. 'Tesla Bots are initially positioned to replace people in repetitive, boring, and dangerous tasks. But the vision is for them to serve millions of households, such as cooking, mowing lawns, and caring for the elderly,' Musk wrote in the essay published in China Cyberspace magazine. 'Tesla Bots are initially positioned to replace people in repetitive, boring, and dangerous tasks,' Elon Musk explained in a recent essay'The vision is for them to serve millions of households, such as cooking, mowing lawns, and caring for the elderly,' the mogul added'The Tesla Bot is close to the height and weight of an adult, can carry or pick up heavy objects, walk fast in small steps, and the screen on its face is an interactive interface for communication with people,' Musk, seen above, explained in the essay The mogul explained that the android, which will have human-like limbs and features, was deliberately designed that way.


'The End of Astronauts' Review: One Small Step for Robots

#artificialintelligence

Whether actual or fictional--Buzz Aldrin or Buzz Lightyear--astronauts embody what most of us see as the best and bravest aspects of humankind. So you have to admire the mettle of authors Donald Goldsmith and Martin Rees who argue that, in almost all cases, space exploration is too important to leave to fallible, vulnerable human beings. Robots, they write, "can go boldly where humans rightly fear to tread." The authors certainly know their topic. Mr. Rees is the U.K.'s Astronomer Royal (talk about a title!) and a former Cambridge University professor.


A Small Step with RPA, a Giant Leap with Hyperautomation

#artificialintelligence

The automation of business processes was already in a state of increasing adoption long before the pandemic began. However, the rapid shift to remote work coupled with COVID-19's economic impact has kicked automation into high gear. Organizations are seeking to improve efficiency and reduce cost by reducing employees' time spent on manual tasks. Robotic Process Automation (RPA) platforms have traditionally driven this transformation, but with the increased demand for a variety of use cases, many organizations are finding RPA tools inadequate. And they're wanting to add more intelligence to automation.


Text-to-Speech: One Small Step by Mankind to Create Lifelike Robots

#artificialintelligence

Note: For those of you who prefer watching videos, please feel free to play the above video on the same content. While speech synthesis has come a long way since Kratzenstein's vowel organ that could produce the five vowel sounds, it is a whole'nother level of challenge to transform text to natural-sounding speech. Recent developments in deep learning have provided us a new approach to the challenge and in this article, we shall briefly introduce a mainstream text-to-speech method before the deep learning era, then explore models like WaveNet that Google's text-to-speech API service is now using for lifelike speech synthesis. If you pause and think for a moment about how you can perform text-to-speech, you would probably formulate a method that is very similar to the concatenative approach. In concatenative text-to-speech, texts are broken down into smaller units such as phonemes, and the corresponding recordings of the units are then combined to form a complete speech.


Automation in small steps

#artificialintelligence

All organizations communicate their vision and roadmap of big events each year; some achieve them successfully. If you or your company is working on such large programs and would like to use automation to improve your process and create larger programs, please read on. Any large organization faces the same challenges throughout trying to make a big initiative more or less. The following are the two main challenges affecting such rollouts. These challenges are not new, but small and large enterprises have been impacted by it.