Goto

Collaborating Authors

 big


CANITA: Faster Rates for Distributed Convex Optimization with Communication Compression

Neural Information Processing Systems

Due to the high communication cost in distributed and federated learning, methods relying on compressed communication are becoming increasingly popular. Besides, the best theoretically and practically performing gradient-type methods invariably rely on some form of acceleration/momentum to reduce the number of communications (faster convergence), e.g., Nesterov's accelerated gradient descent [31, 32] and Adam [14]. In order to combine the benefits of communication compression and convergence acceleration, we propose a \emph{compressed and accelerated} gradient method based on ANITA [20] for distributed optimization, which we call CANITA.


Think Big, Teach Small: Do Language Models Distil Occam's Razor?

Neural Information Processing Systems

Large language models have recently shown a remarkable ability for few-shot learning, including patterns of algorithmic nature. However, it is still an open question to determine what kind of patterns these models can capture and how many examples they need in their prompts. We frame this question as a teaching problem with strong priors, and study whether language models can identify simple algorithmic concepts from small witness sets. In particular, we explore how several GPT architectures, program induction systems and humans perform in terms of the complexity of the concept and the number of additional examples, and how much their behaviour differs. This first joint analysis of language models and machine teaching can address key questions for artificial intelligence and machine learning, such as whether some strong priors, and Occam's razor in particular, can be distilled from data, making learning from a few examples possible.


Artificial Intelligence Will be Big in Supply Chain Management, Report Predicts

#artificialintelligence

Artificial intelligence will be worth about $17.5 billion in the global supply chain management (SCM) software market by 2028, according to a new market report, "Global Artificial Intelligence in Supply Chain Management Market by Technology, Processes, Solutions, Management Function (Automation, Planning & Logistics, Inventory, Risk), Deployment Model, Business Type, and Industry Verticals 2023-2028." The authors said that market analysis shows AI-enabled supply chains are 67% more effective than their non-AI counterparts, thanks to reduced risks and lower overall costs. The study, released by ResearchAndMarkets.com April 10, noted that the Asia-Pacific (APAC) region is expected to be the largest and fastest-growing supplier of artificial intelligence for the global SCM market. The report also examined several forms of AI, including cloud-based AI-as-a-service solutions, which it predicted will be worth more than $3.7 billion by 2028, reaching more than 21% of the total market in the next five years.


AI Chatbots Got Big--and Their Ethical Red Flags Got Bigger

WIRED

In the weeks following the release of OpenAI's viral chatbot ChatGPT late last year, Google AI chief Jeff Dean expressed concern that deploying a conversational search engine too quickly might pose a reputational risk for Alphabet. But last week Google announced its own chatbot, Bard, which in its first demo made a factual error about the James Webb Space Telescope. Also last week, Microsoft integrated ChatGPT-based technology into Bing search results. Sarah Bird, Microsoft's head of responsible AI, acknowledged that the bot could still "hallucinate" untrue information but said the technology had been made more reliable. In the days that followed, Bing claimed that running was invented in the 1700s and tried to convince one user that the year is 2022.


Artificial Intelligence- the Next 'Big' Thing in Technology Analytics Insight

#artificialintelligence

Artificial Intelligence (AI) may seem like a sci-fi but AI machines can do some pretty amazing and impossible stuff which humans will never be able to. Today, Artificial Intelligence is changing every aspect of technology. Nowadays, technology is not just about creating tools for practical purposes, it is much more advanced. AI is the latest example of it. From self-driving cars to playing chess, AI has outperformed humans in each and every task with its high tech new, time-tested tools.


Artificial Intelligence Startups Nudge Giants to 'Think Big'

#artificialintelligence

Ronnie Vuine runs a Berlin-based startup that harnesses artificial intelligence for industrial uses – but that doesn't mean he's all business, all the time. His company Micropsi Industries also programmed an A.I. game piece known as D1 "for fun, and because we want to show what's possible," he told Handelsblatt. D1's A.I. "brain" looks a bit like a fire hydrant spraying out countless tiny streams of water. The figure uses trial and error to track down food, Mr. Vuine explained, and each stream represents a different experience.