Goto

Collaborating Authors

 tip




Mobile-Agent-E: Self-Evolving Mobile Assistant for Complex Tasks

Wang, Zhenhailong, Xu, Haiyang, Wang, Junyang, Zhang, Xi, Yan, Ming, Zhang, Ji, Huang, Fei, Ji, Heng

arXiv.org Artificial Intelligence

Smartphones have become indispensable in modern life, yet navigating complex tasks on mobile devices often remains frustrating. Recent advancements in large multimodal model (LMM)-based mobile agents have demonstrated the ability to perceive and act in mobile environments. However, current approaches face significant limitations: they fall short in addressing real-world human needs, struggle with reasoning-intensive and long-horizon tasks, and lack mechanisms to learn and improve from prior experiences. To overcome these challenges, we introduce Mobile-Agent-E, a hierarchical multi-agent framework capable of self-evolution through past experience. By hierarchical, we mean an explicit separation of high-level planning and low-level action execution. The framework comprises a Manager, responsible for devising overall plans by breaking down complex tasks into subgoals, and four subordinate agents--Perceptor, Operator, Action Reflector, and Notetaker--which handle fine-grained visual perception, immediate action execution, error verification, and information aggregation, respectively. Mobile-Agent-E also features a novel self-evolution module which maintains a persistent long-term memory comprising Tips and Shortcuts. Tips are general guidance and lessons learned from prior tasks on how to effectively interact with the environment. Shortcuts are reusable, executable sequences of atomic operations tailored for specific subroutines. The inclusion of Tips and Shortcuts facilitates continuous refinement in performance and efficiency. Alongside this framework, we introduce Mobile-Eval-E, a new benchmark featuring complex mobile tasks requiring long-horizon, multi-app interactions. Empirical results show that Mobile-Agent-E achieves a 22% absolute improvement over previous state-of-the-art approaches across three foundation model backbones. Project page: https://x-plug.github.io/MobileAgent.


Talking to animals? See what AI is making possible

FOX News

PsychoGenics CEO Emer Leahy of Paramus, New Jersey, explains how the first potential AI-discovered treatment for schizophrenia was developed through machine learning. Fox News Digital spoke with her. Imagine a world where "interspecies communication" isn't the stuff of sci-fi fantasies - instead, a reality where humans can chit-chat with their furry, feathery, and scaly friends. This is where AI swoops in like a superhero, with researchers using algorithms to decipher animal vocalizations, movements, and even facial expressions. The Earth Species Project, a non-profit organization dedicated to decoding animal communication, is at the forefront of this groundbreaking research.


Top 10 Tips to be a More Successful Data Scientist in 2023

#artificialintelligence

In this tech-driven world, the demand for data scientists is constantly increasing and the discipline presents an enticing career path for students and existing professionals in the field of data science. There are many people who are not data scientists but are obsessed with data and data science, which has left them asking for tips to be a successful data scientist, to pursue a career in data science. Leveraging the use of Big Data as an insight-generating engine has skyrocketed the demand for a skilled data scientist globally at the enterprise level. In this competitive world a data scientist, who specializes in analyzing and interpreting data is not sufficient. We need to practice many tricks and tips to be a more successful data scientist.


7 Tips for Value-Driven AI

#artificialintelligence

How your business can improve the skills of its talent to take greater advantage of AI. There's no doubt that artificial intelligence (AI) is changing the way business is done today. AI will ultimately transform every business in every industry. However, despite their desire to use data science when making decisions, many organizations can't find enough qualified data scientists to develop and run their data science initiatives. Nonetheless, with online training and readily available tools, any software engineer -- or even a business user with a math background -- can become a data scientist.


Custom Event Optimization: 3 Tips for Success

#artificialintelligence

Advertisers from all kinds of companies, as well as app developers, are adopting the use of predictive events to create custom Facebook optimizations based on what will happen in the future. With predictive events, advertisers can optimize campaigns around the predicted 30-day value of a customer, using information on what happens on day 1 or day 2 of an ad campaign. For mobile apps and companies reliant on their apps' data, the number of events passed back to advertisers was limited by the introduction of SKAdNetwork in iOS 14. Without a doubt, that limitation has made optimizing campaigns with custom events through predictive analyticsPredictive analytics uses data, statistics, and machine learning techniques to build mathematical models that can generate predictions about things likely to happen in the future…. Thanks to AIArtificial intelligence (AI) refers to the development of computerized systems that can carry out tasks and perform actions that augment or take the place of… and machine learning, platforms like Pecan AI provide a new wave of tools for advertisers, app developers, and mobile gaming companies.


7 Tips for Python Beginners - KDnuggets

#artificialintelligence

Learning a new language can be confusing and challenging. You are bombarded with YouTube videos claiming to teach you Python in 10 minutes. In the end, you get more confused and give up. Find out ways that work for you." Even if you understand the basics, you will get more confused in selecting and learning new tools. Furthermore, without structured learning, you will fail to pass any coding interview or test. Just like any skill, you need persistence and practice. In this blog, I have converted my Python learning experience into 7 easy to follow tips. Let's start the journey of becoming an expert Python programmer. Learning everything about Python is not necessary, but you need to build a base. For that, you need to understand the basics. There are plenty more things to learn, but for the starter stick to basics and practice. It is ok to make mistakes, forget the syntax, and get stuck in simple things. Do not force yourself to memorize. The most important thing is that you learn ...


8 Tips To Get People To Trust Your Machine Learning Models

#artificialintelligence

This is one of those things you only find out after getting a job as a data scientist. Imagine that someone simply showed up with an app to you and said that if you follow what this app recommends, you will reach your goals in life. Take the job the app ranks highest. Date the person the app shows it's the best match. Just take the medicine the app recommends.


Tips to plan storage elements of artificial intelligence – TechTarget

#artificialintelligence

In his recent book, The Artificial Intelligence Infrastructure Workshop, Arankalle and his co-authors discuss the complexities of AI and how …