Given a natural language, a general robot has to comprehend the instruction and find the target object or location based on visual observations even in unexplored environments. Most agents rely on massive diverse training data to achieve better generalization, which requires expensive labor. These agents often focus on common objects and fewer tasks, thus are not intelligent enough to handle different types of instructions. To facilitate research in open-set vision-and-language navigation, we propose a benchmark named MO-VLN, aiming at testing the effectiveness and generalization of the agent in the multi-task setting. First, we develop a 3D simulator rendered by realistic scenarios using Unreal Engine 5, containing more realistic lights and details. The simulator contains three scenes, i.e., cafe, restaurant, and nursing house, of high value in the industry. Besides, our simulator involves multiple uncommon objects, such as takeaway cup and medical adhesive tape, which are more complicated compared with existing environments. Inspired by the recent success of large language models (e.g., ChatGPT, Vicuna), we construct diverse high-quality data of instruction type without human annotation. Our benchmark MO-VLN provides four tasks: 1) goal-conditioned navigation given a specific object category (e.g., "fork"); 2) goal-conditioned navigation given simple instructions (e.g., "Search for and move towards a tennis ball"); 3) step-by-step instruction following; 4) finding abstract object based on high-level instruction (e.g., "I am thirsty").

As part of the deal, Amazon, the world's largest provider of cloud infrastructure services through its AWS unit, will become the primary provider of computational processing power, also called compute, for Anthropic. The process of training and running state-of-the-art AI models requires vast amounts of compute, and many analysts expect future AI models to require increasing amounts of compute. In return, Amazon will acquire a minority ownership position in Anthropic, and Amazon's engineers will be able to incorporate Anthropic's AI models into their products and services such as Amazon's personal assistant, Alexa. Anthropic has also committed to offering its models via Bedrock, Amazon's online platform on which it hosts foundation models--broadly capable AI models that can be adapted for different tasks. Anthropic was founded in 2021, after a group of OpenAI employees left over differences in their approach to AI safety.

Up to now, people could ask ChatGPT questions by speaking them out loud on its mobile app, but the bot would respond with text. OpenAI also said people can now upload images as part of their questions to the bot, such as showing a photo of the ingredients in a fridge and asking ChatGPT to come up with recipe suggestions. Adding voice and image capabilities also puts ChatGPT further along the line toward becoming a true "multimodal" model -- a chatbot that can "see" and "hear" the world, and respond with voice and images, in addition to being fed text-only prompts. AI researchers and analysts say multimodal models are the next stage of competition in the industry, and companies are racing to create the most capable one.

Anthropic's chief executive Dario Amodei met with UK Prime Minister Rishi Sunak and the heads of DeepMind and OpenAI in May to discuss the potential risks from AI - from disinformation to national security and even "existential threats" - and the voluntary actions and regulation required to manage them.

ChatGPT is getting some significant updates that will enable the chatbot to deal with voice commands and image-based queries. Users will be able to have a voice conversation with ChatGPT on Android and iOS and to feed images into it on all platforms. OpenAI is rolling out the features now. They'll be available to Plus and Enterprise users at first, with other folks gaining access to the image-based features later. You'll need to opt in to voice conversations in the ChatGPT app (go to Settings then New Features) if you'd like to try them out.

Amazon is to invest up to $4bn (£3.2bn) in the startup Anthropic, which has created a rival to ChatGPT called Claude, as the Silicon Valley giant seeks to keep pace with rivals including Microsoft and Google in the race to dominate the artificial intelligence space. Under the terms of the deal, Amazon will invest an initial $1.25bn into Anthropic, which was founded about two years ago by former research executives from the ChatGPT developer OpenAI, and take a minority stake in the business. Amazon said its investment in Anthropic, which recently announced its new AI chatbot Claude 2, can be increased to up to $4bn. "We have tremendous respect for Anthropic's team and foundation models, and believe we can help improve many customer experiences, short- and long-term, through our deeper collaboration," said the Amazon chief executive, Andy Jassy. Amazon's move to strike a strategic partnership with a successful AI startup follows Microsoft's multibillion-dollar deal with OpenAI in January, which included becoming its exclusive cloud provider.

The news: OpenAI has launched two new ways to interact with its flagship large language model in a major update. You can have a spoken conversation with the chatbot as if you were making a call, and it's also able to answer questions about images. How it works: The ability to talk to ChatGPT draws on two separate models. Whisper, OpenAI's existing speech-to-text model, converts what you say into text, which is then fed to the chatbot. And a new text-to-speech model converts ChatGPT's responses into spoken words.

In a demo the company gave me last week, Joanne Jang, a product manager, showed off ChatGPT's range of synthetic voices. These were created by training the text-to-speech model on the voices of actors that OpenAI had hired. In the future it might even allow users to create their own voices. "In fashioning the voices, the number-one criterion was whether this is a voice you could listen to all day," she says. They are chatty and enthusiastic but won't be to everyone's taste.

This copy is for your personal, non-commercial use only. For non-personal use or to order multiple copies, please contact Dow Jones Reprints at 1-800-843-0008 or visit www.djreprints.com.

OpenAI, the artificial intelligence company that unleashed ChatGPT on the world last November, is making the chatbot app a lot more chatty. An upgrade to the ChatGPT mobile apps for iOS and Android announced today lets a person speak their queries to the chatbot and hear it respond with its own synthesized voice. The new version of ChatGPT also adds visual smarts: Upload or snap a photo from ChatGPT and the app will respond with a description of the image and offer more context, similar to Google's Lens feature. ChatGPT's new capabilities show that OpenAI is treating its artificial intelligence models, which have been in the works for years now, as products with regular, iterative updates. The company's surprise hit, ChatGPT, is looking more like a consumer app that competes with Apple's Siri or Amazon's Alexa.