Goto

Collaborating Authors

 Media


A Dataset for Interactive Vision-Language Navigation with Unknown Command Feasibility

arXiv.org Artificial Intelligence

Vision-language navigation (VLN), in which an agent follows language instruction in a visual environment, has been studied under the premise that the input command is fully feasible in the environment. Yet in practice, a request may not be possible due to language ambiguity or environment changes. To study VLN with unknown command feasibility, we introduce a new dataset Mobile app Tasks with Iterative Feedback (MoTIF), where the goal is to complete a natural language command in a mobile app. Mobile apps provide a scalable domain to study real downstream uses of VLN methods. Moreover, mobile app commands provide instruction for interactive navigation, as they result in action sequences with state changes via clicking, typing, or swiping. MoTIF is the first to include feasibility annotations, containing both binary feasibility labels and fine-grained labels for why tasks are unsatisfiable. We further collect follow-up questions for ambiguous queries to enable research on task uncertainty resolution. Equipped with our dataset, we propose the new problem of feasibility prediction, in which a natural language instruction and multimodal app environment are used to predict command feasibility. MoTIF provides a more realistic app dataset as it contains many diverse environments, high-level goals, and longer action sequences than prior work. We evaluate interactive VLN methods using MoTIF, quantify the generalization ability of current approaches to new app environments, and measure the effect of task feasibility on navigation performance.



Social intelligence is not sentience

#artificialintelligence

On Saturday morning, June 11, Jeff Bezo's newspaper The Washington Post published a story under the headline "The Google engineer who thinks the company's AI has come to life." The headline was followed by a brief explanation of Blake Lamoine, a Southern grown, former U.S. military, ex-convict, Christian mystic, AI researcher, father, and genius of compassion (I added that last part) and his belief that there's "a ghost in the machine."* If your eyes haven't rolled to the back of your head yet, then chances are you're reading this from the front porch of a double-wide trailer parked somewhere below the Mason Dixon with a glass of sweet tea in your hand and a coon dog at your feet. Which is clearly not something any "reasonable" person would choose to do in the year 2022. Or if, like me, you're a bit more progressed from the stereotype, you might be standing in front of a classroom of semi-attentive undergraduate students at a Southeastern research university making your best effort to bridge the ever-widening practical and theoretical gaps between old-world journalistic traditions and new-age neoliberal ideologies related to the function of human language in society.


Data Science and Machine Learning Service Market 2022 CAGR Growth Statistics, Forecast 2028

#artificialintelligence

Data Science and Machine Learning Service will help the customer to also get overview about the global markets and establishing their business at theย โ€ฆ


We need to talk about the Midjourney Discord-based AI image generator

#artificialintelligence

Extremely realistic-looking images can now be created almost instantaneously by artificially intelligent internet bots. Should photographers, illustrators and graphic designers be threatened by this new industry development? In recent years, AI and smart programs have been advancing, especially in the fields of art, design and photography. Even Google is developing a new advanced AI system (opens in new tab) that can create hyper-realistic images from just a basic text prompt. You might be familiar with an AI program called the Dall-E Mini (opens in new tab), which set the internet abuzz a few months back with the ability to create any image you ask it for, and the results are completely original, too.



How AI is helping revitalise indigenous languages - ITU Hub

#artificialintelligence

Thirty-five years ago, New Zealand adopted a law declaring the official status of Te Reo Mฤori, the language spoken by the country's indigenous Mฤori people. Decades of repression put the language, also called simply te reo, under serious threat: only one in four Mฤori spoke it by 1960, with a very low percentage of speakers among children. Since then, the language has started regaining lost ground, enjoying formally equal status with English and being taught widely to New Zealand schoolchildren. Still, reviving it as a living language takes time and persistence. Lately, the nascent te reo renaissance is gaining added momentum with the help of artificial intelligence (AI).


A startup wants to democratize the tech behind DALL-E 2, consequences be damned โ€“ TechCrunch

#artificialintelligence

DALL-E 2, OpenAI's powerful text-to-image AI system, can create photos in the style of cartoonists, 19th century daguerreotypists, stop-motion animators and more. But it has an important, artificial limitation: a filter that prevents it from creating images depicting public figures and content deemed too toxic. Now an open source alternative to DALL-E 2 is on the cusp of being released, and it'll have no such filter. London- and Los Altos-based startup Stability AI this week announced the release of a DALL-E 2-like system, Stable Diffusion, to just over a thousand researchers ahead of a public launch in the coming weeks. A collaboration between Stability AI, media creation company RunwayML, Heidelberg University researchers and the research groups EleutherAI and LAION, Stable Diffusion is designed to run on most high-end consumer hardware, generating 512 512-pixel images in just a few seconds given any text prompt. "Stable Diffusion will allow both researchers and soon the public to run this under a range of conditions, democratizing image generation," Stability AI CEO and founder Emad Mostaque wrote in a blog post.


Faculty position in Artificial Intelligence in Chemical Engineering Department of Chemical & Bioc

#artificialintelligence

Applicants with research expertise in the application of data science, artificial intelligence, and machine learning to chemical and/or biochemicalย โ€ฆ


Artificial Intelligence Is Now Used To Track Down Hate Speech

#artificialintelligence

Throughout the last decade, the U.S. has seen immense growth in frequent internet usage, as one-third of Americans say they're online constantly, while nine out of ten say they surf the web several times a week -- according to a March 2021 Pew Research poll. That immense surge in activity has helped people stay more connected to one another, but it's also allowed for the widespread proliferation and exposure of hate speech. One fix that social media companies and other online networks have relied on is artificial intelligence - to varying degrees of success. For companies with giant user bases, like Meta, artificial intelligence is a key, if not necessary tool for detecting hate speech -- as there are too many users and pieces of violative content to be reviewed by the thousands of human content moderators already employed by the company. AI can help alleviate that burden by scaling up or down to fill in those gaps based on new influxes of users.