create
SafeArena: Evaluating the Safety of Autonomous Web Agents
Tur, Ada Defne, Meade, Nicholas, Lù, Xing Han, Zambrano, Alejandra, Patel, Arkil, Durmus, Esin, Gella, Spandana, Stańczak, Karolina, Reddy, Siva
LLM-based agents are becoming increasingly proficient at solving web-based tasks. With this capability comes a greater risk of misuse for malicious purposes, such as posting misinformation in an online forum or selling illicit substances on a website. To evaluate these risks, we propose SafeArena, the first benchmark to focus on the deliberate misuse of web agents. SafeArena comprises 250 safe and 250 harmful tasks across four websites. We classify the harmful tasks into five harm categories -- misinformation, illegal activity, harassment, cybercrime, and social bias, designed to assess realistic misuses of web agents. We evaluate leading LLM-based web agents, including GPT-4o, Claude-3.5 Sonnet, Qwen-2-VL 72B, and Llama-3.2 90B, on our benchmark. To systematically assess their susceptibility to harmful tasks, we introduce the Agent Risk Assessment framework that categorizes agent behavior across four risk levels. We find agents are surprisingly compliant with malicious requests, with GPT-4o and Qwen-2 completing 34.7% and 27.3% of harmful requests, respectively. Our findings highlight the urgent need for safety alignment procedures for web agents. Our benchmark is available here: https://safearena.github.io
- North America > United States (0.46)
- Europe > Austria > Vienna (0.14)
- North America > Canada > Quebec > Montreal (0.14)
- (2 more...)
- Law > Criminal Law (1.00)
- Information Technology > Security & Privacy (1.00)
- Government (1.00)
- (3 more...)
- Information Technology > Communications (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Chatbot (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
Spooked by ChatGPT, US Lawmakers Want to Create an AI Regulator
Since the tech industry began its love affair with machine learning about a decade ago, US lawmakers have chattered about the potential need for regulation to rein in the technology. No proposal to regulate corporate AI projects has got close to becoming law--but OpenAI's release of ChatGPT in November has convinced some senators there is now an urgent need to do something to protect people's rights against the potential harms of AI technology. At a hearing held by a Senate Judiciary subcommittee yesterday attendees heard a terrifying laundry list of ways artificial intelligence can harm people and democracy. Senators from both parties spoke in support of the idea of creating a new arm of the US government dedicated to regulating AI. The idea even got the backing of Sam Altman, CEO of OpenAI.
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Chatbot (1.00)
- Information Technology > Artificial Intelligence > Issues > Social & Ethical Issues (0.91)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning > Generative AI (0.48)
AI Website Builder to Create an AI Website Design for Free
Artificial Intelligence is concerned with creating smart machines to perform tasks which majorly requires human intelligence. AI-based applications like chatbots, automation platforms, search engines, etc. are creating a paradigm shift. To create your own Artificial Intelligence website, ensure that you have sufficient knowledge of the field. You must add a few essential pages to your Artificial Intelligence website design to fulfill the purpose. Some of them are mentioned below.
- Information Technology > Communications > Web (0.63)
- Information Technology > Artificial Intelligence > Natural Language (0.59)
Create Your Own Stable Diffusion UI on AWS in Minutes
Stable Diffusion (SD) has quickly become one of the most popular text-to-image (a.k.a. One key factor contributing to its success is that it has been made available as open-source software. This spawned a vibrant community that quickly built tools to make SD more accessible to anyone interested in it, regardless of their technical knowledge. One of those tools is the simple yet powerful web interface stable-diffusion-webui by Automatic1111. It allows us to use all the features of SD without any coding and it is also open-source, which means anyone can download this Web UI as well as the SD model and deploy them anywhere they want.
Create a Pencil Sketch From an Image using Python and AI
Deep learning models have shown remarkable success in tasks such as image classification and object detection. But they can also be used to generate artistic outputs, such as sketches. One such model is Artline, which is a deep-learning model that can convert images into sketches. Artline uses a technique called "style transfer" to convert images into sketches. Style transfer involves taking the content of an image and combining it with the style of another image to create a new, composite image.
Machine Learning Could Create the Perfect Game Bosses
Romain Trachel and Alexandre Peyrot, machine-learning specialists at Eidos-Sherbrooke, demonstrated a game at Unreal Fest 2022 that combines machine learning with a feature which lets developers use spatial data to inform AI decisions. This is normally handled through behavior trees, but in the demo the AI behavior was driven by a machine-learning model. The Unreal Engine Environment Query System (EQS) acts as the AI's eyes and ears, providing information about its environment, while the machine-learning model becomes its brain and decides how it should respond. "If a developer decided to activate a stronger chase mode, the only thing to do is to increase a reference value in the EQS tests," Trachel and Peyrot said in an email. "It really has the potential to simplify the development workflow, because in actual game productions, it would be up to a game designer to decide which game variables must be tuned in order to change the difficulty."
- Leisure & Entertainment > Games (0.75)
- Leisure & Entertainment > Sports > Baseball (0.40)
I Used ChatGPT to Create an Entire AI Application on AWS
Two days ago OpenAI released ChatGPT, a new language model which is an improved version of GPT-3 and, possibly, gives us a peek into what GPT-4 will be capable of when it is released early next year (as is rumoured). With ChatGPT it is possible to have actual conversation with the model, referring back to previous points in the conversation. I wanted to try out if I could use this model as a pair programmer that I can give some instructions and it produces the code for me. I would still double-check those code snippets, of course, but at least I won't have to write them from scratch anymore. So in this blog post I describe how I used ChatGPT to create a simple sentiment analysis application from scratch.
Amazon Alexa Wants To Put Your Child To Bed With Generative AI Storytelling
Amazon Alexa's Create With Alexa feature uses conversational and generative AI to create unique stories after users select a theme, character, a descriptive word and a color. Generative AI, which is known for churning out fantastical art based on text prompts, is now sneaking into one of the most sacred bonding experiences for parents and children: bedtime storytelling. Amazon is hopping into the generative AI craze with a new Alexa feature that creates short, five-scene stories for kids based on a few prompts. Called'Create With Alexa,' the feature lets children and parents select from given themes like underwater, enchanted forest and space exploration and pick a character, a descriptive word and a color. Then, they sit back and wait as the AI comes up with different stories, visuals, audio dialogues and background music.
AI Conversation Speaker aka Friend Bot: Part 2 Wake Word - Hackster.io
The Conversational Speaker, informally known as "Friend Bot", uses a Raspberry Pi to enable a spoken conversation with OpenAI large language models. This implementation waits for a wake phrase, listens to speech, processes the conversation through the OpenAI service, and responds back. For more information on the prompt engine used for maintaining conversation context, go here: python,typescript,dotnet. This project is written in.NET 6 which supports Raspberry Pi OS, Linux, macOS, and Windows. The code base has a default wake word (i.e., "Hey, Computer.")
7 Technologies that are Waiting to Create a Revolution
There are many different types of technologies that are waiting to revolutionize the world. Here are 7 of those technologies that you should keep an eye on. Technology has revolutionized our lives in so many ways, and it continues to grow more and more advanced every day. While we are constantly surrounded by technology, it can be easy to take it for granted and forget about the many amazing ways that it has impacted our lives. Mobile technology is critical today, and it continues to grow more popular each year. Nearly everyone utilizes mobile devices in one way or another, and the ubiquity of smartphones has made them essential for virtually everyone.
- Information Technology > Communications > Mobile (0.63)
- Information Technology > Artificial Intelligence (0.47)