Goto

Collaborating Authors

 Large Language Model


Architext: Language-Driven Generative Architecture Design

arXiv.org Artificial Intelligence

Architectural design is a highly complex practice that involves a wide diversity of disciplines, technologies, proprietary design software, expertise, and an almost infinite number of constraints, across a vast array of design tasks. Enabling intuitive, accessible, and scalable design processes is an important step towards performance-driven and sustainable design for all. To that end, we introduce Architext, a novel semantic generation assistive tool. Architext enables design generation with only natural language prompts, given to large-scale Language Models, as input. We conduct a thorough quantitative evaluation of Architext's downstream task performance, focusing on semantic accuracy and diversity for a number of pre-trained language models ranging from 120 million to 6 billion parameters. Architext models are able to learn the specific design task, generating valid residential layouts at a near 100% rate. Accuracy shows great improvement when scaling the models, with the largest model (GPT-J) yielding impressive accuracy ranging between 25% to over 80% for different prompt categories. We open source the finetuned Architext models and our synthetic dataset, hoping to inspire experimentation in this exciting area of design research.


Black-box Prompt Tuning with Subspace Learning

arXiv.org Artificial Intelligence

Black-box prompt tuning uses derivative-free optimization algorithms to learn prompts in low-dimensional subspaces instead of back-propagating through the network of Large Language Models (LLMs). Recent studies have found that black-box prompt tuning lacks versatility across tasks and LLMs, which we believe is related to the inappropriate choice of subspaces. In this paper, we propose Black-box prompt tuning with Subspace Learning (BSL) to improve the versatility of black-box prompt tuning. Based on the assumption that nearly optimal prompts for similar tasks exist in a common subspace, we propose identifying such subspaces by meta-learning on a set of similar source tasks. Therefore, for a target task that shares similarities with source tasks, we guarantee that optimizing in the subspace can find a prompt that performs well on the target task. Experiments confirm that our BSL framework consistently achieves competitive performance regardless of downstream tasks and LLMs.


What is BERT?

FOX News

Naftali Bennett spoke exclusively with Fox News Digital about the benefits of AI and the need to set parameters for its use now. BERT is an open-source machine learning framework that is used for various natural language processing (NLP) tasks. It is designed to help computers better understand nuance in language by grasping the meaning of surrounding words in a text. The benefit is that context of a text can be understood rather than just the meaning of individual words. It is no secret that artificial intelligence impacts society in surprising ways.


These are the top 10 most in-demand jobs worldwide, suggests new study

Daily Mail - Science & tech

Knowing the state of the job market is critical to finding your next position - a new report aims to take out the guesswork by revealing the most in-demand worldwide. Experts compiled internet data and Google job searches to create a list of the top 10 most sought-after positions, ranking software quality assurance analyst at the top. A software quality assurance analyst, someone that tests software to ensure it is free of bugs, saw a 155 percent increase in searchers from 2021 to 2022. The second most searched was solar consultant, who provided customers with information about solar-powered equipment, and customer service associate. However, the report was conducted before AI's success, which is set to take over many positions, and the recent tech layoffs that saw thousands of people lose their jobs.


ChatGPT could create a new religion by writing its own sacred texts, historian claims

Daily Mail - Science & tech

Elon Musk wants to push technology to its absolute limit, from space travel to self-driving cars -- but he draws the line at artificial intelligence. The billionaire first shared his distaste for AI in 2014, calling it humanity's'biggest existential threat' and comparing it to'summoning the demon.' At the time, Musk also revealed he was investing in AI companies not to make money but to keep an eye on the technology in case it gets out of hand. His main fear is that in the wrong hands, if AI becomes advanced, it could overtake humans and spell the end of mankind, which is known as The Singularity. That concern is shared among many brilliant minds, including the late Stephen Hawking, who told the BBC in 2014: 'The development of full artificial intelligence could spell the end of the human race.


The Download: Geoffrey Hinton's AI fears, and decoding our thoughts

MIT Technology Review

Geoffrey Hinton is a pioneer of deep learning who helped develop some of the most important techniques at the heart of modern artificial intelligence. But after a decade at Google, he is stepping down to focus on new concerns he now has about AI. Stunned by the capabilities of new large language models like GPT-4, Hinton wants to raise public awareness of the serious risks that he now believes may accompany the technology he ushered in. Will Douglas Heaven, our senior AI editor, sat down with Hinton at his north London home just four days before the bombshell announcement of his departure. Hinton explained his belief that machines are on track to be a lot smarter than he thought they'd be--and why he's scared about how that might play out.


Samsung tells employees not to use AI tools like ChatGPT and Google Bard

Engadget

While many workers worry AI bots will take their jobs, Samsung employees are no longer allowed to use them. The company banned generative AI tools, like ChatGPT and Google Bard, after discovering staff had added sensitive code to them, Bloomberg reported. This revelation followed last month's incident in which Samsung engineers uploaded internal source code and meeting notes to ChatGPT and accidentally leaked it. Samsung isn't waiting for another mishap to take action. "HQ is reviewing security measures to create a secure environment for safely using generative AI to enhance employees' productivity and efficiency," the company said in a memo to staff.


Never Give Artificial Intelligence the Nuclear Codes

The Atlantic - Technology

No technology since the atomic bomb has inspired the apocalyptic imagination like artificial intelligence. Ever since ChatGPT began exhibiting glints of logical reasoning in November, the internet has been awash in doomsday scenarios. Many are self-consciously fanciful--they're meant to jar us into envisioning how badly things could go wrong if an emerging intelligence comes to understand the world, and its own goals, even a little differently from how its human creators do. One scenario, however, requires less imagination, because the first steps toward it are arguably already being taken--the gradual integration of AI into the most destructive technologies we possess today. Check out more from this issue and find your next story to read. The world's major military powers have begun a race to wire AI into warfare.


We need to bring consent to AI

MIT Technology Review

But first, we need to talk about consent in AI. Last week, OpenAI announced it is launching an "incognito" mode that does not save users' conversation history or use it to improve its AI language model ChatGPT. The new feature lets users switch off chat history and training and allows them to export their data. This is a welcome move in giving people more control over how their data is used by a technology company. OpenAI's decision to allow people to opt out comes as the firm is under increasing pressure from European data protection regulators over how it uses and collects data.


Geoffrey Hinton tells us why he's now scared of the tech he helped build

MIT Technology Review

Leaving Google will let him speak his mind, without the self-censorship a Google executive must engage in. "I want to talk about AI safety issues without having to worry about how it interacts with Google's business," he says. "As long as I'm paid by Google, I can't do that." That doesn't mean Hinton is unhappy with Google by any means. "It may surprise you," he says.