Google is rolling out new features and improvements for Home and Nest, one of which could make it much easier for users to create complex home automations even if they don't know how to code. The company's experimental "help me script" feature leverages the power of generative AI to create home automation scripts from the natural language prompts users type in. They can, for instance, write "when the TV turns on after sunset, dim the living room lights and close the blinds" to instantly generate a script they can use. "Help me script" lives inside Google Home for the web, and it appears as a panel inside the script editor when users click on " Add new." All they have to do is write a prompt, press enter and then copy-paste the script results into the script editor.

Inference optimizations are critical for improving user experience and reducing infrastructure costs and power consumption. In this article, we illustrate a form of dynamic execution known as speculative sampling to reduce the overall latency of text generation and compare it with standard autoregressive sampling. This can be used together with model-based optimizations (e.g. quantization) to provide an optimized solution. Both sampling methods make use of KV caching. A Jupyter notebook and some sample executions are provided.

Translation Quality Evaluation (TQE) is an essential step of the modern translation production process. TQE is critical in assessing both machine translation (MT) and human translation (HT) quality without reference translations. The ability to evaluate or even simply estimate the quality of translation automatically may open significant efficiency gains through process optimisation. This work examines whether the state-of-the-art large language models (LLMs) can be used for this purpose. We take OpenAI models as the best state-of-the-art technology and approach TQE as a binary classification task. On eight language pairs including English to Italian, German, French, Japanese, Dutch, Portuguese, Turkish, and Chinese, our experimental results show that fine-tuned gpt3.5 can demonstrate good performance on translation quality prediction tasks, i.e. whether the translation needs to be edited. Another finding is that simply increasing the sizes of LLMs does not lead to apparent better performances on this task by comparing the performance of three different versions of OpenAI models: curie, davinci, and gpt3.5 with 13B, 175B, and 175B parameters, respectively.

OpenAI recently announced multiple new features for ChatGPT and other artificial intelligence tools during its recent developer conference. The upcoming launch of a creator tool for chatbots, called GPTs (short for generative pretrained transformers), and a new model for ChatGPT, called GPT-4 Turbo, are two of the most important announcements from the company's event. This isn't the first time OpenAI has given ChatGPT a new model. Earlier this year, OpenAI updated the algorithm for ChatGPT from GPT-3.5 to GPT-4. Are you curious how the GPT-4 Turbo version of the chatbot will be different when it rolls out later this year?

This article is from Big Technology, a newsletter by Alex Kantrowitz. It's been a year of glossy profiles, breathless accolades, and billions in new funding for OpenAI, but the ChatGPT maker is far more vulnerable than the popular narrative suggests. Amid a seemingly unstoppable ascent, the company is facing fierce competition, a rising open-source movement, and pressure to deliver hits in an unpredictable discipline. While its marquee product has become practically synonymous with A.I., its perch atop the field is less than rock solid. OpenAI's weakness stems in part from its strength. It popularized generative A.I. by taking others' innovations--like the transformer model--and building stellar products on top of them.

Xbox has teamed up with a startup called Inworld AI to create a generative AI toolset that developers can use to create games. It's a multi-year collaboration, which the Microsoft-owned brand says can "assist and empower creators in dialogue, story and quest design." Specifically, the partners are looking to develop an "AI design copilot" that can turn prompts into detailed scripts, dialogue trees, quests and other game elements in the same way people can type ideas into generative AI chatbots and get detailed scripts in return. They're also going to work on an "AI character runtime engine" that developers can plug into their actual games, allowing players to generate new stories, quests and dialogues as they go. On Inworld's website, it says its technology can "craft characters with distinct personalities and contextual awareness that stay in-world."

Facebook is no stranger to moderating and mitigating misinformation on its platform, having long employed machine learning and artificial intelligence systems to help supplement its human-led moderation efforts. At the start of October, the company extended its machine learning expertise to its advertising efforts with an experimental set of generative AI tools that can perform tasks like generating backgrounds, adjusting image and creating captions for an advertiser's video content. Reuters reports Monday that Meta will specifically not make those tools available to political marketers ahead of what is expected to be a brutal and divisive national election cycle. Meta's decision to bar the use of generative AI is in line with much of the social media ecosystem, though, as Reuters is quick to point out, the company, "has not yet publicly disclosed the decision in any updates to its advertising standards." TikTok and Snap both ban political ads on their networks, Google employs a "keyword blacklist" to prevent its generative AI advertising tools from straying into political speech and X (formerly Twitter) is, well, you've seen it.

Human-AI interaction in text production increases complexity in authorship. In two empirical studies (n1 = 30 & n2 = 96), we investigate authorship and ownership in human-AI collaboration for personalized language generation. We show an AI Ghostwriter Effect: Users do not consider themselves the owners and authors of AI-generated text but refrain from publicly declaring AI authorship. Personalization of AI-generated texts did not impact the AI Ghostwriter Effect, and higher levels of participants' influence on texts increased their sense of ownership. Participants were more likely to attribute ownership to supposedly human ghostwriters than AI ghostwriters, resulting in a higher ownership-authorship discrepancy for human ghostwriters. Rationalizations for authorship in AI ghostwriters and human ghostwriters were similar. We discuss how our findings relate to psychological ownership and human-AI interaction to lay the foundations for adapting authorship frameworks and user interfaces in AI in text-generation tasks.

The past decade has been transformative for mental health research and practice. The ability to harness large repositories of data, whether from electronic health records (EHR), mobile devices, or social media, has revealed a potential for valuable insights into patient experiences, promising early, proactive interventions, as well as personalized treatment plans. Recent developments in generative artificial intelligence, particularly large language models (LLMs), show promise in leading digital mental health to uncharted territory. Patients are arriving at doctors' appointments with information sourced from chatbots, state-of-the-art LLMs are being incorporated in medical software and EHR systems, and chatbots from an ever-increasing number of startups promise to serve as AI companions, friends, and partners. This article presents contemporary perspectives on the opportunities and risks posed by LLMs in the design, development, and implementation of digital mental health tools. We adopt an ecological framework and draw on the affordances offered by LLMs to discuss four application areas -- care-seeking behaviors from individuals in need of care, community care provision, institutional and medical care provision, and larger care ecologies at the societal level. We engage in a thoughtful consideration of whether and how LLM-based technologies could or should be employed for enhancing mental health. The benefits and harms our article surfaces could serve to help shape future research, advocacy, and regulatory efforts focused on creating more responsible, user-friendly, equitable, and secure LLM-based tools for mental health treatment and intervention.

Large Multimodal Models (LMMs) have demonstrated impressive performance across various vision and language tasks, yet their potential applications in recommendation tasks with visual assistance remain unexplored. To bridge this gap, we present a preliminary case study investigating the recommendation capabilities of GPT-4V(ison), a recently released LMM by OpenAI. We construct a series of qualitative test samples spanning multiple domains and employ these samples to assess the quality of GPT-4V's responses within recommendation scenarios. Evaluation results on these test samples prove that GPT-4V has remarkable zero-shot recommendation abilities across diverse domains, thanks to its robust visual-text comprehension capabilities and extensive general knowledge. However, we have also identified some limitations in using GPT-4V for recommendations, including a tendency to provide similar responses when given similar inputs. This report concludes with an in-depth discussion of the challenges and research opportunities associated with utilizing GPT-4V in recommendation scenarios. Our objective is to explore the potential of extending LMMs from vision and language tasks to recommendation tasks. We hope to inspire further research into next-generation multimodal generative recommendation models, which can enhance user experiences by offering greater diversity and interactivity.