By the time you read this article, there's a good chance it will have already been scanned by an artificially intelligent machine. If asked about the artist David Salle, large language models such as ChatGPT or Gemini may repurpose some of the words below to come up with their answer. The bigger the data set, the more convincing the response – and Salle has been written about exhaustively since he first rose to art world stardom in the 1980s. The question is whether AI can ever say anything new about the artist and his work, or if it's for ever condemned to generate more of the same. A similar question lingers beneath the surface of the paintings that Salle has been making since 2023, a new series of which he has just unveiled at Thaddaeus Ropac in London.

Recently, there has been a growing interest in the field of controllable Text-to-Speech (TTS). While previous studies have relied on users providing specific style factor values based on acoustic knowledge or selecting reference speeches that meet certain requirements, generating speech solely from natural text prompts has emerged as a new challenge for researchers. This challenge arises due to the scarcity of high-quality speech datasets with natural text style prompt and the absence of advanced text-controllable TTS models. In light of this, 1) we propose TextrolSpeech, which is the first large-scale speech emotion dataset annotated with rich text attributes. The dataset comprises 236,220 pairs of style prompt in natural text descriptions with five style factors and corresponding speech samples. Through iterative experimentation, we introduce a multi-stage prompt programming approach that effectively utilizes the GPT model for generating natural style descriptions in large volumes. 2) Furthermore, to address the need for generating audio with greater style diversity, we propose an efficient architecture called Salle. This architecture treats text controllable TTS as a language model task, utilizing audio codec codes as an intermediate representation to replace the conventional mel-spectrogram. Finally, we successfully demonstrate the ability of the proposed model by showing a comparable performance in the controllable TTS task. Audio samples are available at https://sall-e.github.io/