Media
Study Suggests a Human-AI Collobaration in Fashion Design – WWD
As the buzz around ChatGPT continues, communication academics and experts say the AI-generated technology has uses for marketing and content creation but is far from replacing human creativity. This assessment was also found by researchers in Korea, who studied AI in fashion and textile design. The study compared human and AI-generated designs. And while they were similar, humans have an edge, the report found, while concluding that AI can help designers in the creative process. And it could open the door for nonprofessionals to create their own fashion designs. They discovered that AI has "a wide range of applications in fashion, from increasing efficiency of processes and reducing waste to improving the industry's overall functioning," authors of the report said in a statement, adding that while creative processes are not often automated, AI can help in the creative process of design.
AI Is Improving Faster Than Most Humans Realize - The Washington Post
What will the next half-decade bring? Can we rely on our current impressions of these tools to judge their quality, or will they surprise us with their development? As someone who has spent many hours playing around with these models, I think many people are in for a shock. LLMs will have significant implications for our business decisions, our portfolios, our regulatory structures and the simple question of how much we as individuals should invest in learning how to use them.
'It's the opposite of art': why illustrators are furious about AI
'Woman reading book, under a night sky, dreamy atmosphere," I type into Deep Dream Generator's Text 2 Dream feature. In less than a minute, an image is returned to me showing what I've described. Welcome to the world of AI image generation, where you can create what on the surface looks like top-notch artwork using just a few text prompts, even if in reality your skills don't go beyond drawing stick figures. AI image generation seems to be everywhere: on TikTok, the popular AI Manga filter shows you what you look like in the Japanese comic style, while people in their droves are using it to create images for everything from company logos to picture books. It's already been used by one major publisher: sci-fi imprint Tor discovered that a cover it had created had used a licensed image created by AI, but decided to go ahead anyway "due to production constraints". The biggest players in AI include companies such as MidJourney, Stable Diffusion and Deep Dream Generator (DDG). They're free to use, up to a point, making them attractive to those just wanting to try them out. There's no denying that they're fun, but closer examination of the images they produce shows oddities. The face of the woman in my image has very odd features, and appears to be holding multiple books. The images also have a similarly polished, somewhat kitsch aesthetic. And, while there's an initial thrill at seeing an image appear, there's no creative satisfaction. The implications of AI image generation are far-reaching and could impact everything from film to graphic novels and more. Children's illustrators were quick to raise concerns about the technology on social media. Among them is author and illustrator Rob Biddulph, who says that AI-generated art "is the exact opposite of what I believe art to be.
Interacting with next-phrase suggestions: How suggestion systems aid and influence the cognitive processes of writing
Bhat, Advait, Agashe, Saaket, Mohile, Niharika, Oberoi, Parth, Jangir, Ravi, Joshi, Anirudha
Writing with next-phrase suggestions powered by large language models is becoming more pervasive by the day. However, research to understand writers' interaction and decision-making processes while engaging with such systems is still emerging. We conducted a qualitative study to shed light on writers' cognitive processes while writing with next-phrase suggestion systems. To do so, we recruited 14 amateur writers to write two reviews each, one without suggestions and one with suggestions. Additionally, we also positively and negatively biased the suggestion system to get a diverse range of instances where writers' opinions and the bias in the language model align or misalign to varying degrees. We found that writers interact with next-phrase suggestions in various complex ways: Writers abstracted and extracted multiple parts of the suggestions and incorporated them within their writing, even when they disagreed with the suggestion as a whole; along with evaluating the suggestions on various criteria. The suggestion system also had various effects on the writing process, such as altering the writer's usual writing plans, leading to higher levels of distraction etc. Based on our qualitative analysis using the cognitive process model of writing by Hayes as a lens, we propose a theoretical model of 'writer-suggestion interaction' for writing with GPT-2 (and causal language models in general) for a movie review writing task, followed by directions for future research and design.
Weakly Supervised Headline Dependency Parsing
Benton, Adrian, Shi, Tianze, İrsoy, Ozan, Malioutov, Igor
English news headlines form a register with unique syntactic properties that have been documented in linguistics literature since the 1930s. However, headlines have received surprisingly little attention from the NLP syntactic parsing community. We aim to bridge this gap by providing the first news headline corpus of Universal Dependencies annotated syntactic dependency trees, which enables us to evaluate existing state-of-the-art dependency parsers on news headlines. To improve English news headline parsing accuracies, we develop a projection method to bootstrap silver training data from unlabeled news headline-article lead sentence pairs. Models trained on silver headline parses demonstrate significant improvements in performance over models trained solely on gold-annotated long-form texts. Ultimately, we find that, although projected silver training data improves parser performance across different news outlets, the improvement is moderated by constructions idiosyncratic to outlet.
Large language models can segment narrative events similarly to humans
Michelmann, Sebastian, Kumar, Manoj, Norman, Kenneth A., Toneva, Mariya
Humans perceive discrete events such as "restaurant visits" and "train rides" in their continuous experience. One important prerequisite for studying human event perception is the ability of researchers to quantify when one event ends and another begins. Typically, this information is derived by aggregating behavioral annotations from several observers. Here we present an alternative computational approach where event boundaries are derived using a large language model, GPT-3, instead of using human annotations. We demonstrate that GPT-3 can segment continuous narrative text into events. GPT-3-annotated events are significantly correlated with human event annotations. Furthermore, these GPT-derived annotations achieve a good approximation of the "consensus" solution (obtained by averaging across human annotations); the boundaries identified by GPT-3 are closer to the consensus, on average, than boundaries identified by individual human annotators. This finding suggests that GPT-3 provides a feasible solution for automated event annotations, and it demonstrates a further parallel between human cognition and prediction in large language models. In the future, GPT-3 may thereby help to elucidate the principles underlying human event perception.
Multitask Instruction-based Prompting for Fallacy Recognition
Alhindi, Tariq, Chakrabarty, Tuhin, Musi, Elena, Muresan, Smaranda
Fallacies are used as seemingly valid arguments to support a position and persuade the audience about its validity. Recognizing fallacies is an intrinsically difficult task both for humans and machines. Moreover, a big challenge for computational models lies in the fact that fallacies are formulated differently across the datasets with differences in the input format (e.g., question-answer pair, sentence with fallacy fragment), genre (e.g., social media, dialogue, news), as well as types and number of fallacies (from 5 to 18 types per dataset). To move towards solving the fallacy recognition task, we approach these differences across datasets as multiple tasks and show how instruction-based prompting in a multitask setup based on the T5 model improves the results against approaches built for a specific dataset such as T5, BERT or GPT-3. We show the ability of this multitask prompting approach to recognize 28 unique fallacies across domains and genres and study the effect of model size and prompt choice by analyzing the per-class (i.e., fallacy type) results. Finally, we analyze the effect of annotation quality on model performance, and the feasibility of complementing this approach with external knowledge.
Self-Supervised Hierarchical Metrical Structure Modeling
We propose a novel method to model hierarchical metrical structures for both symbolic music and audio signals in a self-supervised manner with minimal domain knowledge. The model trains and inferences on beat-aligned music signals and predicts an 8-layer hierarchical metrical tree from beat, measure to the section level. The training procedure does not require any hierarchical metrical labeling except for beats, purely relying on the nature of metrical regularity and inter-voice consistency as inductive biases. We show in experiments that the method achieves comparable performance with supervised baselines on multiple metrical structure analysis tasks on both symbolic music and audio signals. All demos, source code and pre-trained models are publicly available on GitHub.
Audience-Centric Natural Language Generation via Style Infusion
Moorjani, Samraj, Krishnan, Adit, Sundaram, Hari, Maslowska, Ewa, Sankar, Aravind
Adopting contextually appropriate, audience-tailored linguistic styles is critical to the success of user-centric language generation systems (e.g., chatbots, computer-aided writing, dialog systems). While existing approaches demonstrate textual style transfer with large volumes of parallel or non-parallel data, we argue that grounding style on audience-independent external factors is innately limiting for two reasons. First, it is difficult to collect large volumes of audience-specific stylistic data. Second, some stylistic objectives (e.g., persuasiveness, memorability, empathy) are hard to define without audience feedback. In this paper, we propose the novel task of style infusion - infusing the stylistic preferences of audiences in pretrained language generation models. Since humans are better at pairwise comparisons than direct scoring - i.e., is Sample-A more persuasive/polite/empathic than Sample-B - we leverage limited pairwise human judgments to bootstrap a style analysis model and augment our seed set of judgments. We then infuse the learned textual style in a GPT-2 based text generator while balancing fluency and style adoption. With quantitative and qualitative assessments, we show that our infusion approach can generate compelling stylized examples with generic text prompts. The code and data are accessible at https://github.com/CrowdDynamicsLab/StyleInfusion.