Media
Label Mask for Multi-Label Text Classification
Song, Rui, Chen, Xingbing, Liu, Zelong, An, Haining, Zhang, Zhiqi, Wang, Xiaoguang, Xu, Hao
One of the key problems in multi-label text classification is how to take advantage of the correlation among labels. However, it is very challenging to directly model the correlations among labels in a complex and unknown label space. In this paper, we propose a Label Mask multi-label text classification model (LM-MTC), which is inspired by the idea of cloze questions of language model. LM-MTC is able to capture implicit relationships among labels through the powerful ability of pre-train language models. On the basis, we assign a different token to each potential label, and randomly mask the token with a certain probability to build a label based Masked Language Model (MLM). We train the MTC and MLM together, further improving the generalization ability of the model. A large number of experiments on multiple datasets demonstrate the effectiveness of our method.
The Efforts to Make Text-Based AI Less Racist and Terrible
In July 2020, OpenAI launched GPT-3, an artificial intelligence language model that quickly stoked excitement about computers writing poetry, news articles, and programming code. Just as quickly, it was shown to sometimes be foulmouthed and toxic. OpenAI said it was working on fixes, but the company recently discovered GPT-3 was being used to generate child porn. Now OpenAI researchers say they've found a way to curtail GPT-3's toxic text by feeding the program roughly 100 encyclopedia-like samples of writing by human professionals on topics like history and technology but also abuse, violence, and injustice. OpenAI's project shows how the tech industry is scrambling to constrain the dark side of a technology that's shown enormous potential but also can spread disinformation and perpetuate biases.
Artificial Intelligence will make marketing more creative and effective - Express Computer
AI can free up a lot of the marketers' time, currently spent on mundane tasks, so that they focus on what they do best--be creative, think, ideate and innovate. All of us have heard about driverless cars, automated machines, bots and virtual assistants, even if we don't fully understand what these terms mean. All of these are manifestations of self-learning algorithms, smart technologies such as Artificial Intelligence (AI) and Machine Learning (ML). The application of these technologies is no longer just limited to sci-fi movies and erudite research papers. Directed by data-driven insights from these powerful technologies, traditional decision-making by experienced professionals is slowly being transformed.