Goto

Collaborating Authors

 Oceania


Tools for Landscape Analysis of Optimisation Problems in Procedural Content Generation for Games

arXiv.org Artificial Intelligence

The term Procedural Content Generation (PCG) refers to the (semi-)automatic generation of game content by algorithmic means, and its methods are becoming increasingly popular in game-oriented research and industry. A special class of these methods, which is commonly known as search-based PCG, treats the given task as an optimisation problem. Such problems are predominantly tackled by evolutionary algorithms. We will demonstrate in this paper that obtaining more information about the defined optimisation problem can substantially improve our understanding of how to approach the generation of content. To do so, we present and discuss three efficient analysis tools, namely diagonal walks, the estimation of high-level properties, as well as problem similarity measures. We discuss the purpose of each of the considered methods in the context of PCG and provide guidelines for the interpretation of the results received. This way we aim to provide methods for the comparison of PCG approaches and eventually, increase the quality and practicality of generated content in industry.


UDApter -- Efficient Domain Adaptation Using Adapters

arXiv.org Artificial Intelligence

We propose two methods to make unsupervised domain adaptation (UDA) more parameter efficient using adapters, small bottleneck layers interspersed with every layer of the large-scale pre-trained language model (PLM). The first method deconstructs UDA into a two-step process: first by adding a domain adapter to learn domain-invariant information and then by adding a task adapter that uses domain-invariant information to learn task representations in the source domain. The second method jointly learns a supervised classifier while reducing the divergence measure. Compared to strong baselines, our simple methods perform well in natural language inference (MNLI) and the cross-domain sentiment classification task. We even outperform unsupervised domain adaptation methods such as DANN and DSN in sentiment classification, and we are within 0.85% F1 for natural language inference task, by fine-tuning only a fraction of the full model parameters. We release our code at https://github.com/declare-lab/domadapter


Causal Reasoning of Entities and Events in Procedural Texts

arXiv.org Artificial Intelligence

Entities and events are crucial to natural language reasoning and common in procedural texts. Existing work has focused either exclusively on entity state tracking (e.g., whether a pan is hot) or on event reasoning (e.g., whether one would burn themselves by touching the pan), while these two tasks are often causally related. We propose CREPE, the first benchmark on causal reasoning of event plausibility and entity states. We show that most language models, including GPT-3, perform close to chance at .35 F1, lagging far behind human at .87 F1. We boost model performance to .59 F1 by creatively representing events as programming languages while prompting language models pretrained on code. By injecting the causal relations between entities and events as intermediate reasoning steps in our representation, we further boost the performance to .67 F1. Our findings indicate not only the challenge that CREPE brings for language models, but also the efficacy of code-like prompting combined with chain-of-thought prompting for multihop event reasoning.


Wind Power Scenario Generation Using Graph Convolutional Generative Adversarial Network

arXiv.org Artificial Intelligence

Generating wind power scenarios is very important for studying the impacts of multiple wind farms that are interconnected to the grid. We develop a graph convolutional generative adversarial network (GCGAN) approach by leveraging GAN's capability in generating large number of realistic scenarios without using statistical modeling. Unlike existing GAN-based wind power data generation approaches, we design GAN's hidden layers to match the underlying spatial and temporal characteristics. We advocate the use of graph filters to embed the spatial correlation among multiple wind farms, and a one-dimensional (1D) convolutional layer to represent the temporal feature filters. The proposed graph and feature filter design significantly reduce the GAN model complexity, leading to improvements in training efficiency and computation complexity. Numerical results using real wind power data from Australia demonstrate that the scenarios generated by the proposed GCGAN exhibit more realistic spatial and temporal statistics than other GAN-based outputs.


Special Properties of Gradient Descent with Large Learning Rates

arXiv.org Artificial Intelligence

When training neural networks, it has been widely observed that a large step size is essential in stochastic gradient descent (SGD) for obtaining superior models. However, the effect of large step sizes on the success of SGD is not well understood theoretically. Several previous works have attributed this success to the stochastic noise present in SGD. However, we show through a novel set of experiments that the stochastic noise is not sufficient to explain good non-convex training, and that instead the effect of a large learning rate itself is essential for obtaining best performance.We demonstrate the same effects also in the noise-less case, i.e. for full-batch GD. We formally prove that GD with large step size -- on certain non-convex function classes -- follows a different trajectory than GD with a small step size, which can lead to convergence to a global minimum instead of a local one. Our settings provide a framework for future analysis which allows comparing algorithms based on behaviors that can not be observed in the traditional settings.


SAM operates far from home: eigenvalue regularization as a dynamical phenomenon

arXiv.org Artificial Intelligence

The Sharpness Aware Minimization (SAM) optimization algorithm has been shown to control large eigenvalues of the loss Hessian and provide generalization benefits in a variety of settings. The original motivation for SAM was a modified loss function which penalized sharp minima; subsequent analyses have also focused on the behavior near minima. However, our work reveals that SAM provides a strong regularization of the eigenvalues throughout the learning trajectory. We show that in a simplified setting, SAM dynamically induces a stabilization related to the edge of stability (EOS) phenomenon observed in large learning rate gradient descent. Our theory predicts the largest eigenvalue as a function of the learning rate and SAM radius parameters. Finally, we show that practical models can also exhibit this EOS stabilization, and that understanding SAM must account for these dynamics far away from any minima.


Why are there so many earthquakes?

Daily Mail - Science & tech

Less than two weeks after the tragic earthquake that has killed more than 40,000 people in Turkey and Syria, another shake has rocked New Zealand. Wednesday's'widely felt' tremor, around magnitude 6, jolted both New Zealand's islands, although thankfully there's been no immediate reports of damage or injury. Earthquakes are happening all the time, from the ones too small to even be noticed to the devastating high magnitude quakes that lead to thousands of fatalities. But its occurrence so soon after the disaster in Turkey and Syria begs the question - could they be linked? Here, MailOnline takes a closer look at today's event and whether it's related to the catastrophic tremor in the Middle East last week.


Google's AI music generator MusicLM has impressed listeners. Can you tell if these tunes were created by humans or an algorithm? - ABC News

#artificialintelligence

Human creativity was once thought to be protected from major improvements in artificial intelligence (AI) technology, but new generative AI systems are already competing with the imaginations of our most creative individuals, including musicians. Google's AI research project MusicLM has impressed listeners in the past few weeks, since it debuted its ability to turn simple text prompts into music that can sometimes be almost indistinguishable from works created by humans. So we've collected five pieces of music created by humans and five created by the MusicLM AI, to see if you can spot differences between the two in the quiz below. After the interactive questionnaire, we ask an expert to discuss how we might be able to better identify AI music, and what its advancements may mean for artists and the listening public. For now, let's get listening.


100% Fixed- OpenAI's Services Are Not Available In Your Country - TechGecs

#artificialintelligence

Have you encountered the message "OpenAI's Services Are Not Available In Your Country" while using ChatGPT? If yes, then this is the place where you will get all the information. There are various ways to fix the OpenAI's Services Are Not Available In Your Country error. Before going to fix you should know a little bit about OpenAi company. A firm known as OpenAI develops artificial intelligence ChatGPT.


Paraphrase Acquisition from Image Captions

arXiv.org Artificial Intelligence

We propose to use image captions from the Web as a previously underutilized resource for paraphrases (i.e., texts with the same "message") and to create and analyze a corresponding dataset. When an image is reused on the Web, an original caption is often assigned. We hypothesize that different captions for the same image naturally form a set of mutual paraphrases. To demonstrate the suitability of this idea, we analyze captions in the English Wikipedia, where editors frequently relabel the same image for different articles. The paper introduces the underlying mining technology, the resulting Wikipedia-IPC dataset, and compares known paraphrase corpora with respect to their syntactic and semantic paraphrase similarity to our new resource. In this context, we introduce characteristic maps along the two similarity dimensions to identify the style of paraphrases coming from different sources. An annotation study demonstrates the high reliability of the algorithmically determined characteristic maps.