Goto

Collaborating Authors

 Oceania


Applying Data Driven Decision Making to rank Vocational and Educational Training Programs with TOPSIS

arXiv.org Artificial Intelligence

The 2008 financial crisis that hit the world's economies has had a particularly acute impact in Spain (Guardiola and Guillen-Royo, 2015). It is only since 2014 that Spain seemed to begin its recovery (Martí and Pérez, 2015). However, this recuperation is still far to be acceptable with regard to the labor landscape (Casares and Vázquez, 2018). One of the main Spanish weaknesses that the crisis exposed was the so-called duality of the labor market. Thus, Spain is characterized by the existence of two very different types of workers. On one hand, long term workers on indefinite contracts, having both a very high job security and a very high cost for companies (especially in terms of dismissals) and usually with university studies even for jobs that do not require them.


Fine-Tuning Large Language Models to Appropriately Abstain with Semantic Entropy

arXiv.org Artificial Intelligence

Large Language Models (LLMs) are known to hallucinate, whereby they generate plausible but inaccurate text. This phenomenon poses significant risks in critical applications, such as medicine or law, necessitating robust hallucination mitigation strategies. While recent works have proposed fine-tuning methods to teach LLMs to abstain from answering questions beyond their knowledge or capabilities, these methods rely on the existence of ground-truth labels or are limited to short-form responses. To address these limitations, we propose fine-tuning using semantic entropy, an uncertainty measure derived from introspection into the model which does not require external labels. We demonstrate that our approach matches or outperforms models fine-tuned using prior work and achieves strong performance for both short and long-form generations on a range of datasets.


Are Large Language Models Ready for Travel Planning?

arXiv.org Artificial Intelligence

While large language models (LLMs) show promise in hospitality and tourism, their ability to provide unbiased service across demographic groups remains unclear. This paper explores gender and ethnic biases when LLMs are utilized as travel planning assistants. To investigate this issue, we apply machine learning techniques to analyze travel suggestions generated from three open-source LLMs. Our findings reveal that the performance of race and gender classifiers substantially exceeds random chance, indicating differences in how LLMs engage with varied subgroups. Specifically, outputs align with cultural expectations tied to certain races and genders. To minimize the effect of these stereotypes, we used a stop-word classification strategy, which decreased identifiable differences, with no disrespectful terms found. However, hallucinations related to African American and gender minority groups were noted. In conclusion, while LLMs can generate travel plans seemingly free from bias, it remains essential to verify the accuracy and appropriateness of their recommendations.


PLDR-LLM: Large Language Model from Power Law Decoder Representations

arXiv.org Artificial Intelligence

We present the Large Language Model from Power Law Decoder Representations (PLDR-LLM), a language model that leverages non-linear and linear transformations through Power Law Graph Attention mechanism to generate well-defined deductive and inductive outputs. We pretrain the PLDR-LLMs of varying layer sizes with a small batch size of 32 and $\sim$8B tokens from the RefinedWeb dataset, and show that they achieve competitive performance in zero-shot and few-shot settings compared to scaled dot-product LLMs of similar model size reported in the literature. We show that deductive outputs of PLDR-LLMs can be used to compare model characteristics or improve the performance by introducing the Directed Acyclic Graph (DAG) loss as a metric and regularizer. Our results indicate that the initial maximum learning rate and warm-up steps have a lasting impact on deductive outputs throughout the pretraining. We provide a detailed description of PLDR-LLM architecture, its implementation and the pretraining procedure.


AskBeacon -- Performing genomic data exchange and analytics with natural language

arXiv.org Artificial Intelligence

For the two investigated workflows, there are significant difference in the prediction of variants terms and additional phenotypic filtering terms. An intuitive comparison between the parallel and multistep extraction model is that, in the parallel workflow the models' instructions are rather simple, where the model is asked to predict only variants specific fields (variants extractor template) and other fields (filter extractor template) not concerning about the presence of the fields in the Beacon schema. Not all extracted terms in this extractor chain are valid for Beacon. A further validator template is further required here to filter out the terms that are not related to Beacon. In contrast, in the multistep workflow, both the variants and phenotypic terms are extracted only when they match with the beacon schema without the necessity of the validation prompt. Thus, although these models are predicting less terms, the extracted terms are aligned with the schema with less hallucination than the Parallel schema, as seen in previous section.


Meta to use facial recognition technology in fight against celebrity investment scam ads

The Guardian

Meta is fighting the scourge of celebrity investment scam ads with facial recognition technology to detect those who most often have their images used. The parent company of Facebook and Instagram announced on Monday it would begin trialling the use of facial recognition technology with a select pool of 50,000 celebrities or public figures worldwide on an opt-out basis in December. If Meta's existing systems suspect an ad may be a scam, it would compare the images in the ad against the public figure's Facebook and Instagram profile pictures, and if it's a match and the ad is a scam, it will be deleted. "This process is done in real time and is faster and much more accurate than manual human reviews, so it allows us to apply our enforcement policies more quickly and to protect people on our apps from scams and celebrities," David Agranovich, director of global threat disruption at Meta, told reporters on Monday. The celebrities must have a Facebook or Instagram profile in order to participate in the system.


Man guilty of army veteran hammer attack murder

BBC News

Man guilty of army veteran hammer attack murder Cumbria PoliceJack Crawley attempted to burn Paul Taylor's body, before burying him in woodland A man who attacked an army veteran he had met for sex and bludgeoned him with a hammer has been found guilty of murder. Paul Taylor, 57, from Annan, Dumfriesshire, went missing last October, with his remains found in a shallow grave in woodland near Carlisle, Cumbria, in May. Jack Crawley, 20, of Carlisle, was found guilty of attacking him and trying to burn his body following a trial at the city's crown court. He will be sentenced on Wednesday. Crawley was also found guilty of the attempted murder of a man in York, who he met on the gay dating app Grindr and also attacked with a hammer, while he was on bail for killing Mr Taylor.


Procedural Content Generation in Games: A Survey with Insights on Emerging LLM Integration

arXiv.org Artificial Intelligence

Procedural Content Generation (PCG) is defined as the automatic creation of game content using algorithms. PCG has a long history in both the game industry and the academic world. It can increase player engagement and ease the work of game designers. While recent advances in deep learning approaches in PCG have enabled researchers and practitioners to create more sophisticated content, it is the arrival of Large Language Models (LLMs) that truly disrupted the trajectory of PCG advancement. This survey explores the differences between various algorithms used for PCG, including search-based methods, machine learning-based methods, other frequently used methods (e.g., noise functions), and the newcomer, LLMs. We also provide a detailed discussion on combined methods. Furthermore, we compare these methods based on the type of content they generate and the publication dates of their respective papers. Finally, we identify gaps in the existing academic work and suggest possible directions for future research.


Semantic-guided Search for Efficient Program Repair with Large Language Models

arXiv.org Artificial Intelligence

In this paper, we first show that increases in beam size of even just small-sized LLM (1B-7B parameters) require an extensive GPU resource consumption, leading to up to 80% of recurring crashes due to memory overloads in LLM-based APR. Seemingly simple solutions to reduce memory consumption are (1) to quantize LLM models, i.e., converting the weights of a LLM from high-precision values to lower-precision ones. and (2) to make beam search sequential, i.e., forwarding each beam through the model sequentially and then concatenate them back into a single model output. However, we show that these approaches still do not work via both theoretical analysis and experiments. To address this, we introduce FLAMES, a novel LLM-based APR technique that employs semantic-guided patch generation to enhance repair effectiveness and memory efficiency. Unlike conventional methods that rely on beam search, FLAMES utilizes greedy decoding to enhance memory efficiency while steering the search to more potentially good repair candidates via a semantic-guided best-first search algorithm. At each decoding step, FLAMES uses semantic feedback from test validation such as the number of passing and failing test cases to select the most promising token to explore further. Our empirical evaluation on the Defects4J and HumanEval-Java datasets shows that FLAMES not only substantially reduces memory consumption by up to 83% compared to conventional LLM-based APR, but also accelerates the repair process. Remarkably, FLAMES successfully generated 133 and 103 correct fixes for 333 and 163 bugs in the Defects4J and HumanEval-Java datasets, respectively. This suggests that FLAMES is not only more efficient but also outperforms state-of-the-art techniques, fixing at least 10 and 11 more bugs than SOTA baselines in the Defects4J and HumanEval-Java datasets, respectively.


Information for Conversation Generation: Proposals Utilising Knowledge Graphs

arXiv.org Artificial Intelligence

LLMs are frequently used tools for conversational generation. Without additional information LLMs can generate lower quality responses due to lacking relevant content and hallucinations, as well as the perception of poor emotional capability, and an inability to maintain a consistent character. Knowledge graphs are commonly used forms of external knowledge and may provide solutions to these challenges. This paper introduces three proposals, utilizing knowledge graphs to enhance LLM generation. Firstly, dynamic knowledge graph embeddings and recommendation could allow for the integration of new information and the selection of relevant knowledge for response generation. Secondly, storing entities with emotional values as additional features may provide knowledge that is better emotionally aligned with the user input. Thirdly, integrating character information through narrative bubbles would maintain character consistency, as well as introducing a structure that would readily incorporate new information.