As full AI-based automation remains out of reach in most real-world applications, the focus has instead shifted to leveraging the strengths of both human and AI agents, creating effective collaborative systems. The rapid advances in this area have yielded increasingly more complex systems and frameworks, while the nuance of their characterization has gotten more vague. Similarly, the existing conceptual models no longer capture the elaborate processes of these systems nor describe the entire scope of their collaboration paradigms. In this paper, we propose a new unified set of dimensions through which to analyze and describe human-AI systems. Our conceptual model is centered around three high-level aspects - agency, interaction, and adaptation - and is developed through a multi-step process. Firstly, an initial design space is proposed by surveying the literature and consolidating existing definitions and conceptual frameworks. Secondly, this model is iteratively refined and validated by conducting semi-structured interviews with nine researchers in this field. Lastly, to illustrate the applicability of our design space, we utilize it to provide a structured description of selected human-AI systems.

Reinforcement Learning From Human Feedback (RLHF) has been a critical to the success of the latest generation of generative AI models. In response to the complex nature of the classical RLHF pipeline, direct alignment algorithms such as Direct Preference Optimization (DPO) have emerged as an alternative approach. Although DPO solves the same objective as the standard RLHF setup, there is a mismatch between the two approaches. Standard RLHF deploys reinforcement learning in a specific token-level MDP, while DPO is derived as a bandit problem in which the whole response of the model is treated as a single arm. In this work we rectify this difference, first we theoretically show that we can derive DPO in the token-level MDP as a general inverse Q-learning algorithm, which satisfies the Bellman equation. Using our theoretical results, we provide three concrete empirical insights. First, we show that because of its token level interpretation, DPO is able to perform some type of credit assignment. Next, we prove that under the token level formulation, classical search-based algorithms, such as MCTS, which have recently been applied to the language generation space, are equivalent to likelihood-based search on a DPO policy. Empirically we show that a simple beam search yields meaningful improvement over the base DPO policy. Finally, we show how the choice of reference policy causes implicit rewards to decline during training. We conclude by discussing applications of our work, including information elicitation in multi-tun dialogue, reasoning, agentic applications and end-to-end training of multi-model systems.

The quadratic complexity and weak length extrapolation of Transformers limits their ability to scale to long sequences, and while sub-quadratic solutions like linear attention and state space models exist, they empirically underperform Transformers in pretraining efficiency and downstream task accuracy. We introduce Megalodon, a neural architecture for efficient sequence modeling with unlimited context length. Megalodon inherits the architecture of Mega (exponential moving average with gated attention), and further introduces multiple technical components to improve its capability and stability, including complex exponential moving average (CEMA), timestep normalization layer, normalized attention mechanism and pre-norm with two-hop residual configuration. In a controlled head-to-head comparison with Llama2, Megalodon achieves better efficiency than Transformer in the scale of 7 billion parameters and 2 trillion training tokens. Megalodon reaches a training loss of 1.70, landing mid-way between Llama2-7B (1.75) and 13B (1.67). Code: https://github.com/XuezheMax/megalodon

Former Secretary of State Hillary Clinton took a swipe at voters "upset" by the forthcoming rematch between President Biden and former President Trump during her appearance on "The Tonight Show." Hillary Clinton reacted to a recent ruling in Arizona, which bans abortion in nearly all circumstances, calling it "cruelty" during an interview with Kelly Clarkson and encouraging Americans to vote in a way that would "make life better" for the largest number of people. "I feared it would happen but I hoped it wouldn't happen. Now here we are in the middle of this very difficult period for women in about half the states in our country, who cannot get the care that they need. And the old law in Arizona is without exceptions and the danger to women's lives as well as to our right to make our own decisions about our bodies and ourselves is so profound," Clinton said during the interview with Clarkson on "The Kelly Clarkson Show."

How to Do It is Slate's sex advice column. Send it to Jessica and Rich here. I'm (35F) very interested in having a threesome and have been working the apps to try to find the right person to help make this happen. I've had a few bites. I was sexting with one guy for days on end about our joint fantasy of making this happen, and I found a second guy, who said he'd like to join us.

Sen. Fetterman said he disagreed with President Biden's decision to keep the U.S. out of any offensive response to the Iran attacks on Sunday during an interview with CNN. Sen. John Fetterman, D-Pa., said he didn't agree with President Biden on his stance that the U.S. wouldn't join in an offensive operation against Iran during an interview on Sunday, saying he would never "capitulate to the fringe" of his party. CNN host Jake Tapper asked Fetterman to respond to reports that Biden told Israeli Prime Minister Benjamin Netanyahu that the U.S. wouldn't participate in any offensive operations against Iran during a conversation on Saturday. "Do you think that's the right call or should direct U.S. military action, as some of your colleagues in the Senate are suggesting, should that be on the table?" he asked. "I don't agree with that, I just think we should follow and have Israel's back in the situation. I don't agree with the president. I'm proud to stand with him and campaign for him and vote for him," he responded.

In this study, we employ a classification approach to show that different categories of literary "quality" display unique linguistic profiles, leveraging a corpus that encompasses titles from the Norton Anthology, Penguin Classics series, and the Open Syllabus project, contrasted against contemporary bestsellers, Nobel prize winners and recipients of prestigious literary awards. Our analysis reveals that canonical and so called high-brow texts exhibit distinct textual features when compared to other quality categories such as bestsellers and popular titles as well as to control groups, likely responding to distinct (but not mutually exclusive) models of quality. We apply a classic machine learning approach, namely Random Forest, to distinguish quality novels from "control groups", achieving up to 77\% F1 scores in differentiating between the categories. We find that quality category tend to be easier to distinguish from control groups than from other quality categories, suggesting than literary quality features might be distinguishable but shared through quality proxies.

In London last night, the 20th Bafta games awards celebrated a year that was stacked with critically acclaimed games. Taking place against the backdrop of an unprecedented year of layoffs and studio closures in the gaming industry, acknowledged by Bafta chair Sara Putt in her speech at the beginning of the evening, it was a much-needed night of recognition of the creative efforts of the video game development community. The sprawling Dungeons & Dragons-inspired role-playing game Baldur's Gate 3 won five awards, including the public voted EE players' choice award and best game, alongside music, narrative and best performer in a supporting role (won by Andrew Wincott for his role at the devilish Raphael). Nintendo picked up the family and multiplayer awards for the exuberant Super Mario Bros Wonder, and technical achievement for The Legend of Zelda: Tears of the Kingdom. Alan Wake 2, the arresting, idiosyncratic horror game from Finnish studio Remedy, won artistic achievement and audio achievement.

The Knowledge Graph Entity Typing (KGET) task aims to predict missing type annotations for entities in knowledge graphs. Recent works only utilize the \textit{\textbf{structural knowledge}} in the local neighborhood of entities, disregarding \textit{\textbf{semantic knowledge}} in the textual representations of entities, relations, and types that are also crucial for type inference. Additionally, we observe that the interaction between semantic and structural knowledge can be utilized to address the false-negative problem. In this paper, we propose a novel \textbf{\underline{S}}emantic and \textbf{\underline{S}}tructure-aware KG \textbf{\underline{E}}ntity \textbf{\underline{T}}yping~{(SSET)} framework, which is composed of three modules. First, the \textit{Semantic Knowledge Encoding} module encodes factual knowledge in the KG with a Masked Entity Typing task. Then, the \textit{Structural Knowledge Aggregation} module aggregates knowledge from the multi-hop neighborhood of entities to infer missing types. Finally, the \textit{Unsupervised Type Re-ranking} module utilizes the inference results from the two models above to generate type predictions that are robust to false-negative samples. Extensive experiments show that SSET significantly outperforms existing state-of-the-art methods.

This paper proposes a test to perform Thematic Analysis (TA) with Large Language Model (LLM) on data which is in a different language than English. While there has been initial promising work on using pre-trained LLMs for TA on data in English, we lack any tests on whether these models can reasonably perform the same analysis with good quality in other language. In this paper a test will be proposed using an open access dataset of semi-structured interviews in Italian. The test shows that a pre-trained model can perform such a TA on the data, also using prompts in Italian. A comparative test shows the model capacity to produce themes which have a good resemblance with those produced independently by human researchers. The main implication of this study is that pre-trained LLMs may thus be suitable to support analysis in multilingual situations, so long as the language is supported by the model used.