Goto

Collaborating Authors

 joanna


Evaluating Very Long-Term Conversational Memory of LLM Agents

Maharana, Adyasha, Lee, Dong-Ho, Tulyakov, Sergey, Bansal, Mohit, Barbieri, Francesco, Fang, Yuwei

arXiv.org Artificial Intelligence

Existing works on long-term open-domain dialogues focus on evaluating model responses within contexts spanning no more than five chat sessions. Despite advancements in long-context large language models (LLMs) and retrieval augmented generation (RAG) techniques, their efficacy in very long-term dialogues remains unexplored. To address this research gap, we introduce a machine-human pipeline to generate high-quality, very long-term dialogues by leveraging LLM-based agent architectures and grounding their dialogues on personas and temporal event graphs. Moreover, we equip each agent with the capability of sharing and reacting to images. The generated conversations are verified and edited by human annotators for long-range consistency and grounding to the event graphs. Using this pipeline, we collect LoCoMo, a dataset of very long-term conversations, each encompassing 300 turns and 9K tokens on avg., over up to 35 sessions. Based on LoCoMo, we present a comprehensive evaluation benchmark to measure long-term memory in models, encompassing question answering, event summarization, and multi-modal dialogue generation tasks. Our experimental results indicate that LLMs exhibit challenges in understanding lengthy conversations and comprehending long-range temporal and causal dynamics within dialogues. Employing strategies like long-context LLMs or RAG can offer improvements but these models still substantially lag behind human performance.


Writing With Artificial Intelligence With Andrew Mayne

#artificialintelligence

What is GPT-3 and how can writers use it responsibly as part of their creative process? How can we approach AI tools with curiosity, rather than fear? In the intro, I mention the discussion about whether Google's language model, LaMDA, could be sentient [The Verge]; and the Alliance of Independent Authors Ethical Usage of AI tools. If you'd like to know more about using AI for writing, images, marketing, voice, translation, and more, check out my course, The AI-Assisted Author. Andrew Mayne is the multi-award-nominated and internationally best-selling author of thrillers. He invented an underwater stealth suit for shark diving, and he works with OpenAI as a science communicator. He also has books for authors, including, 'How to Write a Novella in 24 hours,' and a co-hosts the podcast'Weird Things.' You can find Andrew at www.AndrewMayne.com You can find GPT-3 on OpenAI.com. There are many tools built on top of GPT-3. I use and recommend Sudowrite for fiction, in particular. Joanna: Andrew Mayne is the multi-award-nominated and internationally best-selling author of thrillers. He invented an underwater stealth suit for shark diving, and he works with OpenAI as a science communicator. He also has books for authors, including, 'How to Write a Novella in 24 hours,' and a co-hosts the podcast'Weird Things.' Andrew: Hey, thank you for having me. Joanna: Oh, you do so many things. But we are actually going to talk about AI today. Andrew: Well, ever since I was a little boy, I was really interested in science, and entertainment, and everything in between. And I loved robots when I was a kid. And I'd build robots from science fairs and stuff, and I would use coffee cans, and little motors and things I pulled from toys to do that.


Writing Action Adventure Fiction And Systems Thinking With Nick Thacker

#artificialintelligence

The life of a full-time independent author involves wearing many hats. You have to balance your time between learning your craft and pleasing readers with great books, as well as publishing, book marketing, and building a business that will support you for the long-term. In today's interview, Nick Thacker talks about the key aspects of action-adventure thrillers as well as how he runs his publishing company and thoughts on pricing, email list building, and creating systems to avoid overwhelm. In the intro, The Hotsheet reports on the All about Audio conference, publishers start Storyglass, a new podcasting business [The Bookseller], The New York Times acquires a podcast production company [The Verge]; and Amazon Ad reports now incorporate page reads. In the futurist segment, GPT3 takes natural language generation to a new level -- what does this mean for writers? I also recommend The Inevitable by Kevin Kelly and his blog post, 1000 True Fans, and Homo Deus by Yuval Noah Harari. Today's show is sponsored by IngramSpark, who I use to print and distribute my print-on-demand books to 39,000 retailers including independent bookstores, schools and universities, libraries and more. Nick Thacker is the USA Today bestselling author of action-adventure thrillers. His non-fiction books for authors include Platform Mastery and BookBub Mastery. You can listen above or on your favorite podcast app or read the notes and links below. Here are the highlights and the full transcript is below. You can find Nick Thacker at NickThacker.com and on Twitter @NickThacker Joanna: Nick Thacker is the'USA Today' bestselling author of action-adventure thrillers. His nonfiction books for authors include Platform Mastery and BookBub Mastery. It's good to be here, it's good to be talking to you again. Joanna: It's great to have you on the show. Nick: I was late to get to writing. I grew up reading a lot and never really liked writing.


Joanna Penn: How Artificial Intelligence Will Cause A Seismic Shift In How We Produce And Discover Content Online

#artificialintelligence

Over the last decade I've been asked many times whether I think blogging will die, or will it be replaced by something else. Every time I was asked this question I replied that I believe the only way it could change is if how we consume content changes. As long as we humans like to read, listen and watch, and we use our eyes and ears to do so, I couldn't imagine anything changing. Unless technology reaches the point where we can download content directly to our brains like in the Matrix movies… which I don't see happening anytime soon! While my basic thesis remains the same – we continue to use our eyes and ears to read and listen to content – for the first time in a long time there is something on the horizon that is going to cause a fundamental shift.


Artificial Intelligence and the Indie Author with Joanna Penn and Orna Ross

#artificialintelligence

Every week, there are news reports on how AI will impact jobs, but what about the impact of AI on indie authors? Can we surf the change instead of being drowned by it? Could it make our lives better as creative entrepreneurs? I recently did a mega-solo podcast on 9 Ways that Artificial Intelligence Will Disrupt Authors and the Publishing Industry, and in this interview, Orna Ross interviews me about some of the specifics that might impact indie authors, in particular. The interview is on the Alliance of Independent Authors AskAlli Podcast feed. The interview starts after the introduction around 12:25 mins. Links and notes here and you can subscribe below. Click here to watch the interview on YouTube. But today we are going to talk about something that sounds maybe mysterious, sounds maybe scary for a lot of authors. But that you have been investing a lot of time and attention and you're hugely interested in and you're actually making work for you. And that is artificial intelligence. And our theme for today is really how can indie authors harness the power of AI? Where are we with it? What can it do for us? And on all things AI, you are our guru so I'm going to be quizzing you, but first, before we start on what it can do for us, what is it? Explain to the people, what are we talking about when we're talking about artificial intelligence?


Designing Responsible AI

#artificialintelligence

"Intelligence is central to everything humans do, and artificial intelligence should be no exception." With these words, Joanna Bryson urges for stronger professional standards for software engineers and experts designing intelligent-like systems. Joanna is a tenured associate professor at the University of Bath in the United Kingdom, where she founded the Bath Intelligence Systems group. She is one of the world's leading AI researchers, uniting the perspectives of computer science, psychology, and biology in her work. HBR Presents is a network of podcasts curated by HBR editors, bringing you the best business ideas from the leading minds in management.


AI And Creativity With Marcus Du Sautoy

#artificialintelligence

Marcus is the Simonyi Professor for the Public Understanding of Science at Oxford University, quite a mouthful.


How Near Are We To 'Robot Lawyers'? THINK Digital Partners

#artificialintelligence

Joanna Goodman is a freelance journalist and author. She is The Law Society Gazette's IT columnist and writes about tech for other publications including The Guardian. Her focus is emerging tech, including artificial intelligence (AI), connected devices and robots. She is a visiting scholar at University of Westminster Law School. As she is also the author of ones of the very first books on AI in the legal sector, we were fascinated by her views on just how worried lawyers should be when it comes to the impact of these technologies.


'Mr. Robot' Season 2, Episode 12 Spoilers: Phase 2 Revealed! 7 Top OMG Moments From USA Show's Season Finale

International Business Times

Robot" Season 2 has ended. The final episode was filled with answers, but many more questions were posed. In true Sam Esmail fashion, the episode was also filled with a lot of surprises. Here are some of the moments in "eps2.9_pyth0n-pt2.p7z" that cleared things up and shocked us. There had been speculations that it was Knowles (Brian Stokes Mitchell) who was sending Joanna Wellick (Stephanie Corneliussen) gifts. The theory looked more probable when Mr. Sutherland (Jeremy Holm) found out the address of the person calling Tyrell's (Martin Wallstrom) wife and said that it was impossible for his missing boss to be hiding there. Joanna confronted Knowles about sending her gifts. She then learned that Knowles just wanted to plant a seed of hope in Joanna and lead her on. Knowles also revealed that his wife, Sharon (Michele Hicks), was pregnant when Tyrell killed her. It has also been cleared up that Joanna was only using Derek (Chris Conroy) in order to make Tyrell appear innocent.


Apple's Siri: A Lot Smarter, But Still Kind of Dumb

WSJ.com: WSJD - Technology

Me: Siri, how are you tonight? Siri: I'm happy to be alive! Siri: OK, one option I see is Totto Ramen which averages 4 stars and is moderately priced. Looks like I'm going to be needing a Lyft. Siri: Lyft can be there in 6 minutes.