Large Language Model
Relational Context Learning for Human-Object Interaction Detection
Kim, Sanghyun, Jung, Deunsol, Cho, Minsu
Recent state-of-the-art methods for HOI detection typically build on transformer architectures with two decoder branches, one for human-object pair detection and the other for interaction classification. Such disentangled transformers, however, may suffer from insufficient context exchange between the branches and lead to a lack of context information for relational reasoning, which is critical in discovering HOI instances. In this work, we propose the multiplex relation network (MUREN) that performs rich context exchange between three decoder branches using unary, pairwise, and ternary relations of human, object, and interaction tokens. The proposed method learns comprehensive relational contexts for discovering HOI instances, achieving state-of-the-art performance on two standard benchmarks for HOI detection, HICO-DET and V-COCO.
DoNotPay says it's pivoting from plans to argue speeding tickets in court with AI
DoNotPay says it is pivoting away from plans to bring AI to a courtroom. DoNotPay, which bills itself as "the world's first robot lawyer," said last month that it planned to take on two speeding ticket cases in court in February, with its AI instructing the defendants how to respond to their assigned judges. The startup said it would cover any fines and the defendants will be compensated for taking part in the experiment. But CEO and founder Joshua Browder announced late last month that it would be "postponing" those plans, citing "threats from State Bar prosecutors." "Ultimately, it seemed like a distraction from using chatGPT technology to help with consumer rights issues," Browder said in an emailed statement. "We have decided to focus on consumer rights products, where we are very successful.
Coding with ChatGPT (GPT-3.5 and GPT-4) --A Quick Guide
Given the new oracle that is ChatGPT, you may often find yourself tasked with creating prompts for various applications. One of the most significant challenges in this regard is crafting prompts that effectively communicate your requirements and elicit the desired response. In this article, I will provide a comprehensive guide on how to write high-quality prompts for software development, specifically for the ChatGPT language model. Our aim is to help you improve your skills as a prompt engineer, moving beyond generic advice and offering practical tips and examples. To create effective prompts, it is essential to understand the AI language model you are working with.
What is the true potential impact of artificial intelligence on cybersecurity?
Will artificial intelligence become clever enough to upend computer security? AI is already surprising the world of art by producing masterpieces in any style on demand. If AIs can act like a bard while delivering the comprehensive power of the best search engines, why can't they shatter security protocols, too? The answers are complex, rapidly evolving, and still murky. AI makes some parts of defending computers against attack easier.
With a wave of new LLMs, open source AI is having a moment -- and a red-hot debate
Join top executives in San Francisco on July 11-12, to hear how leaders are integrating and optimizing AI investments for success. The open source technology movement has been having a moment over the past few weeks thanks to AI -- following a wave of recent large language model (LLM) releases and an effort by startups, collectives and academics to push back on the shift in AI to closed, proprietary LLMs. State-of-the-art LLMs require huge compute budgets โ OpenAI reportedly used 10,000 Nvidia GPUs to train ChatGPTโ and deep ML expertise, so few organizations can train them from scratch. Yet, increasingly, those that have the resources and expertise are not opening up their models -- the data, source code, or deep learning's secret sauce, the model weights -- to public scrutiny, relying on API distribution instead. That is where open source AI is stepping into the void to democratize access to LLMs.
AI, ChatGPT and Identity Security's Critical Human Element
In 1999, a far-fetched movie about a dystopia run by intelligent machines captured our imaginations (and to this day, remains my favorite film). Twenty-four years later, the line between fact and fiction has all but vanished and the blockbuster hits much differently. Are we entering the Matrix? Are we already in it? While robot overlords haven't materialized (yet), modern life is inseparable from artificial intelligence (AI) and machine learning (ML).
Majed Madamani on LinkedIn: #chatgpt4 #chatgpt #ai #artificialintelligence #blockchain #ethereumโฆ
CryptoGPT recently rolled out AI assistant "Alex" and is developing its ZK rollup layer 2 blockchain and a data-to-AI engine, which collects, encrypts and transfers data for commercial applications. Zero-knowledge (ZK) layer 2 blockchain CryptoGPT has cashed in on the recent surge in interest around artificial intelligence (AI) to raise $10 million in funding. The Series A round, which was led by market maker DWF Labs โ which has emerged as one of the most active investors during the crypto bear market โ gave the AI-focused blockchain a $250 million valuation, according to a statement. CryptoGPT recently rolled out Web3-focused AI assistant "Alex" and is developing its ZK rollup layer 2 blockchain and a data-to-AI engine, which collects, encrypts and transfers data for commercial applications. "Instead of applying ZK technology to payments, CryptoGPT integrates it for private data transfers," CryptoGPT said in the statement on Monday. The proceeds of the new funding will be used to grow its developer team globally and build on its regional presence in the Asian markets, said Dejan Erja, co-founder and chief technology officer of the AI-focused blockchain.
Google's CoLT5 Processes Extremely Long Inputs via Conditional Computation
One of the highlights of OpenAI's GPT-4 large language model (LLM) is its expanded context window size of 32,000 tokens (about 25,000 words), which enables longer input sequences and conversations than ChatGPT's 4,000 token limit. While expanding the processing capacities of transformer-based LLMs in this way is beneficial, it is also computationally costly due to the quadratic complexity of the models' attention mechanisms and the application of feedforward and projection layers to every token. A Google Research team addresses this issue in the new paper CoLT5: Faster Long-Range Transformers with Conditional Computation, proposing CoLT5 (Conditional LongT5), a family of transformer models that apply a novel conditional computation approach for higher quality and faster long-input processing of up to 64,000 tokens. CoLT5 is built on Google's LongT5 (Gua et al., 2022), which simultaneously scales input length and model size to improve long-input processing in transformers; and is inspired by the idea that better performance and reduced computation cost can be achieved via a novel "conditional computation" approach that allocates more computation to important tokens. The conditional computation mechanism comprises three main components: 1) Routing modules, which select important tokens at each attention or feedforward layer; 2) A conditional feedforward layer that applies an additional high-capacity feedforward layer to select important routed tokens; and 3) A conditional attention layer that enables CoLT5 to differentiate between tokens that require additional information and those that already possess such information.
What ChatGPT's "iPhone Moment" Looks Like
This article is from Big Technology, a newsletter by Alex Kantrowitz. Now that chatbots from OpenAI and Microsoft have demonstrated generative A.I.'s value, companies are running to build on their APIs. Soon you'll be able to generate recipes within ChatGPT and have it add the ingredients to Instacart. Or have it find restaurant reservations with help from OpenTable. Or discover flights with Kayak.
Scientist claims humans will be able to upload consciousness onto computer by the end of this YEAR
A computer scientist is urging the world to record their elderly parents and loved ones as he predicts consciousness could be uploaded onto a computer this year. Dr Pratik Desai, who has founded multiple Silicon Valley AI startups, said that if people have enough video and voice recorders of their loved ones, there is a '100 percent chance' of relatives'living with you forever.' Desai, who has created his own ChatGPT-like system, wrote on Twitter: 'This should be even possible by end of the year.' Many scientists believe the rapid advancements in AI, which ChatGPT is spearheading, are poised to usher in a new golden era for technology. However, the world's greatest minds are split on the technology - Elon Musk and more than 1,000 tech leaders are calling for a pause, warning it could destroy humanity. On the other side are other experts, like Bill Gates, who believe AI will improve our lives - and it seems other experts are on board with the idea it will help us live on forever.