As large language models (LLMs) tackle increasingly complex tasks and longer documents, their computational and memory costs during inference become a major bottleneck. To address this, we propose PromptDistill, a novel, training-free method that improves inference efficiency while preserving generation quality. PromptDistill identifies and retains the most informative tokens by leveraging attention interactions in early layers, preserving their hidden states while reducing the computational burden in later layers. This allows the model to focus on essential contextual information without fully processing all tokens. Unlike previous methods such as H2O and SnapKV, which perform compression only after processing the entire input, or GemFilter, which selects a fixed portion of the initial prompt without considering contextual dependencies, PromptDistill dynamically allocates computational resources to the most relevant tokens while maintaining a global awareness of the input. Experiments using our method and baseline approaches with base models such as LLaMA 3.1 8B Instruct, Phi 3.5 Mini Instruct, and Qwen2 7B Instruct on benchmarks including LongBench, InfBench, and Needle in a Haystack demonstrate that PromptDistill significantly improves efficiency while having minimal impact on output quality compared to the original models. With a single-stage selection strategy, PromptDistill effectively balances performance and efficiency, outperforming prior methods like GemFilter, H2O, and SnapKV due to its superior ability to retain essential information. Specifically, compared to GemFilter, PromptDistill achieves an overall $1\%$ to $5\%$ performance improvement while also offering better time efficiency. Additionally, we explore multi-stage selection, which further improves efficiency while maintaining strong generation performance.

With the launch of the Mini 4 Pro, DJI has nailed the recipe for producing premium-level ultralight drones. It comes just 18 months after the superb Mini 3 Pro, but with significant tweaks to the image processing and obstacle avoidance tech, it's undeniably the one to beat. At under 250 grams in weight, it's free from many of the rules and regulations that apply to larger models. In the USA there's no need to register it with the FAA for recreational use, while in the UK (a notoriously difficult place to fly drones), it can be flown pretty freely in public areas. Here in the UK, finding a sub-250 gram drone is critical for most amateur pilots.

Amazon's bid for AI glory is in the billions. It's investing up to $4 billion in OpenAI rival Anthropic to provide advanced deep learning and other services for its Amazon Web Services (AWS) customers. Google has already invested $400 million in the company, which was founded by former OpenAI executives. Anthropic recently unveiled its first consumer-facing chatbot Claude 2, accessible by subscription much like OpenAI's ChatGPT. The Claude Constitutional AI system is guided by 10 "foundational" principles of fairness and autonomy and is supposed to be harder to trick than other AI. Anthropic is already working on a chatbot it calls Claude-Next, which is supposed to be 10 times more powerful than any current AI.

Last year, DJI showed what was possible in a small drone with the Mini 3 Pro by fitting tons of technology and a high-quality camera into a sub-250 gram drone. Following that up was never going to be easy, but now (after numerous leaks) it's unveiled the Mini 4 Pro with a long list of new features. Aside from one improvement, the camera is largely the same. However, it has new omnidirectional obstacle sensors that eliminate the blind spots on the Mini 3 Pro. It also comes with a new feature called ActiveTrack 360 that lets you program camera moves when tracking a subject.

If you're looking for a camera (or drone) for content creation, travel photography and more, Amazon Prime Day has some great deals, including rare sales on popular models. For example, Sony's latest A7 IV model is on sale for the first time at $2,400, or $2,600 with a 28-70mm kit lens -- saving you $100 on each. DJI, which doesn't often discount its popular drones, is selling the Mini 3 Pro with DJI RC remote for $729. Meanwhile, Canon is selling its R50 creator's kit for $850 for a savings of $150, Panasonic has its full frame Lumix S5 on sale with two lenses (including a prime) for $1,700 (40 percent off) and OM System is selling the OM-D E-M1 Mark III mirrorless camera for just $1,300, for an impressive $500 discount. There are plenty of other deals as well, and if you don't find what you want at Amazon, some of the products come with the same discount elsewhere.

When it launched last year, the DJI Mavic 3 grabbed a lot of headlines with features like a big Four Thirds sensor and a second 7X telephoto camera. But it also drew some criticism for going on sale with key features like ActiveTrack and QuickShots still not available. That meant that I and others couldn't assess those features in our early Mavic 3 reviews. And because of that, potential buyers couldn't get a full picture of the drone before paying up to $5,000 for one. Following three major firmware updates in December, January and May, all the promised functions and more are finally here. Now, I'm going to test them out using the same exact drone to see how well they work.

With every release, DJI seems to pack more features into smaller and smaller drones. The Mavic 3 that launched last year was a relatively small drone with a mirrorless camera sensor, pro video quality and more. Now, it has brought a lot of that technology to an even tinier drone, the Mini 3 Pro. At 249 grams (8.8 ounces), the Mini 3 Pro is light enough to avoid most drone regulations. But DJI has managed to fit in a sensor larger than most smartphones, and it can detect obstacles all around.