local ai
AI subscriptions are the electric bill. Your PC is the solar panel
When you purchase through links in our articles, we may earn a small commission. AI subscriptions are the electric bill. You're always going to pay for cloud AI, so why not invest in yourself? The AI pendulum has swung back and forth throughout the last few years, from ChatGPT and Copilot in the cloud, then back to local AI and the PC's newfound NPU, then back to independent agents like Claude. Now it's headed the way of the PC once again, abandoning privacy arguments (which still stand strong!) for a more straightforward argument: It's better for your wallet.
Apple's new Mac minis are primed for local AI. I specced one for 2,899
When you purchase through links in our articles, we may earn a small commission. Apple's new Mac minis are primed for local AI. Apple's new M6 and M5 Pro Mac minis promise big local AI gains, but RAM limits and no CUDA support come with real trade-offs. The Mac mini became the surprise local AI hero earlier this year, packing a relatively large pool of RAM into a small, always-on, reasonably affordable form factor that was catnip for OpenClaw AI users. Since then, both AMD and Nvidia have teed up their own AI-centric Mac mini rivals, with AMD's Ryzen AI Halo and Nvidia's RTX Spark-powered systems serving up beefy processors and gobs of unified memory.
Portable Computer is Perplexity's new local AI agent - why it's a game changer
I wore the world's first HDR10 smart glasses TCL's new E Ink tablet beats the Remarkable and Kindle Anker's new charger is one of the most unique I've ever seen I wore the world's first HDR10 smart glasses TCL's new E Ink tablet beats the Remarkable and Kindle Anker's new charger is one of the most unique I've ever seen Portable Computer is Perplexity's new local AI agent - why it's a game changer Running an AI model locally, Perplexity's new Portable Computer can deliver faster performance, tighter security, and lower costs. But it has some strict requirements. Perplexity's new agentic Portable Computer runs AI locally. Local AI is faster and cheaper than cloud-based models. But you'll need some beefy hardware for Linux or Windows.
What else can AI do? 7 uses beyond chatbots and image generation
When you purchase through links in our articles, we may earn a small commission. What else can AI do? 7 uses beyond chatbots and image generation You can do a lot with local AI, especially on a gaming PC with a powerful graphics card. While cloud-based AI solutions are all the rage, local AI tools are more powerful than ever. Your gaming PC can do a lot more with AI than just run large language models in LM Studio and generate images with Stable Diffusion and unlike with cloud-based AI tools, you maintain full control over your data and have complete privacy. Here's a taste of the cool AI stuff you can do on a desktop PC right now.
The great NPU failure: Two years later, local AI is still all about GPUs
When you purchase through links in our articles, we may earn a small commission. Local AI tools are more powerful than ever, but most of the magic ain't happening on NPUs--much to Microsoft's disappointment, I'm sure. For the last few years, the term "AI PC" has basically meant little more than "a lightweight portable laptop with a neural processing unit (NPU) ." Today, two years after the glitzy launch of NPUs with Intel's Meteor Lake hardware, these AI PCs still feel like glorified tech demos. But local AI is here!
Scalable Coordinated Learning for H2M/R Applications over Optical Access Networks (Invited)
--One of the primary research interests adhering to next-generation fiber-wireless access networks is human-to-machine/robot (H2M/R) collaborative communications facilitating Industry 5.0. This paper discusses scalable H2M/R communications across large geographical distances that also allow rapid onboarding of new machines/robots as 72% training time is saved through global-local coordinated learning. In recent years, several inter-disciplinary technical paradigms like cyber-physical systems, Industrial IoT, robotics, big data, cloud/edge and cognitive computing, and virtual/augmented reality (VR/AR) have received significant attention from both industry and academia. The primary reason behind this development is the inclusion of industry vertical scenarios like Industry 4.0 in the fifth and beyond-fifth generation mobile technologies [1]. Although Industry 4.0 primarily involved connectivity among cyber-physical systems, Industry 5.0 will focus on the "human and machine/robots/cobots" relationship [2] to ensure real-time monitoring of products' condition, use, and the environment through sensors and external data sources, dynamic control of product functions and personalized user experience through embedded software in the products, optimization of use and performance of products, and autonomous delivery of products through coordinated operations with other products and systems.
The PC industry is losing the argument for local AI
It's not enough to champion AI hardware that supports local large language models, generative AI, and the like. Hardware vendors need to step up and serve as a middleman -- if not an outright developer -- for those local AI apps, too. At MWC 2024 (formerly known as Mobile World Congress, aka one of the world's largest mobile trade shows), the company this week announced a Qualcomm AI Hub, a repository of more than 75 AI models specifically optimized for Qualcomm and Snapdragon platforms. Qualcomm also showed off a seven-billion-parameter local LLM, running on a (presumably Snapdragon-powered) PC, that can accept audio inputs. Finally, Qualcomm demonstrated an additional seven-billion-parameter LLM running on Snapdragon phones.
Mythic: Pushing AI into Newer Territories
Mike Henry, CEO One cannot possibly miss all the hype and recognition around artificial intelligence (AI) these days. AI has percolated deep into our everyday lives in ways we cannot fathom. Even for most of the tech-savvy millennials, the AI experience is not defined by complex algorithms, huge computing power, or advanced analytical methods. Instead, it sounds like the voice of a smart speaker that responds to weather-related queries or tunes into a podcast. The truth is, the potential for a "digital me" resides in every device.