The increasing sizes of large language models (LLMs) result in significant computational overhead and memory usage when adapting these models to specific tasks or domains. Various parameter-efficient fine-tuning (PEFT) methods have been devised to mitigate these challenges by training a small set of parameters for the task-specific updates of the model weights. Among PEFT methods, LoRA stands out for its simplicity and efficiency, inspiring the development of a series of variants. However, LoRA and its successors disregard the knowledge that is noisy or irrelevant to the targeted task, detrimentally impacting model performance and leading to suboptimality. To address this limitation, we introduce Knowledge-aware Singular-value Adaptation (KaSA), a PEFT method that leverages singular value decomposition (SVD) with knowledge-aware singular values to dynamically activate knowledge based on its relevance to the task at hand. We conduct extensive experiments across a range of LLMs on tasks spanning natural language understanding (NLU), generation (NLG), instruction following, and commonsense reasoning. The experimental results demonstrate that KaSA consistently outperforms FFT and 14 popular PEFT baselines across 16 benchmarks and 4 synthetic datasets, underscoring our method's efficacy and adaptability. The source code of our method is available at https://github.com/juyongjiang/KaSA.

This smart lightbulb from Kasa requires no hub or special equipment to operate. Set timers, on/off schedules, and fully adjust the brightness from 1-100% using an app, or with your voice though Amazon Alexa or Google Assistant. The list price on this bulb is 16.99, but right now on Amazon you can buy it for just 7.99, the lowest price in over a year. That's a great deal if you're looking to add some basic automation to the lights inside your home, or outside on a porch. The 53% discount is active on Amazon right now (see it here), where the bulb gets 4.5 out of 5 stars from nearly 15,000 reviewers.

Something tells me TP-link has been taking note of the best and worst the market has to offer, because the KC120 (available at Amazon for $130) is surprisingly refined for a new product, boasting advanced features, a clean and speedy app, and integration with Amazon's Echo Show smart speaker and display. The Kasa Cam is controlled by the same Kasa app used for TP-Link's other smart home products. These typically include buttons for taking screenshots, manually recording a video clip, muting the audio, and activating the camera's mic. You can pair the Kasa Cam with Amazon's Echo Show and use the latter to view your camera feed.