Goto

Collaborating Authors

 rass


FF-SRL: High Performance GPU-Based Surgical Simulation For Robot Learning

arXiv.org Artificial Intelligence

Robotic surgery is a rapidly developing field that can greatly benefit from the automation of surgical tasks. However, training techniques such as Reinforcement Learning (RL) require a high number of task repetitions, which are generally unsafe and impractical to perform on real surgical systems. This stresses the need for simulated surgical environments, which are not only realistic, but also computationally efficient and scalable. We introduce FF-SRL (Fast and Flexible Surgical Reinforcement Learning), a high-performance learning environment for robotic surgery. In FF-SRL both physics simulation and RL policy training reside entirely on a single GPU. This avoids typical bottlenecks associated with data transfer between the CPU and GPU, leading to accelerated learning rates. Our results show that FF-SRL reduces the training time of a complex tissue manipulation task by an order of magnitude, down to a couple of minutes, compared to a common CPU/GPU simulator. Such speed-up may facilitate the experimentation with RL techniques and contribute to the development of new generation of surgical systems. To this end, we make our code publicly available to the community.


Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients

arXiv.org Artificial Intelligence

Large language model (LLM) training and finetuning are often bottlenecked by limited GPU memory. While existing projection-based optimization methods address this by projecting gradients into a lower-dimensional subspace to reduce optimizer state memory, they typically rely on dense projection matrices, which can introduce computational and memory overheads. In this work, we propose Grass (GRAdient Stuctured Sparsification), a novel approach that leverages sparse projections to transform gradients into structured sparse updates. This design not only significantly reduces memory usage for optimizer states but also minimizes gradient memory footprint, computation, and communication costs, leading to substantial throughput improvements. Extensive experiments on pretraining and finetuning tasks demonstrate that Grass achieves competitive performance to full-rank training and existing projection-based methods. Notably, Grass enables half-precision pretraining of a 13B parameter LLaMA model on a single 40GB A100 GPU--a feat infeasible for previous methods--and yields up to a $2\times$ throughput improvement on an 8-GPU system. Code can be found at https://github.com/aashiqmuhamed/GRASS .


Amanda, The money Token AI Assistant Will deliver Blockchain Backed Loans to the Crypto group.

#artificialintelligence

One problem is that spending crypto belongings prevents these holders from enjoying the abilities future benefits of their investments. These crypto belongings should be held so as to mature and present benefits to their holders. MoneyToken is a platform that makes it possible for people to borrow liquid cash straight, in keeping with the cost of their crypto property. After repaying your personal loan in full, you receive the collateral returned; although it has elevated in value. It offers an outstanding option to purchase liquid cash (in the variety of solid cash or fiat currency), without needing to sell your crypto property, all whereas nevertheless enjoying the expertise growth of your funding.