Goto

Collaborating Authors

 aquant


Efficient Adaptive Activation Rounding for Post-Training Quantization

arXiv.org Artificial Intelligence

Post-training quantization attracts increasing attention due to its convenience in deploying quantized neural networks. Although rounding-to-nearest remains the prevailing method for DNN quantization, prior research has demonstrated its suboptimal nature when applied to weight quantization. They propose optimizing weight rounding schemes by leveraging output error rather than the traditional weight quantization error. Our study reveals that similar rounding challenges also extend to activation quantization. Despite the easy generalization, the challenges lie in the dynamic nature of activation. Adaptive rounding is expected for varying activations and the method is subjected to runtime overhead. To tackle this, we propose the AQuant quantization framework with a novel perspective to reduce output error by adjusting rounding schemes of activations. Instead of using the constant rounding border 0.5 of the rounding-to-nearest operation, we make the border become a function w.r.t. the activation value to change the activation rounding by the adaptive border. To deal with the runtime overhead, we use a coarse-grained version of the border function. Finally, we introduce our framework to optimize the border function. Extensive experiments show that AQuant achieves notable improvements compared to state-of-the-art works and pushes the accuracy of ResNet-18 up to 60.31% under the 2-bit weight and activation quantization.


Aquant.io Announces $2.6M Seed Round, Bringing AI Into the World of Service to Solve the Multi-Billion-Dollar Downtime Problem

#artificialintelligence

Aquant, a New York City-based tech company, announced it has secured $2.6 million in seed funding from World Trade Ventures, SilverTech Ventures, AngeList Syndicate led by Gil Dibner, and a group of private investors in order to expand their customer base and accelerate development of the technology's abilities. Aquant, a rising name in the tech business ecosystem, has developed sophisticated AI and machine learning technology to addresses the multi-billion-dollar problem of machinery downtime that troubles service companies. The unique aspect of Aquant's technology is its ability to locate potential failures at levels that are difficult to be predicted by humans. Companies in the service industry have gotten used to paying a fortune on a yearly basis on machinery downtime and recurring technicians' visits, due to lack of technicians' skills and wrong stocking of parts. Aquant provides service companies with a permanent solution for this problem.