shufflenet
Advancing Green AI: Efficient and Accurate Lightweight CNNs for Rice Leaf Disease Identification
Saddami, Khairun, Nurdin, Yudha, Zahramita, Mutia, Safiruz, Muhammad Shahreeza
Rice plays a vital role as a primary food source for over half of the world's population, and its production is critical for global food security. Nevertheless, rice cultivation is frequently affected by various diseases that can severely decrease yield and quality. Therefore, early and accurate detection of rice diseases is necessary to prevent their spread and minimize crop losses. In this research, we explore three mobile-compatible CNN architectures, namely ShuffleNet, MobileNetV2, and EfficientNet-B0, for rice leaf disease classification. These models are selected due to their compatibility with mobile devices, as they demand less computational power and memory compared to other CNN models. To enhance the performance of the three models, we added two fully connected layers separated by a dropout layer. We used early stop creation to prevent the model from being overfiting. The results of the study showed that the best performance was achieved by the EfficientNet-B0 model with an accuracy of 99.8%. Meanwhile, MobileNetV2 and ShuffleNet only achieved accuracies of 84.21% and 66.51%, respectively. This study shows that EfficientNet-B0 when combined with the proposed layer and early stop, can produce a high-accuracy model. Keywords: rice leaf detection; green AI; smart agriculture; EfficientNet;
Quantisation and Pruning for Neural Network Compression and Regularisation
Paupamah, Kimessha, James, Steven, Klein, Richard
Deep neural networks are typically too computationally expensive to run in real-time on consumer-grade hardware and low-powered devices. In this paper, we investigate reducing the computational and memory requirements of neural networks through network pruning and quantisation. We examine their efficacy on large networks like AlexNet compared to recent compact architectures: ShuffleNet and MobileNet. Our results show that pruning and quantisation compresses these networks to less than half their original size and improves their efficiency, particularly on MobileNet with a 7x speedup. We also demonstrate that pruning, in addition to reducing the number of parameters in a network, can aid in the correction of overfitting.
Building Efficient Deep Neural Networks with Unitary Group Convolutions
Zhao, Ritchie, Hu, Yuwei, Dotzel, Jordan, De Sa, Christopher, Zhang, Zhiru
We propose unitary group convolutions (UGConvs), a building block for CNNs which compose a group convolution with unitary transforms in feature space to learn a richer set of representations than group convolution alone. UGConvs generalize two disparate ideas in CNN architecture, channel shuffling (i.e. ShuffleNet) and block-circulant networks (i.e. CirCNN), and provide unifying insights that lead to a deeper understanding of each technique. We experimentally demonstrate that dense unitary transforms can outperform channel shuffling in DNN accuracy. On the other hand, different dense transforms exhibit comparable accuracy performance. Based on these observations we propose HadaNet, a UGConv network using Hadamard transforms. HadaNets achieve similar accuracy to circulant networks with lower computation complexity, and better accuracy than ShuffleNets with the same number of parameters and floating-point multiplies.
[R] [1707.01083] ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devices • r/MachineLearning
I am one of the authors of ShuffleNet. We've designed a new convolutional neural network structure for mobile platforms which utilizes pointwise group convolution and channel shuffle. Under the budget of 40MFLOPS, we've achieved 6.7% absolute top-1 error reduction on ImageNet classification compared to MobileNets. Empirically, our network with approximately the same error runs 13x faster than AlexNet on an ARM platform.