Goto

Collaborating Authors

 text-guided image classifier


Supplementary Material Hardware Resilience Properties of Text-Guided Image Classifiers This section contains supplementary material that provides additional details for the main paper and

Neural Information Processing Systems

Note that for error injection experiments, we perform single-bit flips only in the convolutional and linear layers of the neural network, in line with other work in this field. In this section, we provide visualizations of additional backbones. Figure 9 and Figure 10 extend from Figure 3 for more networks. The Y -axis shows the absolute value of the max neuron value observed per layer on the X-axis. Next, Figure 11 and Figure 12 are extensions for Figure 4, showcasing the impact of our proposed technique on the end-to-end network accuracy.


Hardware Resilience Properties of Text-Guided Image Classifiers

Neural Information Processing Systems

This paper presents a novel method to enhance the reliability of image classification models during deployment in the face of transient hardware errors. By utilizing enriched text embeddings derived from GPT-3 with question prompts per class and CLIP pretrained text encoder, we investigate their impact as an initialization for the classification layer. Our approach achieves a remarkable $5.5\times$ average increase in hardware reliability (and up to $14\times$) across various architectures in the most critical layer, with minimal accuracy drop ($0.3\%$ on average) compared to baseline PyTorch models. Furthermore, our method seamlessly integrates with any image classification backbone, showcases results across various network architectures, decreases parameter and FLOPs overhead, and follows a consistent training recipe. This research offers a practical and efficient solution to bolster the robustness of image classification models against hardware failures, with potential implications for future studies in this domain.


Hardware Resilience Properties of Text-Guided Image Classifiers

Neural Information Processing Systems

This paper presents a novel method to enhance the reliability of image classification models during deployment in the face of transient hardware errors. By utilizing enriched text embeddings derived from GPT-3 with question prompts per class and CLIP pretrained text encoder, we investigate their impact as an initialization for the classification layer. Our approach achieves a remarkable 5.5\times average increase in hardware reliability (and up to 14\times) across various architectures in the most critical layer, with minimal accuracy drop ( 0.3\% on average) compared to baseline PyTorch models. Furthermore, our method seamlessly integrates with any image classification backbone, showcases results across various network architectures, decreases parameter and FLOPs overhead, and follows a consistent training recipe. This research offers a practical and efficient solution to bolster the robustness of image classification models against hardware failures, with potential implications for future studies in this domain.


Hardware Resilience Properties of Text-Guided Image Classifiers

Neural Information Processing Systems

This paper presents a novel method to enhance the reliability of image classification models during deployment in the face of transient hardware errors. By utilizing enriched text embeddings derived from GPT-3 with question prompts per class and CLIP pretrained text encoder, we investigate their impact as an initialization for the classification layer. Our approach achieves a remarkable 5.5\times average increase in hardware reliability (and up to 14\times) across various architectures in the most critical layer, with minimal accuracy drop ( 0.3\% on average) compared to baseline PyTorch models. Furthermore, our method seamlessly integrates with any image classification backbone, showcases results across various network architectures, decreases parameter and FLOPs overhead, and follows a consistent training recipe. This research offers a practical and efficient solution to bolster the robustness of image classification models against hardware failures, with potential implications for future studies in this domain.