Energy Consumption Analysis Details

We show the theoretical energy consumption estimation method of the proposed Spike-driven Transformer in Table 1 of the main text. Compared to the vanilla Transformer counterpart, the spiking version requires information on timesteps T and spike firing rates (R). Therefore, we only need to evaluate the FLOPs of the vanilla Transformer, and T and R are known, we can get the theoretical energy consumption of spike-driven Transformer. FLConv = (kn)2 hn wn cn 1 cn, (S1) where kn is the kernel size, (hn,wn) is the output feature map size, cn 1 and cn are the input and output channel numbers, respectively. The FLOPs of the m-th MLP layer in ANNs are: FLMLP = im om, (S2) where im and om are the input and output dimensions of the MLP layer, respectively.