TemporalLatentBottleneck

It also tends towards high capacity storage of all pieces of information which may be relevant for future reasoning [42, 3, 4]. By contrast, longterm memory changes slowly [45, 41], is highly selective and involves repeated consolidation. It contains a set of memories that summarize the entire past, only storing details about observations whicharemostrelevant[28,6]. Deep Learning has seen a variety of architectures for processing sequential data [36, 57, 18].