Sequential data collection has emerged as a widely adopted technique for enhancing the efficiency of data gathering processes. Despite its advantages, such data collection mechanism often introduces complexities to the statistical inference procedure.

TBAL is emerging as a widely-used solution in practice.

We argue that these properties are satisfied in many continuous state-action Markov decision processes.