$\texttt{SEM-CTRL}$: Semantically Controlled Decoding