$\Texttt{SEM-CTRL}$: Semantically Controlled Decoding