We introduce ControlVAE, a novel model-based framework for learning generative motion control policies, which learns flexible skill embeddings for motion generation and downstream tasks.