How to define new task ?

We would like to simulate a custom robotic manipulation task environment and then use it in a reinforcement learning framework.
It is possible to use dm_control components to do that and is there any guidelines on how to proceed ?