Distral: Robust Multitask Reinforcement Learning

This paper presents a new approach for joint training of multiple tasks, which is referred to as Distral (Distill & transfer learning). Instead of sharing parameters between the different workers, the authors propose to share a "distilled" policy that captures common behavior across tasks.