DeepMind DiscoRL Meta Learning Update Rule Ported from JAX to PyTorch

A developer has ported DeepMind's DiscoRL meta learning update rule from JAX to PyTorch. The work is based on the 2025 Nature article about DiscoRL, which stands for 'Distributed Compositional Reinforcement Learning'—a meta-learning approach for training agents that can quickly adapt to new tasks.

Implementation Details

The port includes a complete implementation available on GitHub at https://github.com/asystemoffields/disco-torch. The repository contains:

• A Colab notebook for experimentation
• An API for using the implementation
• Pre-trained weights hosted on Hugging Face

The developer used Claude Code to assist with the porting process from JAX to PyTorch. This type of translation work is common in the ML community when researchers want to make implementations available in different frameworks or when they prefer working with one framework over another.

Meta-learning approaches like DiscoRL are designed to enable agents to learn new tasks quickly by leveraging prior experience. The 'update rule' refers to the mathematical formulation of how the agent's policy or value function is adjusted during learning. Porting such implementations allows PyTorch users to experiment with these techniques without needing to work in JAX.