Key Info

Hugging Face is bringing RL environments from frameworks like OpenEnv, Verifiers, Harbor, and NeMo Gym onto the Hub, creating a common place to discover environments regardless of framework.

Highlights

  • Previously each RL framework had its own discovery mechanism: custom hubs, runtime registries, or GitHub lists with custom loaders
  • Publishing for one framework meant users of other frameworks couldn't load the environment
  • The Hub now aims to be a shared home for RL environments across frameworks