Skip to content

arcade-learning-environment 0.11.0 #221507

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

BrewTestBot
Copy link
Member

@BrewTestBot BrewTestBot commented Apr 26, 2025

Created by brew bump


Created with brew bump-formula-pr.

  • resource blocks have been checked for updates.
release notes
This release adds (an experiment) built-in vectorisation environment, available through `gymnasium.make_vec("ALE/{game_name}-v5", num_envs)` or `ale_py.AtariVectorEnv("{rom_name}", num_envs)`.
import gymnasium as gym
import ale_py

gym.register_envs(ale_py)

envs = gym.make_vec("ALE/Pong-v5")
observations, infos = envs.reset()

for i in range(100):
  actions = envs.action_space.sample()
  observations, rewards, terminations, truncations, infos = envs.step(actions)

envs.close()

Vectorisation is a crucial feature of RL to help increase the sample rate of environments through sampling multiple sub-environments at the same time.
Gymnasium provides a generalised vectorisation capability, however, is relatively slow due its python implementation.
For faster implementations, EnvPool provide C++ vectorisation that significantly increase the sample speed but it no longer maintained.
Inspired by the EnvPool implementation, we've implemented an asynchronous vectorisation environment in C++, in particular, the standard Atari preprocessing including frame skipping, frame stacking, observation resizing, etc.

For full documentation of the vector environment, see this page.

We will continue building out this vectorisation to include XLA support, improved preprocessing and auto resetting.

As this is an experimental feature, we wish to hear about any bugs, problems or features to add. Raise an issue on GitHub or ask a question on the Farama Discord server.


@github-actions github-actions bot added python Python use is a significant feature of the PR or issue bump-formula-pr PR was created using `brew bump-formula-pr` labels Apr 26, 2025
@chenrui333 chenrui333 added the CI-no-fail-fast Continue CI tests despite failing GitHub Actions matrix builds. label Apr 26, 2025
@bevanjkay bevanjkay force-pushed the bump-arcade-learning-environment-0.11.0 branch 2 times, most recently from 0e4cc86 to 8c026f0 Compare April 26, 2025 12:57
@daeho-ro daeho-ro force-pushed the bump-arcade-learning-environment-0.11.0 branch from 8c026f0 to dadbec2 Compare April 27, 2025 12:54
@github-actions github-actions bot added the automerge-skip `brew pr-automerge` will skip this pull request label Apr 27, 2025
Copy link
Contributor

:shipit: @fxcoudert has requested bottles to be published to this PR.

Please do not push to this PR branch before the bottle commits have been pushed, as this results in a state that is difficult to recover from. If you need to resolve a merge conflict, please use a merge commit. Do not force-push to this PR branch.

Copy link
Contributor

⚠️ @fxcoudert bottle publish failed.

@fxcoudert fxcoudert force-pushed the bump-arcade-learning-environment-0.11.0 branch from dadbec2 to f8cfd94 Compare April 27, 2025 15:02
@fxcoudert
Copy link
Member

Actions got stuck :( trying again

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
automerge-skip `brew pr-automerge` will skip this pull request bump-formula-pr PR was created using `brew bump-formula-pr` CI-no-fail-fast Continue CI tests despite failing GitHub Actions matrix builds. python Python use is a significant feature of the PR or issue
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants