Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

RecurrentPPO: 9x speedup - whole sequence batching #118

Draft
wants to merge 28 commits into
base: master
Choose a base branch
from
Draft

RecurrentPPO: 9x speedup - whole sequence batching #118

wants to merge 28 commits into from

Commits on Nov 12, 2022

  1. added whole sequence batching functionality to PPORecurrent

    @b-vm
    b-vm committed Nov 12, 2022
    Configuration menu
    Copy the full SHA
    6467c79 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2022

  1. added masking and fixed some bugs

    @b-vm
    b-vm committed Nov 14, 2022
    Configuration menu
    Copy the full SHA
    ff8cb9d View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2022

  1. implemented for non dict obs + fixed bugs + added basic script showin… 

    …g speed improvement
    @b-vm
    b-vm committed Nov 23, 2022
    Configuration menu
    Copy the full SHA
    cfc0f70 View commit details
    Browse the repository at this point in the history

Commits on Nov 28, 2022

  1. bug fix episode starts after first update

    @b-vm
    b-vm committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    8b60954 View commit details
    Browse the repository at this point in the history

  2. updated testing script

    @b-vm
    b-vm committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    59f4a7a View commit details
    Browse the repository at this point in the history

  3. fixed NaNs due to supersmall batch sizesoccurring in edge case by dro… 

    …pping those batches
    @b-vm
    b-vm committed Nov 28, 2022
    Configuration menu
    Copy the full SHA
    9196049 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' into sequence_batching

    @araffin
    araffin authored Nov 28, 2022
    Configuration menu
    Copy the full SHA
    a74be36 View commit details
    Browse the repository at this point in the history

Commits on Dec 16, 2022

  1. Merge branch 'master' into sequence_batching

    @araffin
    araffin authored Dec 16, 2022
    Configuration menu
    Copy the full SHA
    0f5a0f7 View commit details
    Browse the repository at this point in the history

Commits on Jan 8, 2023

  1. Merge branch 'master' of https://github.com/Stable-Baselines-Team/sta… 

    …ble-baselines3-contrib into Stable-Baselines-Team-master
    @b-vm
    b-vm committed Jan 8, 2023
    Configuration menu
    Copy the full SHA
    f445d4d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'Stable-Baselines-Team-master' into sequence_batching

    @b-vm
    b-vm committed Jan 8, 2023
    Configuration menu
    Copy the full SHA
    b83d5f8 View commit details
    Browse the repository at this point in the history

  3. refactoring, made code simpler.

    @b-vm
    b-vm committed Jan 8, 2023
    Configuration menu
    Copy the full SHA
    d3af84d View commit details
    Browse the repository at this point in the history

  4. improved indexing to sample all sequences

    @b-vm
    b-vm committed Jan 8, 2023
    Configuration menu
    Copy the full SHA
    18ace01 View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2023

  1. integrated whole sequence train function with existing

    @b-vm
    b-vm committed Mar 1, 2023
    Configuration menu
    Copy the full SHA
    de092ba View commit details
    Browse the repository at this point in the history

  2. Merge pull request #2 from b-vm/master 

    merge with master
    @b-vm
    b-vm authored Mar 1, 2023
    Configuration menu
    Copy the full SHA
    d66bcaa View commit details
    Browse the repository at this point in the history

  3. improvement of isntance checking

    @b-vm
    b-vm committed Mar 1, 2023
    Configuration menu
    Copy the full SHA
    5dc8bc9 View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2023

  1. Merge branch 'master' into sequence_batching

    @araffin
    araffin committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    9a268be View commit details
    Browse the repository at this point in the history

  2. Reformat and simplify

    @araffin
    araffin committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    e543b31 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2023

  1. bug fix flatten extractor instance check

    @b-vm
    b-vm committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    194f758 View commit details
    Browse the repository at this point in the history

  2. simplified if statement

    @b-vm
    b-vm committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    8f18c9c View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2023

  1. Merge branch 'master' into sequence_batching

    @araffin
    araffin committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    5e6f371 View commit details
    Browse the repository at this point in the history

  2. Update comment

    @araffin
    araffin committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    ad0d3ed View commit details
    Browse the repository at this point in the history

  3. Re-add drop last, was causing NaN

    @araffin
    araffin committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    b43e9b5 View commit details
    Browse the repository at this point in the history

  4. Fix NaN

    @araffin
    araffin committed Apr 27, 2023
    Configuration menu
    Copy the full SHA
    ef37cc7 View commit details
    Browse the repository at this point in the history

Commits on May 29, 2023

  1. fixed bug: append correct index, and only once.

    @b-vm
    b-vm committed May 29, 2023
    Configuration menu
    Copy the full SHA
    a2382c8 View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2023

  1. Merge pull request #3 from Stable-Baselines-Team/master 

    update to latest
    @b-vm
    b-vm authored Jun 29, 2023
    Configuration menu
    Copy the full SHA
    2837be5 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2023

  1. Merge branch 'master' into sequence_batching

    @araffin
    araffin authored Sep 3, 2023
    Configuration menu
    Copy the full SHA
    79fbd3f View commit details
    Browse the repository at this point in the history

Commits on Oct 6, 2023

  1. Merge branch 'master' into sequence_batching

    @araffin
    araffin authored Oct 6, 2023
    Configuration menu
    Copy the full SHA
    7edb731 View commit details
    Browse the repository at this point in the history

Commits on Jan 10, 2024

  1. Merge branch 'master' into sequence_batching

    @araffin
    araffin authored Jan 10, 2024
    Configuration menu
    Copy the full SHA
    9898e27 View commit details
    Browse the repository at this point in the history