Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Migration to Gymnasium + bug fixes + QOL features #34

Open
wants to merge 66 commits into
base: master
Choose a base branch
from
Open

Migration to Gymnasium + bug fixes + QOL features #34

wants to merge 66 commits into from

Commits on Mar 31, 2024

  1. Fixed sampling from set bug

    @Moonflower2022
    Moonflower2022 committed Mar 31, 2024
    Configuration menu
    Copy the full SHA
    fbcf8ed View commit details
    Browse the repository at this point in the history

Commits on Apr 2, 2024

  1. Migration to gymnasium (final models are still in gym)

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    e3c20a5 View commit details
    Browse the repository at this point in the history

  2. Added requirement to hamiltonian agent https://math.stackexchange.com… 

    …/questions/1699203/hamilton-paths-cycles-in-grid-graphs
    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    7a81ba6 View commit details
    Browse the repository at this point in the history

  3. Added check_env to custom wrappers

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    d789eb9 View commit details
    Browse the repository at this point in the history

  4. added folder_dir variable

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    64379d4 View commit details
    Browse the repository at this point in the history

  5. fixed careless bug

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    27d0ce9 View commit details
    Browse the repository at this point in the history

  6. small syntax change

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    8ba6717 View commit details
    Browse the repository at this point in the history

  7. forgot to update this but also part of gym => gymnasium migration

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    73dae00 View commit details
    Browse the repository at this point in the history

  8. added option to only render and not play sound

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    2cad05d View commit details
    Browse the repository at this point in the history

  9. changed name from num_step to num_steps and added avg win moves stati… 

    …stic
    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    32f2768 View commit details
    Browse the repository at this point in the history

  10. added check for not rendering and playing sound

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    b3e9991 View commit details
    Browse the repository at this point in the history

  11. added more info in prints + changed default settings

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    e17efa2 View commit details
    Browse the repository at this point in the history

  12. more clarification

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    e60a02d View commit details
    Browse the repository at this point in the history

  13. changed git ignore to track trained model changes

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    f6bbf1b View commit details
    Browse the repository at this point in the history

  14. added folder dir that is based on BOARD_SIZE

    @Moonflower2022
    Moonflower2022 committed Apr 2, 2024
    Configuration menu
    Copy the full SHA
    04aaa9f View commit details
    Browse the repository at this point in the history

Commits on Apr 3, 2024

  1. continued migration to gymnasium

    @Moonflower2022
    Moonflower2022 committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    266f7fb View commit details
    Browse the repository at this point in the history

  2. continued mirgation to gymnasium 2

    @Moonflower2022
    Moonflower2022 committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    c180a14 View commit details
    Browse the repository at this point in the history

  3. qol features

    @Moonflower2022
    Moonflower2022 committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    ef0ae07 View commit details
    Browse the repository at this point in the history

  4. mlp models

    @Moonflower2022
    Moonflower2022 committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    9324002 View commit details
    Browse the repository at this point in the history

  5. cnn trained models

    @Moonflower2022
    Moonflower2022 committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    e2207b7 View commit details
    Browse the repository at this point in the history

  6. deleted old gym model

    @Moonflower2022
    Moonflower2022 committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    507f17c View commit details
    Browse the repository at this point in the history

  7. Changed defaults on testing scripts so that winning sound plays each … 

    …time
    @Moonflower2022
    Moonflower2022 committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    38e066a View commit details
    Browse the repository at this point in the history

  8. name changes for convenience

    @Moonflower2022
    Moonflower2022 committed Apr 3, 2024
    Configuration menu
    Copy the full SHA
    3595176 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2024

  1. more name change for conveinence

    @Moonflower2022
    Moonflower2022 committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    9eb95f7 View commit details
    Browse the repository at this point in the history

  2. change tensor board log name

    @Moonflower2022
    Moonflower2022 committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    026b4d0 View commit details
    Browse the repository at this point in the history

  3. more models

    @Moonflower2022
    Moonflower2022 committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    3e3e65e View commit details
    Browse the repository at this point in the history

  4. changes for fluidity

    @Moonflower2022
    Moonflower2022 committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    c611af5 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2024

  1. move things into main function (64 sub processes is too many)

    @Moonflower2022
    Moonflower2022 committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    2851e1f View commit details
    Browse the repository at this point in the history

  2. change reward to be harsher (for more win rate)

    @Moonflower2022
    Moonflower2022 committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    737c3b2 View commit details
    Browse the repository at this point in the history

  3. trained another cnn model with high win rate

    @Moonflower2022
    Moonflower2022 committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    c46ee79 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. dont need separate initialization for mixer because pygame.init() and… 

    … pygame.close() covers it
    @Moonflower2022
    Moonflower2022 committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    fe13d50 View commit details
    Browse the repository at this point in the history

  2. added time recorder

    @Moonflower2022
    Moonflower2022 committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    853d699 View commit details
    Browse the repository at this point in the history

  3. moved constants outside of main function

    @Moonflower2022
    Moonflower2022 committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    1748394 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. added cell_size and border_size as optional variables, changed cleari… 

    …ng from filling screen to be all black to just drawing a black rectangle over its drawing area
    @Moonflower2022
    Moonflower2022 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    39a2165 View commit details
    Browse the repository at this point in the history

  2. removed unused variables

    @Moonflower2022
    Moonflower2022 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    51702bc View commit details
    Browse the repository at this point in the history

  3. revamped snake logic

    @Moonflower2022
    Moonflower2022 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    5ff6bcd View commit details
    Browse the repository at this point in the history

  4. added option for x_offset for rendering QOL

    @Moonflower2022
    Moonflower2022 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    b3b8942 View commit details
    Browse the repository at this point in the history

  5. trained more models on cnn

    @Moonflower2022
    Moonflower2022 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    5f94b25 View commit details
    Browse the repository at this point in the history

  6. logs

    @Moonflower2022
    Moonflower2022 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    d268a2e View commit details
    Browse the repository at this point in the history

  7. fixed careless bug that changed the game logic

    @Moonflower2022
    Moonflower2022 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    78623dc View commit details
    Browse the repository at this point in the history

  8. added more info returned from snake_game

    @Moonflower2022
    Moonflower2022 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    99ec123 View commit details
    Browse the repository at this point in the history

  9. continued addition of optional variables cell_size and border_size

    @Moonflower2022
    Moonflower2022 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    e449938 View commit details
    Browse the repository at this point in the history

  10. more x_offset rendering qol

    @Moonflower2022
    Moonflower2022 committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    4fc94a9 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. added variables like steps and info, added draw info function

    @Moonflower2022
    Moonflower2022 committed Apr 10, 2024
    Configuration menu
    Copy the full SHA
    d559d75 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. changed score variable to fruits variable and changed draw_score func… 

    …tion to be draw_info (now draws more info)
    @Moonflower2022
    Moonflower2022 committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    3d4d219 View commit details
    Browse the repository at this point in the history

  2. change from score to # of fruits

    @Moonflower2022
    Moonflower2022 committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    8bd7671 View commit details
    Browse the repository at this point in the history

  3. more changes to draw_info

    @Moonflower2022
    Moonflower2022 committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    15b8e94 View commit details
    Browse the repository at this point in the history

  4. removed different color for last snake segment and also quick fix for… 

    … draw_info
    @Moonflower2022
    Moonflower2022 committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    ea88716 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. changed draw_snake so that the direction of the snake is displayed

    @Moonflower2022
    Moonflower2022 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    3157b37 View commit details
    Browse the repository at this point in the history

  2. changed draw_info and fixed small bug in draw_snake code

    @Moonflower2022
    Moonflower2022 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    9edc3dc View commit details
    Browse the repository at this point in the history

  3. script demonstrating ability to run a game playing against the bots

    @Moonflower2022
    Moonflower2022 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    e010e53 View commit details
    Browse the repository at this point in the history

  4. another 7x7 model

    @Moonflower2022
    Moonflower2022 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    4ae488c View commit details
    Browse the repository at this point in the history

  5. changed draw_snake to draw tail differently

    @Moonflower2022
    Moonflower2022 committed Apr 12, 2024
    Configuration menu
    Copy the full SHA
    159a37f View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2024

  1. fixed display bug

    @Moonflower2022
    Moonflower2022 committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    1bcbcf2 View commit details
    Browse the repository at this point in the history

  2. name changes and better 6x6 model

    @Moonflower2022
    Moonflower2022 committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    2f90302 View commit details
    Browse the repository at this point in the history

  3. changed sizing of display

    @Moonflower2022
    Moonflower2022 committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    ace9a7b View commit details
    Browse the repository at this point in the history

  4. added extra variable for convenience

    @Moonflower2022
    Moonflower2022 committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    2f73939 View commit details
    Browse the repository at this point in the history

  5. fixed typo

    @Moonflower2022
    Moonflower2022 committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    ac6daad View commit details
    Browse the repository at this point in the history

  6. changed draw_info to display steps always, not just when the game is … 

    …over
    @Moonflower2022
    Moonflower2022 committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    a530757 View commit details
    Browse the repository at this point in the history

  7. removed trained_models_cnn_mps and just made all cnn models go to one… 

    … folder
    @Moonflower2022
    Moonflower2022 committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    b82c2cb View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2024

  1. made sizing consistent

    @Moonflower2022
    Moonflower2022 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    38396b8 View commit details
    Browse the repository at this point in the history

  2. fixed bug since i changed score to fruits

    @Moonflower2022
    Moonflower2022 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    6bdfa57 View commit details
    Browse the repository at this point in the history

  3. made display bigger so info could be seen

    @Moonflower2022
    Moonflower2022 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    d802509 View commit details
    Browse the repository at this point in the history

  4. added seed call before random generation to ensure correctness

    @Moonflower2022
    Moonflower2022 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    2692213 View commit details
    Browse the repository at this point in the history

  5. changed settings and display size to stay consistent

    @Moonflower2022
    Moonflower2022 committed Apr 28, 2024
    Configuration menu
    Copy the full SHA
    fc7b958 View commit details
    Browse the repository at this point in the history

Commits on Apr 30, 2024

  1. changed the way that seeds work

    @Moonflower2022
    Moonflower2022 committed Apr 30, 2024
    Configuration menu
    Copy the full SHA
    21b030e View commit details
    Browse the repository at this point in the history