Code

Render history#149

Code

Open

egafni wants to merge 105 commits intowerner-duvaud:masterwerner-duvaud/muzero-general:masterfrom egafni:render_histegafni/muzero-general:render_histCopy head branch name to clipboard

+3,659-4

Commits

Commits on Feb 22, 2020

• Merge pull request werner-duvaud#9 from littleV/gomoku

  Show description for 6534061
  werner-duvaud

  authored
  6534061

  Copy full SHA for 6534061

Commits on Feb 23, 2020

• Add hyperparameters to TensorBoard and update menu

  werner-duvaud

  committed
  cd3db2f

  Copy full SHA for cd3db2f

• Update readme

  werner-duvaud

  committed
  a06b9fb

  Copy full SHA for a06b9fb

Commits on Feb 27, 2020

• Added Tic-Tac-Toe game.

  fidel-schaposnik

  committed
  a850762

  Copy full SHA for a850762

Commits on Feb 29, 2020

• Merge pull request werner-duvaud#14 from fidel-schaposnik/tictactoe

  Show description for 697435e
  werner-duvaud

  authored
  697435e

  Copy full SHA for 697435e

• Improve ResNet pooling and add abstract game

  werner-duvaud

  committed
  1454f56

  Copy full SHA for 1454f56

• Add test again random agent

  werner-duvaud

  committed
  9f3f25f

  Copy full SHA for 9f3f25f

Commits on Mar 1, 2020

• Add parameters for board games

  werner-duvaud

  committed
  7d3acbc

  Copy full SHA for 7d3acbc

Commits on Mar 2, 2020

• Add random agent results to tensorboard

  werner-duvaud

  committed
  18be118

  Copy full SHA for 18be118

Commits on Mar 5, 2020

• Convergence of tic-tac-toe with fully connected network

  werner-duvaud

  committed
  b16e4ae

  Copy full SHA for b16e4ae

• Type error

  Show description for 4aad737
  manuel-delverme

  authored
  4aad737

  Copy full SHA for 4aad737

• Merge pull request werner-duvaud#17 from manuel-delverme/patch-1

  Show description for 0d110d0
  werner-duvaud

  authored
  0d110d0

  Copy full SHA for 0d110d0

Commits on Mar 8, 2020

• Add stack action to stacked observations

  werner-duvaud

  committed
  f2f0f6f

  Copy full SHA for f2f0f6f

Commits on Mar 11, 2020

• Fix MCTS

  werner-duvaud

  committed
  1442e20

  Copy full SHA for 1442e20

Commits on Mar 14, 2020

• Fix MCTS and typo

  Show description for 1864750
  

  werner-duvaud

  and

  ahainaut

  committed
  1864750

  Copy full SHA for 1864750

Commits on Mar 16, 2020

• Fix OverflowError and Add Conv 1x1

  ahainaut

  committed
  c16e2ec

  Copy full SHA for c16e2ec

Commits on Mar 19, 2020

• Improve lunarlander hyperparameters and scale encoded state gradients

  werner-duvaud

  committed
  7b861c4

  Copy full SHA for 7b861c4

• add PER support

  xuxiyang1993

  committed
  10b7fda

  Copy full SHA for 10b7fda

Commits on Mar 20, 2020

• add PER support

  xuxiyang1993

  committed
  58af304

  Copy full SHA for 58af304

• Improve cartpole hyperparameters and fix typo

  werner-duvaud

  committed
  f51d2cb

  Copy full SHA for f51d2cb

• Merge pull request werner-duvaud#23 from xuxiyang1993/master

  Show description for 976aa01
  werner-duvaud

  authored
  976aa01

  Copy full SHA for 976aa01

Commits on Mar 21, 2020

• update PER support

  xuxiyang1993

  committed
  5c2e4d4

  Copy full SHA for 5c2e4d4

Commits on Mar 23, 2020

• Merge pull request werner-duvaud#25 from xuxiyang1993/master

  Show description for bdbf703
  werner-duvaud

  authored
  bdbf703

  Copy full SHA for bdbf703

Commits on Mar 26, 2020

• Improve loss scaling and fix MCTS

  werner-duvaud

  committed
  027ecc5

  Copy full SHA for 027ecc5

Commits on Mar 27, 2020

• IS weights for prioritized replay

  xuxiyang1993

  committed
  43688f7

  Copy full SHA for 43688f7

Commits on Mar 28, 2020

• Merge pull request werner-duvaud#29 from xuxiyang1993/master

  Show description for 4a20f90
  werner-duvaud

  authored
  4a20f90

  Copy full SHA for 4a20f90

• Change batch aggregation, fix value in replay buffer and prepare merge

  werner-duvaud

  committed
  b62bcce

  Copy full SHA for b62bcce

• Merge branch 'master' into prioritized_replay

  werner-duvaud

  authored
  2d02fc3

  Copy full SHA for 2d02fc3

• Merge pull request werner-duvaud#30 from werner-duvaud/prioritized_replay

  Show description for 5c61323
  werner-duvaud

  authored
  5c61323

  Copy full SHA for 5c61323

• Add notebook and fix merge

  werner-duvaud

  committed
  ee1b333

  Copy full SHA for ee1b333

• Fix typo

  werner-duvaud

  committed
  5cd199d

  Copy full SHA for 5cd199d

Commits on Mar 30, 2020

• Add selfplay / train ratio and improve reproductibility

  werner-duvaud

  committed
  f79bc3c

  Copy full SHA for f79bc3c

Commits on Mar 31, 2020

• Add tree depth info

  werner-duvaud

  committed
  0fd671f

  Copy full SHA for 0fd671f

Commits on Apr 1, 2020

• Add Atari

  werner-duvaud

  committed
  927064a

  Copy full SHA for 927064a

Commits on Apr 4, 2020

• td error for PER

  werner-duvaud

  committed
  29824b6

  Copy full SHA for 29824b6

• Add value reanalyze

  werner-duvaud

  committed
  84e1447

  Copy full SHA for 84e1447

Commits on Apr 5, 2020

• Fix bug in build of grpcio last version

  werner-duvaud

  committed
  cfa34f7

  Copy full SHA for cfa34f7

• Improve memory with stacked observations

  werner-duvaud

  committed
  3b5bb4f

  Copy full SHA for 3b5bb4f

Commits on Apr 7, 2020

• Turn replay buffer into numbered dict

  werner-duvaud

  committed
  ceb45c3

  Copy full SHA for ceb45c3

Commits on Apr 11, 2020

• Add mean value plot

  werner-duvaud

  committed
  17882e4

  Copy full SHA for 17882e4

Commits on Apr 19, 2020

• Refactor

  ahainaut

  committed
  d7ba7d8

  Copy full SHA for d7ba7d8

Commits on Apr 21, 2020

• Fix werner-duvaud#34 (last commit)

  ahainaut

  committed
  593c198

  Copy full SHA for 593c198

Commits on Apr 22, 2020

• Fix numpy types werner-duvaud#35

  werner-duvaud

  committed
  2575a29

  Copy full SHA for 2575a29

Commits on Apr 24, 2020

• Refactor

  werner-duvaud

  committed
  b908eb8

  Copy full SHA for b908eb8

Commits on Apr 25, 2020

• Upon exit, replay buffer perists to disk, and can be optionally pre-populated from disk before training begins.

  fred-drake

  committed
  b63f43b

  Copy full SHA for b63f43b

Commits on Apr 26, 2020

• Update Breakout configuration

  werner-duvaud

  committed
  8fc3f72

  Copy full SHA for 8fc3f72

Commits on Apr 27, 2020

• Merge pull request werner-duvaud#38 from fdrake76/persistent_replay_buffer

  Show description for c5d4b83
  werner-duvaud

  authored
  c5d4b83

  Copy full SHA for c5d4b83

• Refactor

  werner-duvaud

  committed
  c2b0141

  Copy full SHA for c2b0141

Commits on Apr 29, 2020

• Hyperparameters tuning for Gomoku and Connect4

  ahainaut

  committed
  1943c08

  Copy full SHA for 1943c08

Commits on May 2, 2020

• Fix reward for more than 2 players

  Show description for 17f7b9b
  tfzee

  authored
  17f7b9b

  Copy full SHA for 17f7b9b

Commits on May 3, 2020

• Update doc and refactor

  werner-duvaud

  committed
  d3f679b

  Copy full SHA for d3f679b

• Update initial priority

  werner-duvaud

  committed
  5bb15ec

  Copy full SHA for 5bb15ec

Commits on May 5, 2020

• Adding twentyone game as an example.

  

  Adrian-Ryan Acala

  committed
  a5457f8

  Copy full SHA for a5457f8

• Fixing minor issue with __init__.

  

  Adrian-Ryan Acala

  committed
  46c214b

  Copy full SHA for 46c214b

Commits on May 6, 2020

• Typo

  werner-duvaud

  committed
  c88737b

  Copy full SHA for c88737b

• Merge pull request werner-duvaud#43 from TimZF/patch-1

  Show description for e34de11
  ahainaut

  authored
  e34de11

  Copy full SHA for e34de11

• Add conv1x1 in heads

  ahainaut

  committed
  3785486

  Copy full SHA for 3785486

Commits on May 8, 2020

• Update README.md

  werner-duvaud

  authored
  aa43378

  Copy full SHA for aa43378

• Update README.md

  werner-duvaud

  authored
  4573a95

  Copy full SHA for 4573a95

Commits on May 9, 2020

• Fixing learning rate and implemented resnet.

  

  Adrian-Ryan Acala

  committed
  bd95d2b

  Copy full SHA for bd95d2b

Commits on May 10, 2020

• Merge pull request werner-duvaud#44 from AdrianAcala/twentyone

  Show description for ed7ad49
  werner-duvaud

  authored
  ed7ad49

  Copy full SHA for ed7ad49

• Formatting

  werner-duvaud

  committed
  a725915

  Copy full SHA for a725915

Commits on May 12, 2020

• Fix werner-duvaud#50

  werner-duvaud

  committed
  74b2ad5

  Copy full SHA for 74b2ad5

Commits on May 21, 2020

• Update README.md

  werner-duvaud

  authored
  9323f3b

  Copy full SHA for 9323f3b

Commits on Jun 1, 2020

• Fix werner-duvaud#55

  werner-duvaud

  committed
  a70b36c

  Copy full SHA for a70b36c

• Update README.md

  werner-duvaud

  authored
  6f27841

  Copy full SHA for 6f27841

Commits on Jun 11, 2020

• Update README.md

  ahainaut

  authored
  0dfee62

  Copy full SHA for 0dfee62

Commits on Jun 22, 2020

• Add diagnose model

  werner-duvaud

  committed
  0727771

  Copy full SHA for 0727771

Commits on Jun 24, 2020

• Update parameters

  ahainaut

  committed
  fce9e71

  Copy full SHA for fce9e71

Commits on Jun 30, 2020

• Fix backpropagate

  werner-duvaud

  committed
  fee2f7e

  Copy full SHA for fee2f7e

Commits on Jul 26, 2020

• Add hp search and deterministic lunarlander, improve ratio metric and seeding, refactor and minor fixes, fix werner-duvaud#60

  werner-duvaud

  committed
  fc29838

  Copy full SHA for fc29838

• Update muzero.py

  werner-duvaud

  authored
  c0f171b

  Copy full SHA for c0f171b

Commits on Jul 30, 2020

• Add selfplay with gpu, multi gpu, better env closing, save hp search results

  werner-duvaud

  committed
  b615622

  Copy full SHA for b615622

Commits on Aug 10, 2020

• Add Reanalyse

  werner-duvaud

  committed
  afd0b6d

  Copy full SHA for afd0b6d

Commits on Aug 12, 2020

• Add code structure img and uniform reanalyse

  werner-duvaud

  committed
  2cdd3e4

  Copy full SHA for 2cdd3e4

Commits on Aug 14, 2020

• Improve CPU/GPU management

  werner-duvaud

  committed
  4c4422f

  Copy full SHA for 4c4422f

Commits on Aug 16, 2020

• Update replay_buffer.py

  werner-duvaud

  authored
  710a33f

  Copy full SHA for 710a33f

Commits on Aug 20, 2020

• Add resume training and improve training exit

  Show description for e46b500
  

  werner-duvaud

  and

  ahainaut

  committed
  e46b500

  Copy full SHA for e46b500

Commits on Sep 2, 2020

• Fix string formatting (werner-duvaud#77)

  Show description for 4cdcae0
  LukeWood

  authored
  4cdcae0

  Copy full SHA for 4cdcae0

Commits on Sep 6, 2020

• Improve docstring and fix load replay buffer werner-duvaud#75

  werner-duvaud

  committed
  ffbd4b3

  Copy full SHA for ffbd4b3

Commits on Sep 7, 2020

• Fix tic tac toe action to string

  werner-duvaud

  committed
  cd2c7a4

  Copy full SHA for cd2c7a4

Commits on Sep 16, 2020

• Fix reanalyse and format

  werner-duvaud

  committed
  2600e3e

  Copy full SHA for 2600e3e

Commits on Sep 23, 2020

• Add lunarlander checkpoint

  werner-duvaud

  committed
  b7a7665

  Copy full SHA for b7a7665

Commits on Sep 27, 2020

• Renames window_size to replay_buffer_size (werner-duvaud#83)

  SanjoSolutions

  authored
  ab3ffe6

  Copy full SHA for ab3ffe6

Commits on Oct 29, 2020

• Update TicTacToe configuration

  ahainaut

  committed
  2bc3534

  Copy full SHA for 2bc3534

Commits on Nov 3, 2020

• Fix badge typo (werner-duvaud#85)

  sondrelg

  authored
  4b500ff

  Copy full SHA for 4b500ff

Commits on Nov 6, 2020

• Fix Pytorch 1.7

  werner-duvaud

  committed
  f752af6

  Copy full SHA for f752af6

Commits on Nov 7, 2020

• Parallelize get_batch in trainer (werner-duvaud#86)

  sergiovieri

  authored
  ca40525

  Copy full SHA for ca40525

Commits on Nov 11, 2020

• Fix GPU availability in actors with PyTorch 1.7

  werner-duvaud

  committed
  1583ad9

  Copy full SHA for 1583ad9

Commits on Nov 20, 2020

• Fix werner-duvaud#89 (residual block)

  werner-duvaud

  committed
  f350a08

  Copy full SHA for f350a08

Commits on Dec 16, 2020

• Update README.md

  werner-duvaud

  authored
  8fba3da

  Copy full SHA for 8fba3da

Commits on Dec 26, 2020

• Fix reanalyse on GPU

  werner-duvaud

  authored
  dccac8a

  Copy full SHA for dccac8a

Commits on Dec 29, 2020

• Typo fix werner-duvaud#100

  werner-duvaud

  authored
  bdafa68

  Copy full SHA for bdafa68

Commits on Jan 7, 2021

• Explicitly remove special lunarlander import fix werner-duvaud#106

  werner-duvaud

  committed
  469c327

  Copy full SHA for 469c327

• Change spaces to underscores to fix SummaryWriter error messages (werner-duvaud#104)

  Show description for a4bf9a7
  dribnet

  authored
  a4bf9a7

  Copy full SHA for a4bf9a7

• Added submenu for simpler loading of pre-trained models (werner-duvaud#105)

  Show description for 7883c3c
  dribnet

  authored
  7883c3c

  Copy full SHA for 7883c3c

• Fix gomoku hyperparameters and format

  werner-duvaud

  committed
  fb9c6ca

  Copy full SHA for fb9c6ca

Commits on Jan 8, 2021

• fix reward sign in compute_target_value()

  Show description for 1e5c3d0
  mokemokechicken

  committed
  1e5c3d0

  Copy full SHA for 1e5c3d0

Commits on Jan 15, 2021

• sample N games at one time in replay_buffer

  mokemokechicken

  committed
  cf320f0

  Copy full SHA for cf320f0

Commits on Jan 27, 2021

• Merge pull request werner-duvaud#108 from mokemokechicken/fix_reward_sign_in_compute_target_value

  Show description for e864f59
  ahainaut

  authored
  e864f59

  Copy full SHA for e864f59

• Update comments

  ahainaut

  committed
  14fe80d

  Copy full SHA for 14fe80d

Commits on Feb 8, 2021

• Fix werner-duvaud#114

  ahainaut

  committed
  a3e899f

  Copy full SHA for a3e899f

Commits on Feb 9, 2021

• Merge pull request werner-duvaud#117 from mokemokechicken/feature/sample_n_games_at_one_time_in_get_batch

  Show description for 2f3e3cb
  ahainaut

  authored
  2f3e3cb

  Copy full SHA for 2f3e3cb

Commits on Apr 15, 2021

• Merge branch 'master' of github.com:egafni/muzero-general

  egafni

  committed
  342e785

  Copy full SHA for 342e785

• render hist

  egafni

  committed
  3592fc9

  Copy full SHA for 3592fc9