feature(yzj): add multi-agent and structured observation env (GoBigger)#39

Open

jayyoung0802 wants to merge 59 commits intoopendilab:mainfrom jayyoung0802:dev-gobigger

+3,810-174

Commits on May 31, 2023

feature(yzj): adapt multi agent env gobigger with ez
jayyoung0802
committed

Commits on Jun 1, 2023

fix(yzj): fix data device bug in gobigger ez pipeline
jayyoung0802
committed
feature(yzj): add vsbot with ez pipeline and add eat-info in tensorboard
jayyoung0802
committed
feature(yzj): add vsbot with mz pipeline and polish model and buffer
jayyoung0802
committed

Commits on Jun 2, 2023

polish(yzj): polish gobigger env
jayyoung0802
committed
feature(yzj): adapt multi agent env gobigger with sez
jayyoung0802
committed

Commits on Jun 7, 2023

feature(yzj): add gobigger visualization and polish gobigger eval config
jayyoung0802
committed
fix(yzj): fix eval_episode_return and polish env
jayyoung0802
committed
polish(yzj): polish gobigger env pytest
jayyoung0802
committed
polish(yzj): polish gobigger env and eat info in evaluator
jayyoung0802
committed

Commits on Jun 12, 2023

fix(yzj): fix np.pad bug, which need padding_num>0
jayyoung0802
committed

Commits on Jun 13, 2023

polish(yzj): contain raw obs only on eval mode for save memory
jayyoung0802
committed
fix(yzj): fix mcts ptree sampled value/value-prefix bug
jayyoung0802
committed

Commits on Jun 15, 2023

polish(yzj): polish gobigger encoder model
jayyoung0802
committed

Commits on Jun 16, 2023

polish(yzj): polish gobigger encoder model with ding
jayyoung0802
committed

Commits on Jun 19, 2023

polish(yzj): polish gobigger entry evaluator
jayyoung0802
committed
feature(yzj): add eps_greedy and random_collect_episode in gobigger ez
jayyoung0802
committed

Commits on Jun 20, 2023

fix(yzj): fix key bug in entry utils when random collect
jayyoung0802
committed

Commits on Jun 25, 2023

fix(yzj): fix gobigger encoder bn bug
jayyoung0802
committed
polish(yzj): polish ez config and set eps as 1.5e4 learner iter
jayyoung0802
committed
polish(yzj): polish code style by format.sh
jayyoung0802
committed
polish(yzj): polish code comments about gobigger in worker/policy/entry
jayyoung0802
committed
feature(yzj): add eps_greedy and random_collect_episode in gobigger mz
jayyoung0802
committed
Merge branch 'main' of https://github.com/opendilab/LightZero into dev-gobigger
jayyoung0802
committed

Commits on Jun 28, 2023

polish(yzj): polish entry/buffer/policy/config/model/env comments and codes, fix typo in test_gobigger_env, use numpy instead of pygame in gobigger bot
jayyoung0802
committed

Commits on Jun 30, 2023

polish(yzj): use ding scatter_model, muzero_collector add multi_agent option
jayyoung0802
committed

Commits on Jul 3, 2023

fix(yzj): fix collector bug that observation_window_stack no for_loop on agent_id
jayyoung0802
committed

Commits on Jul 5, 2023

fix(yzj): fix ignore done in collector
jayyoung0802
committed
polish(yzj): polish ez config ignore done
jayyoung0802
committed
fix(yzj): add game_segment_pool clear()
jayyoung0802
committed

Commits on Jul 12, 2023

polish(yzj): add gobigger/entry , polish gobigger config and add default env config(t2p2)
jayyoung0802
committed

Commits on Jul 17, 2023

polish(yzj): polish eps greedy and random policy
jayyoung0802
committed
fix(yzj): fix random collect in gobigger ez policy
jayyoung0802
committed

Commits on Aug 2, 2023

polish(yzj): merge main-branch eps and random collect, polish gobigger ez/mz
jayyoung0802
committed

Commits on Aug 4, 2023

feature(yzj): add peetingzoo mz/ez algo, add multi agent buffer/policy/model, and polish gobigger code
jayyoung0802
committed
polish(yzj): polish multi agent muzero collector
jayyoung0802
committed

Commits on Aug 8, 2023

polish(yzj): polish gobigger collector and config to support t2p3
jayyoung0802
committed
feature(yzj): add fc encoder on ptz env instead of identity
jayyoung0802
committed

Commits on Aug 10, 2023

polish(yzj): polish buffer name and remove ignore done in atari config
jayyoung0802
committed

Commits on Aug 14, 2023

fix(yzj): fix ssl data bug and polish to_device code
jayyoung0802
committed
fix(yzj): fix policy utils obs batch
jayyoung0802
committed
fix(yzj): fix collect mode and eval mode to device
jayyoung0802
committed

Commits on Aug 15, 2023

fix(yzj): fix to device bug on policy utils
jayyoung0802
committed
polish(yzj): polish multi agent game buffer code
jayyoung0802
committed
polish(yzj): polish code
jayyoung0802
committed
fix(yzj): fix priority bug, polish priority related config, add all agent obs to ptz
jayyoung0802
committed
polish(yzj): polish train entry
jayyoung0802
committed

Commits on Aug 16, 2023

polish(yzj): polish gobigger config
jayyoung0802
committed

Commits on Aug 18, 2023

polish(yzj): polish best gobigger config on ez/mz
jayyoung0802
committed
polish(yzj): polish collector to adapt multi-agent mode
jayyoung0802
committed
polish(yzj): polish evaluator conflicts
jayyoung0802
committed
polish(yzj): polish multi agent model
jayyoung0802
committed

Commits on Aug 21, 2023

polish(yzj): sync main
jayyoung0802
committed
polish(yzj): polish gobigger entry and evaluator
jayyoung0802
committed

Commits on Aug 29, 2023

feature(yzj): add pettingzoo visualization
jayyoung0802
committed
polish(yzj): polish ptz config and model
jayyoung0802
committed

Commits on Sep 4, 2023

feature(yzj): add ptz simple ez config
jayyoung0802
committed

Commits on Dec 7, 2023