Skip to content

Commit

Permalink
fix comments from review
Browse files Browse the repository at this point in the history
  • Loading branch information
Mistobaan committed Mar 24, 2023
1 parent c5cfc13 commit 07dc763
Show file tree
Hide file tree
Showing 4 changed files with 4 additions and 5 deletions.
2 changes: 1 addition & 1 deletion docs/README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# How To build the documentation
# How to build the documentation

```bash
make html
Expand Down
4 changes: 2 additions & 2 deletions docs/configs.rst
Original file line number Diff line number Diff line change
Expand Up @@ -25,10 +25,10 @@ the specific method being used (i.e. ILQL or PPO)

**PPO**

.. autoclass:: trlx.trainer.nn.ppo_models.MethodConfig
.. autoclass:: trlx.models.modeling_ppo.PPOConfig
:members:

**ILQL**

.. autoclass:: trlx.trainer.nn.ilql_models.ILQLConfig
.. autoclass:: trlx.models.nn.modeling_ilql.ILQLConfig
:members:
1 change: 0 additions & 1 deletion docs/examples.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,6 @@

In the `examples` folder you can find several example training tasks.

Check the configs folder for the associated configs files.

## randomwalks

Expand Down
2 changes: 1 addition & 1 deletion docs/pipeline.rst
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ Pipelines in trlX provide a way to read from a dataset. They are used to fetch d

*Rollout Stores*

Rollout stores in trlX are used to store experiences created for the models by the orchestrator. The experiences in the rollout stores serve as the training data for the models. The models use the experiences stored in their rollout stores to learn and improve their behavior. The rollout stores provide a convenient and efficient way for the models to access the experiences they need for training.
Rollout stores in trlX are used to store experiences created for the models by the trainer. The experiences in the rollout stores serve as the training data for the models. The models use the experiences stored in their rollout stores to learn and improve their behavior. The rollout stores provide a convenient and efficient way for the models to access the experiences they need for training.


**PPO**
Expand Down

0 comments on commit 07dc763

Please sign in to comment.