Actions in Graph Env

[josephdviviano]

Leaving a note here to ensure we address @hyeok9855's ideas:

Here, we define GraphActions as action class, but I think here we need to output Actions as in RingGraphBuilding.make_actions_class.

Thoughts on Actions and GraphActions

I believe the most complicated part w.r.t. Graph is the actions, where we have two kinds of actions - Actions, a class to take flat tensors from the policy, and GraphActions, another class to take steps in the GraphEnv. So we need a clear rule in designing these.

For example,

• make_actions_class should always output the Actions so that it can take flat tensor,
• Enforce users to implement convert_actions by making it as abstractmethod
• step in GraphEnv should always take GraphActions

etc.

Originally posted by @hyeok9855 in #210 (comment)