Setting up the environment is a known problem and takes some debugging to figure out. I will update Spinning Up Set Up environment to make this process easier.
User Documentation
Algorithms Intro
Running Experiments
Experiment Outputs
Plotting Results
Introduction
Key Concepts in RL
Kinds of RL Algorithms
Intro to Policy Optimization