You should take a look at OpenAI's spinning up RL! I found it was a great resource when I began studying for RL.

[1] https://spinningup.openai.com/en/latest/