How should I implement the state transition when it is a Gaussian distribution?
I figured this out by going to the author's publicly available github code. It turned out  the authors were just generating the transition probability $p$ from $\mathcal{N}(\mu,\sigma^2)$ at the beginning of each episode for some reason. Answering it myself for the sake of not leaving this question unanswered.