Chain getting in between sprocket and rear dropout
Yes, you need to adjust the limit screws of the derailleur so it can't pull the chain farther over than the last cog.  There are various videos on YouTube, such as GCN's: