1. A computer-implemented method of providing recommendations, comprising: obtaining a user history for a user, the user history identifying a plurality of items, the plurality of items comprising items representing one or more media items presented to the user and items representing one or more actions performed by the user; generating a sequence of tokens that includes a respective token associated with each of the one or more media items presented to the user and a respective token associated with each of the one or more actions performed by the user; providing each token in the sequence of tokens as an input to a recurrent neural network that is configured to process each of the tokens and, after processing a last token in the sequence of tokens, predict a next token subsequent to the last token in the sequence of tokens; and providing a recommendation to the user based on an item associated with the predicted next token.