Seeking advice: Building a NLP in C++
I think this is a risky project. There is a lot of specialist knowledge in neural networks and NLP. Trying to learn it &quot;on the side&quot; in order to complete your project may be biting off more than you can chew.
If you intend to write the neural network and train it yourself, you should be prepared for long sessions of training and testing variations of the neural network entirely separate from practicing any of the advanced C++ code that you are studying.
My recommendation instead of writing your own NN components, would be to learn the C++ API for Tensorflow and reference examples (like this one in Python/Keras) of using neural networks built in Tensorflow specifically for predicting sequence continuation.
I would also suggest you spend a little time trying out the Python and Keras-based networks to get a feel for what NN architectures work for your problem. If you use Python's tensorflow bindings, you may even be able to train a neural network separately using someone else's script. After training, in your C++ project you could then load the NN definition and use it for the NLP part of the project. You can search for examples of using C++ Tensorflow to load saved networks - this is a relatively common use case when someone wants to re-use a trained network for making new predictions on some edge device where the speed and efficiency of C++ make a large difference.