Should a beginner in ML use libraries like TF and Keras?
Start of by reading up on math/theory. For neural networks I can really recommend Michael Jensens free online book. All along he gives good python examples using only numpy. 
For DNNs, TF and Keras are IMO the easiest approach. For linear models, scikit learn would probably cover most.