Will plaster on basement walls and ceiling provide insulation?
According to Bon, plaster has an R-value of about 0.12/inch, so your plan will give you about 0.24.  That little insulation is not going to be of any practical value (R-0.24 means you're stopping about 4% of the heat transfer).  Comparatively, EPS or XPS has a value of 3.5-5/inch (stopping 72-80% of the heat transfer) and will help with keeping things warm.