Long term time series forecasts with small dataset
You can use reinforcement learning, in instance mbrrl2 package.

As temperature is very stational dependent variable. You should have at least 1 year, better 2 years, to make some predictions.

Other way to solve this, is having a collection of historical temperatures, clustering them, and matching your dataset with the closest cluster.