The growth rate in the Solow model
It seems you are confounding growth and growth rate.  The difference between the blue and purple curves, i. e. growth,  may be small when capital is small, but the ratio of the difference to  capital, i. e. the growth rate will indeed be larger the closer capital is to zero.