Percentage error. How to find percentage error?
Skipping to your question about 


  $$\frac{0.1\alpha^3\alpha^3}{( 0.1 - 0.1\alpha)^2}$$


I'll point out two things.

(1) Significant figures come into play here. The Kc is only given to one significant figure as is the molarity of the solution. So each of those quantities has a +/- 50% error. Remember that in Chemistry 0.1 m isn't the same as 0.1000 m. 

So the molarity of the solution is 0.1 +/- 0.05. If $\alpha &lt; 0.1$ then the assumption that $0.1\alpha$ is negligible is reasonable. 

(2) You can solve the equation for alpha exactly by trial and error. Solve as you did for $\alpha$, then use a factor 10 times larger and one 10 times smaller. One number should be too big and the other too small as compared to Kc. Calculate the average of the two values and test that number. That average will be too big or two small. Discard one side of the bracket. So you're creating an ever shrinking bracket about the "true" value. 6-8 iterations should get you very close. 

Now with the "true value" and the estimate from the assumption that $0.1\alpha$ was negligible you can calculate the "real" percentage error for $\alpha$.