Requesting book references for a non-expert person with math background or just a non-expert person
I personally found Stephen Hawking's "A Breif History of Time" to be very interesting and informative.  It is a little bit advanced, but is put forward in plain English.  Here is a link to it on Amazon, and you can "look inside" to see part of the book and see what you think.

http://www.amazon.com/gp/product/0553380168/ref=pd_lpo_sbs_dp_ss_1?pf_rd_p=1535523722&amp;pf_rd_s=lpo-top-stripe-1&amp;pf_rd_t=201&amp;pf_rd_i=055371449X&amp;pf_rd_m=ATVPDKIKX0DER&amp;pf_rd_r=1Z0JYCKHWXEFPK3TS6TM

After reading your comments / clarifications, you might like "A Field Guide to Stars and Planets."  It appears to be a good introduction into astronomy.

http://www.amazon.com/Field-Guide-Planets-Peterson-Guides/dp/0395934311/ref=sr_1_1?s=books&amp;ie=UTF8&amp;qid=1411293771&amp;sr=1-1&amp;keywords=stars+and+planets

As far as covering astronomy from a more mathematical perspective, you might like "A Student's Guide to the Mathematics of Astronomy." 

http://www.amazon.com/Students-Guide-Mathematics-Astronomy/dp/1107610214/ref=sr_1_1?s=books&amp;ie=UTF8&amp;qid=1411294172&amp;sr=1-1&amp;keywords=math+of+astronomy

You can take a look inside each of these books to see what you think.