If I install the Bitcoin progam on my computer, that simply means that I will be mining Bitcoins over time?
No, the Bitcoin software allows you to receive, hold and send bitcoins. To mine you need specific hardware and software - for most people it is not recommended to bother.