How to add the js files to specfic modules only
It is, of course, not possible. The problem is:


JS files, by the nature of WWW, are added to HTML output
All modules participate in creation of one HTML output
You want to add JS "only to module", but because there is no isolation between parts of HTML output, it's plainly not doable.




To address what you didn't really ask, but probably need to know: 

Never just add jQuery on your own. That's pretty dangerous thing to do and pretty much always will mess things up. There is jQuery Update module to address this need. It's not perfect, but way better than anything you will be able to create yourself now - because it was tested by hundreds of thousands.