How can I move files by using the keyboard only?
Have a look at Move files using just keyboard in Mac Finder? for a discussion of the same topic, listing a lot of options.

Assuming you are running Lion you can move files by using Cmd-C to pick them up and Cmd-Opt-V to move them to the target location.