If I drill holes in a door, would I then at a later time be able to conceal them reasonably well?
There are better options to attach temporarily fixtures.  I would first try using 3M Command Strips to secure the organizer to the door.  In this way you can easily take it down without drilling holes in your door.  They also make velcro so you can remove the organizer and put it back later if you wish.