Is it possible to use a gesture to go back in Finder?
UPDATE

It looks like this has been broken in Mac OS X 10.9 (and wasn't fixed in 10.9.1)

This works again in the latest Mac Os X 10.10.1, and presumably also in 10.10.

Trackpad
Three-finger swipe left goes back and forth in Finder, just like in Safari. 
You don't need 3rd party software to do this, simply make sure your settings are correct.

Go to System Preferences via Spotlight or Launchpad, navigate to Trackpad and click the tab More Gestures. The first option is "Swipe between pages", which enables swiping in Finder, Chrome etc. Make sure to choose one of the two Swipe options.

I've attached an image showing the screen for you here:


Make sure that you've chosen Swipe left or right with four fingers in the Swipe between full-screen apps so the two options don't overrule each other.


You also want to make sure there is no checkmark in the Three finger drag. They are mutually exclusive. You can check this in the Point &amp; Click tab.
 

Magic Mouse
If you use a Magic Mouse and want to be able to swipe back and forth in Finder, you have to turn off the Swipe between full-screen apps and change Swipe between pages to either Swipe left or right with two fingers or Swipe left or right with one or two fingers (both options enables you to swipe back and forth in Finder when using both fingers.