Help getting Nautilus running under MacPorts
This sounds like a problem in X11 itself. To find the real issue with X11, you would have to take a look at the generated crash reports. You will find these within the application Console at "Diagnostic Reports".

As a workaround, you could try to use XQuartz instead, which is a package providing an usually more up-to-date version of the X server for Mac OS X.