I would like to use open source tools if possible.

here are 2 links I found but haven't tried them - 

* <http://pivots.pivotallabs.com/users/chad/blog/articles/471-continuous-integration-in-a-box-exploring-tsttcpw>
* <http://laurentbois.com/category/continuous-integration/>