Ranked in these QuestionsQuestion Ranking
Pro Free and open source
Cruise Control is a free and open source project built with Java and hosted on Sourceforge.
Con A bit tricky to set up
CruiseControl may be a bit tricky to set up. However, it has been around for quite a while so it should be pretty easy to find resources to help you out.