Which programming language do you use?
Maybe someone has already built a framework for you to use?
I personally used ABingo for Ruby on Rails (http://www.bingocardcreator.com/abingo), Visual Website Optimizer (http://visualwebsiteoptimizer.com) and Google Website Optimizer (http://www.google.com/websiteoptimizer) for any technology.
The advantage of running a technology specific tool is mainly because of performance. Most technology-agnostic tools execute a javascript on your page to be able to execute the A/B testing logic where ABingo for example is executed on the server side (no additional http request)
What generic tools give you though is the ability to change your tests without changing your code.