What sort of switch are you using? To be able to reverse the polarity you need a SPDT or DPDT momentary switch, if you use the middle and one outside lug you get one polarity, eg: switch is open and closes when you press it. If you use the middle lug and the other outside lug you get the opposite eg: switch is closed and opens when you press it.