it doesn't seem to be moving... so I'm guessing I need a new cap??
By cap you mean thermostat head with numbers on and not a plastic cap that looks like a bottle top? You could replace the thermostat head (the majority are universal) but you can't buy the head without the whole valve.