Is this the crankshaft pulley you are referring to? if so it is keyed to the crankshaft, the key hasn't dropped out has it? If the pulley runs loose for any length of time it can wear the shaft which will make it sloppy but the nut will normally pull it right up tight.
Peter