Air vents are not just for boilers, they also stop condensation and mould build up. You could end up with a damp problem.
I would suggest maybe blocking one and put an open/close vent cover on the other.
You are more likely to get problems if you have solid brick walls.
where the cold from...