As far as filling the hole is concerned, it would depend, to some extent, on what finish you need outside.
If facing brick, then ideally obtain a couple of matching bricks, cut them around the duct that you will install for the dryer, then neatly mortar the bricks in place.
If you have...