Rally 180 rear oil seal, do I need to press it in?

Hello All, I am rebuilding a 1971 Rally 180 VSD (first time) and have a question about the oil seal for the rear axle. I have pushed it in by hand (see picture) but there is about a 4 mm gap between the oil seal and the bearing. Do I need to press it in further until the outer rim contacts the outer rim of the bearing?

Kind regards
Jeff