just get the bulk of it of,,itll end up the same in good time,is it a rider or are you going to rebuild it?picture the chain wizzing around and the draught thatll pick up all the finest particles,thats why its so muddy and cruddy,wipe the worst of it away,if the seal was leaking it would have a wet "track" leading downwards and depositing oil underneath and rearwards as the wind blows it,your right being carefull with the seals,you dont want to do more than you have to.