This is called oil migration in the bike.
I have experience from my 450. Here is what you will need:
right side crank seal
right side cover gasket and any water pump o rings there for the dowls
both bearings for the counterbalancer and the seal for the counter balancer
left side cover gasket
you will need to move both left and right side case covers. Remove counterbalancer nut, and the shaft. remove the seal and drive out both bearings. replace. Then pull the crank gear (after removing the clutch basket) and replace that seal. Be sure to polish the counterbalancer shaft before reinstalling.