Reinstalling rear wheel 01 CR250

I am in the process of installing the rear wheel on an 01 CR250. I cannot even with two people get the right side to line up for the axle to go through. I clip the brake assembly to the backside of the swingarm by slifding it into the grooves. No matter how much I lift pull or push I can't get the rubber grommet on the right side to line up with the hole that drops down from the brake assembly. The hole connected to the brake assembly lines up with the chain adjuster hole but the grommet always falls about an 3/8" below and to the outside of lining up.
What am I doing wrong? Spent 2 hours trying to get it to line up with another person.

Thanks :bang:

James,

Thanks for the reply. Yes I did make sure the rotor was in between the brake pads