Well, I ran into the same type of problem today. The people at dealerships, or whoever put bikes together, do not own torque wrenches in my opinion. So, in order to break nuts loose (I don't own an impact wrench), I slip a pipe over the end of the wrench or ratchet. You just have to be careful and use your free hand to keep the socket or wrench perfectly centered. Hope this helps.
After looking at the pic I believe it will be easier to take that bolt out if the swingarm is attached.