Same thing happened on my 85 CR, couldnt get the damn thing out no matter what we did, so what we ended up doing last was putting a bolt inside the end of the swingarm pivot bolt (so we wouldnt fray the end of the swing arm bolt) then we took an air hammer to it on the nut side, while turning it with an impact gun on the other side, every 5 minutes of hammering we would stop, and move the swingarm up and down and wiggle it back and forth. After about half an hour of constant hammering, and the expense of my hearing, it finally came out.
And well... all of this could have been avoided if the previous owner WOULD HAVE GREASED THEIR BEARINGS!!!