KZ650 Shift drum removal, HELP!

So the shift drum is the last hing I have left to strip from my lower cases so I can refinish them and it is kicking my a$$!
I took out the cotter pin from the 4/5th fork so it is free. I took out the plate held on by 2 screws as well as the snap ring.
In my manual it says to remove the screw that holds on the pin plate as well as the pins. That sucked even with a hand impact it took me forever to get the screw out destroying it in the process.
So now I am left with the shift drum stripped on both ends with the shift fork freely sliding on the drum.
So which side do I drive it out from, my crappy manual looks like I hit the end where the pins were. I beat the dog $hit out of this thing and it did not budge, what am I missing here?

One bolt

I am a dumbass sir! Got it.