Turn signal problems

Guys,

Got a Canadian KZ750L.
I have those thermal turn signal modules one for 4-way and one for turn signal.
I don’t care for the 4 way mode so I unhooked it and want just the flasher mode.
so I wired it.
Battery---ignition---flasher---handlebar switch---turn signals.
on the handlerbar switch--orange wire for power in the center grey and green for right and left respectively.

When I turn the switch to the right both left and right go on and visa versa for left.
Is it the handlebar switch?
What is it?

Thanks guys.