Automatic tensioner removal/installation

I have a double wedge auto tensioner on my '80 kz750. The lock screw feel out at some point, I rode for a while unknowing and just got a replacement. My question is, can I just screw the new bolt in? Or do I need to take it all off and do that whole thing?

The bike runs fine when warmed up and I rode it with no problems for weeks. The only reason I realized something was wrong was cuz oil was leading from the screw hole.

if you take one of the mounting bolts and screw it in the side it will lock the tensioner and you can take it off.