A drop of green loctite will keep it from moving until you want it to. It is designed
precisely for apps like this. You apply the drop on the edge of the threads and it creeps in.
But you can easily overcome the resistance when needed. If you move the threads then
you would need to reapply another drop or two.