It is designed to remove "camera shake"
If you think you will have camera shake, then turn it on.
It will run down the battery on your camera, that is give you less shots per charge if left on, or used all the time.
I can hand hold without shake at 1/250 all the time and 1/125 if I pay attention, 1/60 if I take time to steady myself and control my breathing, however VR has spoiled me, and I am becoming lazy, so under 1/250 I use it.
It is a tool to be used and as with any tool, should you take time to learn to use it properly, then, you will get better results.