As far as I know this problem happens when you have a lot of vrscene objects in your scene. My best solution is to use vrscene objects if there are several instances (trees, furniture, etc), and if I plan to scatter a lot of instances (like grass or pebbles) it's better to use vrmesh. The exact threshold depends on your hardware.