So….let me get this straight. You had a working fortress to use, but abandoned that to set up your new lair over in an abandoned cave fortress, and you are surprised that Squatters came to do the thing you just did?