There's nothing wrong with unfriending, unfollowing, or even banning them to allow yourself some breathing room and solitude.