RelationshipNotifier

Notifies you when a friend, group chat, or server removes you.

Included in the installer. Enable it in Discord Settings → NightCord → Plugins.