This can be done from the same place where you create new tags. If any customers/contacts have the tag, then it will be removed from them, and there’s no undo button, so please use with caution!