This behavior was reported as a bug in the beta versions of Tahoe. Apparently it hasn’t been fixed yet.
As a workaround, you can delete the file
~/Library/GroupContainersAlias/group.com.apple.controlcenter/Library/Preferences/group.com.apple.controlcenter.plist and log out. This action will reset all menu bar settings to the defaults. Not really worth it if you've gone to any trouble to customize those settings.
Even less worthwhile, in my opinion, wouldIt should also be possible be to edit the above file selectively. I haven't done this myself, and only an advanced user should try itthough it's likely more trouble than it's worth. Apple seems to have gone out of its way to make it difficult, and I can see why they haven't gotten around to fixing the bug.
The file is a property list with a string-valued key trackedApplications whose value is a base64-encoded property list. That plist has a key-value pair for each application that appears in the settings panel. You would have to decode it, remove the unwanted keys, then re-encode it and paste the resulting string back into the plist named above. Then log out. If you're going to try this, make sure to back up the file first.