Usually this is implemented in (cheap) USB hubs by switching VBUS. (in fact I have a hub that does just that). Since most keyboards designs will most likely shut down (because they use VBUS as a power source) if VBUS voltage drops or is disconnected that is the best way.
Adding a switch to ground is unnecessary and could create common mode noise through extra resistance.
Adding a switch to all wires is also complicated because the switch would need to preserve the 90Ω characteristic impedance of the data lines (if not you get reflections noise and data loss. You would need to be able to find a 90Ω switch for both data lines (or transistor switches/buffer)