If we had true bypass and CV ports, a plugin can do that.
The plug simply measure the time between two jack callbacks, compare the result with the DSP time frame and send a CV switch off message when the time hits a given threshold (several times, maybe). The user could connect what ever plug bypass port to the CV out port from this watchdog plug and.
Say, 3 times behind each other, the threshold is reached, Send off message.
We use a similar watchdog in guitarix, to switch off the convolver, when needed, and it works pretty well.