Dynamically adjusting the number of channels of a polyphonic signal

I can’t promise that it won’t click in your setup, but might be worth trying out Polyphonic Mute by Count Modula:

There is a small example patch at: