I'd be looking at freewheeling. You can do quite a lot of this with
that. Even more if you hook it up to, say, JackRack (or Ardour) and
use MIDI control on the plugin parameters there.
But that said, there is are very specific reasons why Live exists,
and this is one of them.