I think generally people refer to midish for that type of stuff:

 

Might I query how you intend to remember all such mappings? </joke>

Particularly for live-performance, I feel it useful to have a very small set of inputs, with sensible "ranges", and then to musically explore the terrain they provide. 

Having 1664 controls would not let me create music: it would actually hinder me. Perhaps this is a personal thing, or perhaps you're trying to experiment with crazy workflows on purpose. Anyway, I'll just leave this here:

Cheers, -Harry