Hey,

I think that you would be a lot better off using a sampler (like Specimen.. :-)
and sending it MIDI commands when you want your sample triggered.

This MIDI event spitter could be programmed in: Python, C++ Java, Shell Script, etc etc

Then connect your MIDI event spitter to the sampler, Voila... ;-)

Or did I misunderstand you request?
-Harry

Note that I dont discourage donating funds to the developers of Kluppe or any GPL/ish softwares