Hey,
I think that you would be a lot better off using a sampler (like Specimen.. :-)
and sending it MIDI commands when you want your sample triggered.
This MIDI event spitter could be programmed in: Python, C++ Java, Shell Script, etc etc
Then connect your MIDI event spitter to the sampler, Voila... ;-)
Or did I misunderstand you request?
-Harry
Note that I dont discourage donating funds to the developers of Kluppe or any GPL/ish softwares