Why couldn't you just connect the computers with some form of digital audio I/O (ADAT?). Of course there will be some latency, but since you're dealing with mostly pre-recorded stuff anyway, does it matter? Inject your live inputs at the last stage of the chain and you should be fine.