The challenge of online musical improvisation

Gentlemen, maybe you can help!
As part of the organization of an information resource, a nontrivial task has arisen - it is necessary to implement through Internet training free improvisation. The essence of the problem is to organize the interaction of musicians without delay, because then the essence of collective improvisation is lost. It seems as though it is clear that this cannot happen, it is necessary to encode the played music, transfer the improvisation to another participant, the recipient must decode the music. We can consider the first and last stage to be quite small (well, let's say that there are good machines), but the stage of transferring encoded music and the stage of downloading, even with a good channel, these participants will spend seconds on this action, and it’s not the musician who will adequately react to the actions of the opponent. For now, we can minimize the second stage, if we assume that the musicians do not care about the good coding quality, that is, we use streaming audio technologies. For subsequent listening, the recording will be stored on the user's computer in a decent quality and subsequently transferred to ... suppose the server is for information. But it seems to me that there could be a more elegant solution.