Hey @Sam_Stern,
it is unlikely that the problem is with the output stage. When using APIs on error state Pause/Play on event will not operate on audio streams. In such case Stop/Play works better as there is no resume data from the remote streams hence requesting new endpoint data.
When the problem occurs, please post link to your debug log.
If this is API methods issue - perhaps this may help you.
Kind Regards,