@Mike Lawrence , Welcome to Microsoft Q&A! Thanks for posting this good question.
I suggest you take a look at the approach, test with the sample charted in the document –Azure Technology for Call Centers – the doc captures and outlines the exact scenario/requirement you described - A typical speech service for telephony data- Call Centers, internally we are using the technologies highlighted in the document to analyze in real-time Microsoft customer calls as they happen, as illustrated in the following diagram.
Having mentioned above, Azure Media Service & Azure Cognitive Service forums are yet to be migrated to Q&A. Feel free to post your question directly on the MSDN forum for the service (Azure Cognitive Service forum /Azure Media Service forum) for receiving inputs from the targeting audience.
We are actively working to onboard all services. We will make a public announcement once complete.
Thank you for your patience as we evolve the Q&A platform.
You may wish to know about Introducing Microsoft Q&A (Preview) and the supported products (Tags).