Unable to record audio in Azure VM when user logs out

Question

Unable to record audio in Azure VM when user logs out

Bharatee, Raktim 0

We have an Azure VM instance which is utilizing the Azure Speech to Text service. When I am logged-in to the VM I am able to run my python script which records a audio from a website(Captcha shown below) and then makes an API call to Speech to Text service and this works perfectly. But when I log out of the VM, python script is unable to record the audio for some reason. We have confirmed that the VM is able to connect to the internet because we are able to open the website. But after that it throws an error saying unable to record audio. Do we need to install some drivers or any form of configuration that needs to be done?

Would appreciate your help! captcha

romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-08-24T13:53:48.2933333+00:00

@Bharatee, Raktim Could you please add what the script is processing and how you are capturing the audio? Are you trying to automate a scenario through script which needs to enter the captcha to capture audio? Additional logging in your script should help you figure out the issue, if you are directly capturing audio, try to write it to file and then pass the audio file to the speechConfig audioConfig instance for text.

I would also recommend checking how the VM might behave if it is not logged in before trying to run the above scenario. Thanks!!

Shresht Kashyap 0

Hi @romungi-MSFT , I am from the same team as Raktim.

Following is the code snippet where we record the audio in python using SoundCard -

with sc.get_microphone(id=str(sc.default_speaker().name),
include_loopback=True).recorder(samplerate=SAMPLE_RATE) as mic:             
	t_end = time.time() + 5             
	while time.time() < t_end:                 
		_data = mic.record(numframes=int(SAMPLE_RATE*RECORD_SEC))                 
		if data is None:                     
			data = _data                 
		else:                     
			data = np.concatenate((data, _data))

And the traceback we get is as follows- Screenshot 2023-08-25 113835

As you can see, the problem occurs because python is not able to find any speaker connected to the VM and therefore throws a traceback. Is there a solution for this?

romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-08-25T07:01:32.9533333+00:00

@Bharatee, Raktim I think you are looking for the default microphone in this case to record audio. I am not familiar with VM behavior for enabling the same. I found this thread which talks about enabling the same and another 3rd party article on enabling microphone access to apps.

Your answer

romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-08-24T13:53:48.2933333+00:00

@Bharatee, Raktim Could you please add what the script is processing and how you are capturing the audio? Are you trying to automate a scenario through script which needs to enter the captcha to capture audio? Additional logging in your script should help you figure out the issue, if you are directly capturing audio, try to write it to file and then pass the audio file to the speechConfig audioConfig instance for text.

I would also recommend checking how the VM might behave if it is not logged in before trying to run the above scenario. Thanks!!
Shresht Kashyap 0 Reputation points

2023-08-25T06:12:57.3866667+00:00

Hi @romungi-MSFT , I am from the same team as Raktim.

Following is the code snippet where we record the audio in python using SoundCard -

with sc.get_microphone(id=str(sc.default_speaker().name), include_loopback=True).recorder(samplerate=SAMPLE_RATE) as mic: t_end = time.time() + 5 while time.time() < t_end: _data = mic.record(numframes=int(SAMPLE_RATE*RECORD_SEC)) if data is None: data = _data else: data = np.concatenate((data, _data))

And the traceback we get is as follows-

As you can see, the problem occurs because python is not able to find any speaker connected to the VM and therefore throws a traceback. Is there a solution for this?
romungi-MSFT 48,911 Reputation points Microsoft Employee Moderator

2023-08-25T07:01:32.9533333+00:00

@Bharatee, Raktim I think you are looking for the default microphone in this case to record audio. I am not familiar with VM behavior for enabling the same. I found this thread which talks about enabling the same and another 3rd party article on enabling microphone access to apps.

Share via

Unable to record audio in Azure VM when user logs out

Your answer