Manage voice recognition technology controls for an Intelligent Speaker

• Applies to:

  Microsoft Teams

An Intelligent Speaker uses voice profile information to recognize who said what in live transcription. When a Microsoft Teams Rooms on Windows meeting room is equipped with an Intelligent Speaker, live transcription can be used during the meeting. This article explains how you, a tenant admin, control the voice profiling that's used for voice recognition to generate live transcription. You can control to what degree the organization is using voice recognition and the following features:

• Edit the speaker's name in transcripts.
• Change the speaker of a single utterance in the transcript or change the speaker in all the utterances in the transcript (but not on future transcripts).
• Change the speaker identification for the people who are listed in the meeting.
• Remove the identification of one or more utterances identified as that speaker, on every transcript.

Review Intelligent Speaker requirements

An Intelligent Speaker includes a special seven-microphone array. The system uses voice profile information to identify voices of up to 10 people in meeting rooms.

The following items are Intelligent Speaker requirements:

• The meeting room should have a maximum of 10 people present in person.
• The meeting room has an upload link of minimum 7 Mbps.

Epos, Jabra, Sennheiser, and Yealink Intelligent Speakers are supported.

Note

Intelligent Speaker is available in all countries and regions. See Supported locales for a list of the locales currently supported for biometric enrollment and in-meeting transcription.

Set up an Intelligent Speaker

An Intelligent Speaker connects directly using USB to the Teams Rooms console or compute module.

Note

We don't support an Intelligent Speaker connected to Logitech Surface Pro Microsoft Teams Rooms. There is a known issue that Teams Rooms can't recognize the Intelligent Speaker through the dock.

An Intelligent Speaker that is of a speakerphone design should be placed at least 8 inches (20 cm) away from walls and large objects, such as laptops. If the Intelligent Speaker USB cable isn't long enough for your setup, use cable extenders.

1. Sign in to the console as administrator.

2. Set the Teams device settings to match the Intelligent Speaker microphone and speaker. You can also do this through the Microsoft Teams admin center (TAC) portal instead of at the room console.

   The diagram shows how the Intelligent Speaker is connected to the device if the device includes a data box.

   

   The diagram shows how the Intelligent Speaker is connected to the device if the device doesn't include a data box.

   

Note

EPOS and Yealink devices should have "EPOS" or "Yealink" prefix and contain "UAC2_RENDER" in the speaker name and "UAC2_TEAMS" in the microphone name. If you don't find these microphone and speaker names in the dropdown menu, restart the Intelligent Speaker device.

The Jabra Panacast 50 connects directly to the Microsoft Teams Rooms compute module and not the center of table console. For the Jabra PanaCast 50, make sure you set the Playback Device Type to Microsoft Teams Rooms device. After restarting the Jabra PanaCast 50 you should see devices with "UAC2_RENDER" in the speaker name and "UAC2_TEAMS" in the microphone name.

Enable an Intelligent Speaker user recognition

Voice profile data can be used in any meeting with an Intelligent Speaker. See Teams meetings policies and the PowerShell meeting cmdlets for information on the meeting settings.

Note

If your voice profile isn't available under the Recognition tab in Settings and you aren't being attributed in transcriptions, re-enroll your Voice Profile.

The voice profile data of the user is created when the policy is set to distinguish or a non-meeting invitee walks in during the meeting. The voice profile data is dismissed at the end of the meeting.

The following are the required policies to set an Intelligent Speaker and user recognition.

Policy	Description	Values and Behavior
enrollUserOverride	Use to set voice profile capture, or enrollment, in Teams settings for a tenant.	Disabled Users who have never enrolled can't view, enroll, or re-enroll. The entry point to the enrollment flow will be hidden. If users select a link to the enrollment page, they'll see a message that states this feature isn't enabled for their organization. Users who have enrolled can view and remove their voice profile in the Teams settings. Once they remove their voice profile, they won't be able to view, access, or complete the enrollment flow. Enabled Users can view, access, and complete the enrollment flow. The entry point will show on Teams settings page under the Recognition tab.
roomAttributeUserOverride	Control the voice-based user identification in meeting rooms. This setting is required for Teams Rooms accounts.	Off The Teams Rooms device won't send audio stream-saving bandwidth from the room. Meeting room users won't be attributed or distinguished, and their voice signatures won't be retrieved or used at all. Meeting room users are unknown. Attribute Rooms users will be attributed based on their enrollment status. Users who are enrolled are shown with their name in the transcription. Users who aren't enrolled show as Speaker <n>. The Teams Rooms device will send seven audio streams from the room. Distinguish Rooms users will be distinguished and separated as speaker 1, speaker 2, ....speaker <n> in the transcription. Irrespective of enrollment status of the user, their name will not show in the transcription. The Teams Rooms device will send seven audio streams from the room.
AllowTranscription	Required for user and Teams rooms accounts.	True and False

In the Teams admin center, set the Transcription policy. Settings are Off by default.

Note

After a policy is assigned, they can take up to 48 hours to take effect. To get the policy to take effect sooner, accounts must be signed out and signed back in.

Frequently asked questions (FAQ)

Where is the voice profile data stored?

Voice profile data is stored in Office 365 cloud with user content.

What is the retention timeline and policy?

General retention policy is stated in the Data retention overview. In addition, a user's voice profile data will be deleted after 1 year if the user isn't invited to any meetings with an Intelligent Speaker within that 1-year period. Data isn't used in any meetings for existing employees. If an employee has left the company, voice profile data is considered user content and is treated as such per Office 365 data retention policy described in the Data retention overview.

Is voice profile data used across Microsoft services?

No, voice profile data is only used for the purpose for which the user has provided consent. Microsoft will not use the voice profile data except within Teams voice recognition scenarios.

Is my voice profile data used when I join a meeting in another organization?

No only in meetings organized by a user in your organization.

How can I export my voice profile?

Your IT admin can export your audio data at any time.

Supported locales

The following enrollment and in-meeting transcription locales are supported in all countries and regions.

Enrollment locales

End-users can enroll their voices for recognition in the following locales:

Language	Country/Region	Culture ID
Arabic	Saudi Arabia	ar-SA
Chinese	China	zh-CN
Chinese	Taiwan	zh-TW
Danish	Denmark	da-DK
Dutch	Netherlands	nl-NL
English	Australia	en-AU
English	Canada	en-CA
English	India	en-IN
English	New Zealand	en-NZ
English	United Kingdom	en-GB
English	United States	en-US
Finnish	Finland	fi-FI
French	Canada	fr-CA
French	France	fr-FR
Italian	Italy	it-IT
Japanese	Japan	ja-JP
Norwegian	Norway	nb-NO
Polish	Poland	pl-PL
Portuguese	Brazil	pt-BR
Russian	Russia	ru-RU
Swedish	Sweden	sv-SE
Spanish	Mexico	es-MX
Spanish	Spain	es-ES

In-meeting transcription locales

Once an end-user enrolls, their voice can be recognized during meetings and identified in the transcription when the meeting is set to one of the following locales:

Language	Country/Region	Culture ID
Chinese (Simplified)	China	zh-CN
English	Australia	en-AU
English	Canada	en-CA
English	India	en-IN
English	New Zealand	en-NZ
English	United Kingdom	en-GB
English	United States	en-US
French	Canada	fr-CA
French	France	fr-FR
German	Germany	de-DE
Italian	Italy	it-IT
Japanese	Japan	ja-JP
Korean	Korea	ko-KR
Portuguese	Brazil	pt-BR
Spanish	Mexico	es-MX
Spanish	Spain	es-ES

Related topics

Support article: Use Intelligent Speakers to Identify in-room participants