Transforms - List
List Transforms
Lists the Transforms in the account.
GET https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.Media/mediaServices/{accountName}/transforms?api-version=2022-07-01
GET https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.Media/mediaServices/{accountName}/transforms?api-version=2022-07-01&$filter={$filter}&$orderby={$orderby}
URI Parameters
Name | In | Required | Type | Description |
---|---|---|---|---|
account
|
path | True |
string |
The Media Services account name. |
resource
|
path | True |
string |
The name of the resource group within the Azure subscription. |
subscription
|
path | True |
string |
The unique identifier for a Microsoft Azure subscription. |
api-version
|
query | True |
string |
The version of the API to be used with the client request. |
$filter
|
query |
string |
Restricts the set of items returned. |
|
$orderby
|
query |
string |
Specifies the key by which the result collection should be ordered. |
Responses
Name | Type | Description |
---|---|---|
200 OK |
OK |
|
Other Status Codes |
Detailed error information. |
Examples
Lists the Transforms |
Lists the Transforms filter by created |
Lists the Transforms filter by lastmodified |
Lists the Transforms filter by name |
Lists the Transforms
Sample request
Sample response
{
"value": [
{
"name": "sampleEncode",
"id": "/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/contosoresources/providers/Microsoft.Media/mediaservices/contosomedia/transforms/sampleEncode",
"type": "Microsoft.Media/mediaservices/transforms",
"properties": {
"created": "2022-10-17T23:14:30.2486761Z",
"description": "A sample Transform using the Standard Encoder with a built in preset.",
"lastModified": "2022-10-17T23:14:30.2486761Z",
"outputs": [
{
"onError": "StopProcessingJob",
"relativePriority": "Normal",
"preset": {
"@odata.type": "#Microsoft.Media.BuiltInStandardEncoderPreset",
"presetName": "AdaptiveStreaming"
}
}
]
},
"systemData": {
"createdBy": "contoso@microsoft.com",
"createdByType": "User",
"createdAt": "2022-10-17T23:14:30.2486761Z",
"lastModifiedBy": "contoso@microsoft.com",
"lastModifiedByType": "User",
"lastModifiedAt": "2022-10-17T23:14:30.2486761Z"
}
},
{
"name": "sampleEncodeAndVideoIndex",
"id": "/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/contosoresources/providers/Microsoft.Media/mediaservices/contosomedia/transforms/sampleEncodeAndVideoIndex",
"type": "Microsoft.Media/mediaservices/transforms",
"properties": {
"created": "2022-10-17T23:14:30.4774769Z",
"description": "A sample Transform using the Standard Encoder with a built-in preset, as well as the Video Analyzer.",
"lastModified": "2022-10-17T23:14:30.4774769Z",
"outputs": [
{
"onError": "StopProcessingJob",
"relativePriority": "Normal",
"preset": {
"@odata.type": "#Microsoft.Media.BuiltInStandardEncoderPreset",
"presetName": "AdaptiveStreaming"
}
},
{
"onError": "StopProcessingJob",
"relativePriority": "Normal",
"preset": {
"@odata.type": "#Microsoft.Media.VideoAnalyzerPreset",
"mode": "Standard",
"insightsToExtract": "AllInsights"
}
}
]
},
"systemData": {
"createdBy": "contoso@microsoft.com",
"createdByType": "User",
"createdAt": "2022-10-17T23:14:30.4774769Z",
"lastModifiedBy": "contoso@microsoft.com",
"lastModifiedByType": "User",
"lastModifiedAt": "2022-10-17T23:14:30.4774769Z"
}
}
]
}
Lists the Transforms filter by created
Sample request
GET https://management.azure.com/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/contosoresources/providers/Microsoft.Media/mediaServices/contosomedia/transforms?api-version=2022-07-01&$filter=properties/created gt 2021-06-01T00:00:00.0000000Z and properties/created le 2021-06-01T00:00:10.0000000Z&$orderby=properties/created
Sample response
{
"value": [
{
"name": "sampleEncodeAndVideoIndex",
"id": "/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/contosoresources/providers/Microsoft.Media/mediaservices/contosomedia/transforms/sampleEncodeAndVideoIndex",
"type": "Microsoft.Media/mediaservices/transforms",
"properties": {
"created": "2021-06-01T00:00:10Z",
"description": "A sample Transform using the Video Analyzer.",
"lastModified": "2021-06-01T00:00:10Z",
"outputs": [
{
"onError": "StopProcessingJob",
"relativePriority": "Normal",
"preset": {
"@odata.type": "#Microsoft.Media.VideoAnalyzerPreset",
"mode": "Standard",
"insightsToExtract": "AllInsights"
}
}
]
},
"systemData": {
"createdBy": "contoso@microsoft.com",
"createdByType": "User",
"createdAt": "2021-06-01T00:00:10Z",
"lastModifiedBy": "contoso@microsoft.com",
"lastModifiedByType": "User",
"lastModifiedAt": "2021-06-01T00:00:10Z"
}
}
]
}
Lists the Transforms filter by lastmodified
Sample request
GET https://management.azure.com/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/contosoresources/providers/Microsoft.Media/mediaServices/contosomedia/transforms?api-version=2022-07-01&$filter=properties/lastmodified gt 2021-06-01T00:00:00.0000000Z and properties/lastmodified le 2021-06-01T00:00:10.0000000Z&$orderby=properties/lastmodified desc
Sample response
{
"value": [
{
"name": "sampleEncodeAndVideoIndex",
"id": "/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/contosoresources/providers/Microsoft.Media/mediaservices/contosomedia/transforms/sampleEncodeAndVideoIndex",
"type": "Microsoft.Media/mediaservices/transforms",
"properties": {
"created": "2021-06-01T00:00:10Z",
"description": "A sample Transform using the Video Analyzer.",
"lastModified": "2021-06-01T00:00:10Z",
"outputs": [
{
"onError": "StopProcessingJob",
"relativePriority": "Normal",
"preset": {
"@odata.type": "#Microsoft.Media.VideoAnalyzerPreset",
"mode": "Standard",
"insightsToExtract": "AllInsights"
}
}
]
},
"systemData": {
"createdBy": "contoso@microsoft.com",
"createdByType": "User",
"createdAt": "2021-06-01T00:00:10Z",
"lastModifiedBy": "contoso@microsoft.com",
"lastModifiedByType": "User",
"lastModifiedAt": "2021-06-01T00:00:10Z"
}
}
]
}
Lists the Transforms filter by name
Sample request
GET https://management.azure.com/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/contosoresources/providers/Microsoft.Media/mediaServices/contosomedia/transforms?api-version=2022-07-01&$filter=(name eq 'sampleEncode') or (name eq 'sampleEncodeAndVideoIndex')&$orderby=name desc
Sample response
{
"value": [
{
"name": "sampleEncodeAndVideoIndex",
"id": "/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/contosoresources/providers/Microsoft.Media/mediaservices/contosomedia/transforms/sampleEncodeAndVideoIndex",
"type": "Microsoft.Media/mediaservices/transforms",
"properties": {
"created": "2022-10-17T23:14:31.2387023Z",
"description": "A sample Transform using the Standard Encoder with a built-in preset, as well as the Video Analyzer.",
"lastModified": "2022-10-17T23:14:31.2387023Z",
"outputs": [
{
"onError": "StopProcessingJob",
"relativePriority": "Normal",
"preset": {
"@odata.type": "#Microsoft.Media.BuiltInStandardEncoderPreset",
"presetName": "AdaptiveStreaming"
}
},
{
"onError": "StopProcessingJob",
"relativePriority": "Normal",
"preset": {
"@odata.type": "#Microsoft.Media.VideoAnalyzerPreset",
"mode": "Standard",
"insightsToExtract": "AllInsights"
}
}
]
},
"systemData": {
"createdBy": "contoso@microsoft.com",
"createdByType": "User",
"createdAt": "2022-10-17T23:14:31.2387023Z",
"lastModifiedBy": "contoso@microsoft.com",
"lastModifiedByType": "User",
"lastModifiedAt": "2022-10-17T23:14:31.2387023Z"
}
},
{
"name": "sampleEncode",
"id": "/subscriptions/00000000-0000-0000-0000-000000000000/resourceGroups/contosoresources/providers/Microsoft.Media/mediaservices/contosomedia/transforms/sampleEncode",
"type": "Microsoft.Media/mediaservices/transforms",
"properties": {
"created": "2022-10-17T23:14:31.2387023Z",
"description": "A sample Transform using the Standard Encoder with a built in preset.",
"lastModified": "2022-10-17T23:14:31.2387023Z",
"outputs": [
{
"onError": "StopProcessingJob",
"relativePriority": "Normal",
"preset": {
"@odata.type": "#Microsoft.Media.BuiltInStandardEncoderPreset",
"presetName": "AdaptiveStreaming"
}
}
]
},
"systemData": {
"createdBy": "contoso@microsoft.com",
"createdByType": "User",
"createdAt": "2022-10-17T23:14:31.2387023Z",
"lastModifiedBy": "contoso@microsoft.com",
"lastModifiedByType": "User",
"lastModifiedAt": "2022-10-17T23:14:31.2387023Z"
}
}
]
}
Definitions
Name | Description |
---|---|
Aac |
Describes Advanced Audio Codec (AAC) audio encoding settings. |
Aac |
The encoding profile to be used when encoding audio with AAC. |
Analysis |
Specifies the maximum resolution at which your video is analyzed. The default behavior is "SourceResolution," which will keep the input video at its original resolution when analyzed. Using "StandardDefinition" will resize input videos to standard definition while preserving the appropriate aspect ratio. It will only resize if the video is of higher resolution. For example, a 1920x1080 input would be scaled to 640x360 before processing. Switching to "StandardDefinition" will reduce the time it takes to process high resolution video. It may also reduce the cost of using this component (see https://azure.microsoft.com/en-us/pricing/details/media-services/#analytics for details). However, faces that end up being too small in the resized video may not be detected. |
Audio |
Defines the common properties for all audio codecs. |
Audio |
Determines the set of audio analysis operations to be performed. If unspecified, the Standard AudioAnalysisMode would be chosen. |
Audio |
The Audio Analyzer preset applies a pre-defined set of AI-based analysis operations, including speech transcription. Currently, the preset supports processing of content with a single audio track. |
Audio |
Describes the properties of an audio overlay. |
Blur |
Blur type |
Built |
Describes a built-in preset for encoding the input video with the Standard Encoder. |
Complexity |
Allows you to configure the encoder settings to control the balance between speed and quality. Example: set Complexity as Speed for faster encoding but less compression efficiency. |
Copy |
A codec flag, which tells the encoder to copy the input audio bitstream. |
Copy |
A codec flag, which tells the encoder to copy the input video bitstream without re-encoding. |
created |
The type of identity that created the resource. |
DDAudio |
Describes Dolby Digital Audio Codec (AC3) audio encoding settings. The current implementation for Dolby Digital Audio support are: Audio channel numbers at 1((mono), 2(stereo), 6(5.1side); Audio sampling frequency rates at: 32K/44.1K/48K Hz; Audio bitrate values as AC3 specification supports: 32000, 40000, 48000, 56000, 64000, 80000, 96000, 112000, 128000, 160000, 192000, 224000, 256000, 320000, 384000, 448000, 512000, 576000, 640000 bps. |
Deinterlace |
Describes the de-interlacing settings. |
Deinterlace |
The deinterlacing mode. Defaults to AutoPixelAdaptive. |
Deinterlace |
The field parity for de-interlacing, defaults to Auto. |
Encoder |
The built-in preset to be used for encoding videos. |
Entropy |
The entropy mode to be used for this layer. If not specified, the encoder chooses the mode that is appropriate for the profile and level. |
Error |
The resource management error additional info. |
Error |
The error detail. |
Error |
Error response |
Face |
Describes all the settings to be used when analyzing a video in order to detect (and optionally redact) all the faces present. |
Face |
This mode provides the ability to choose between the following settings: 1) Analyze - For detection only.This mode generates a metadata JSON file marking appearances of faces throughout the video.Where possible, appearances of the same person are assigned the same ID. 2) Combined - Additionally redacts(blurs) detected faces. 3) Redact - This enables a 2-pass process, allowing for selective redaction of a subset of detected faces.It takes in the metadata file from a prior analyze pass, along with the source video, and a user-selected subset of IDs that require redaction. |
Fade |
Describes the properties of a Fade effect applied to the input media. |
Filters |
Describes all the filtering operations, such as de-interlacing, rotation etc. that are to be applied to the input media before encoding. |
H264Complexity |
Tells the encoder how to choose its encoding settings. The default value is Balanced. |
H264Layer |
Describes the settings to be used when encoding the input video into a desired output bitrate layer with the H.264 video codec. |
H264Rate |
The video rate control mode |
H264Video |
Describes all the properties for encoding a video with the H.264 codec. |
H264Video |
We currently support Baseline, Main, High, High422, High444. Default is Auto. |
H265Complexity |
Tells the encoder how to choose its encoding settings. Quality will provide for a higher compression ratio but at a higher cost and longer compute time. Speed will produce a relatively larger file but is faster and more economical. The default value is Balanced. |
H265Layer |
Describes the settings to be used when encoding the input video into a desired output bitrate layer with the H.265 video codec. |
H265Video |
Describes all the properties for encoding a video with the H.265 codec. |
H265Video |
We currently support Main. Default is Auto. |
Image |
Describes the basic properties for generating thumbnails from the input video |
Image |
Describes the properties for an output image file. |
Insights |
Defines the type of insights that you want the service to generate. The allowed values are 'AudioInsightsOnly', 'VideoInsightsOnly', and 'AllInsights'. The default is AllInsights. If you set this to AllInsights and the input is audio only, then only audio insights are generated. Similarly if the input is video only, then only video insights are generated. It is recommended that you not use AudioInsightsOnly if you expect some of your inputs to be video only; or use VideoInsightsOnly if you expect some of your inputs to be audio only. Your Jobs in such conditions would error out. |
Interleave |
Sets the interleave mode of the output to control how audio and video are stored in the container format. Example: set InterleavedOutput as NonInterleavedOutput to produce audio-only and video-only outputs in separate MP4 files. |
Jpg |
Describes the settings for producing JPEG thumbnails. |
Jpg |
Describes the properties for producing a series of JPEG images from the input video. |
Jpg |
Describes the settings to produce a JPEG image from the input video. |
Mp4Format |
Describes the properties for an output ISO MP4 file. |
Multi |
Describes the properties for producing a collection of GOP aligned multi-bitrate files. The default behavior is to produce one output file for each video layer which is muxed together with all the audios. The exact output files produced can be controlled by specifying the outputFiles collection. |
On |
A Transform can define more than one outputs. This property defines what the service should do when one output fails - either continue to produce other outputs, or, stop the other outputs. The overall Job state will not reflect failures of outputs that are specified with 'ContinueJob'. The default is 'StopProcessingJob'. |
Output |
Represents an output file produced. |
Png |
Describes the settings for producing PNG thumbnails. |
Png |
Describes the properties for producing a series of PNG images from the input video. |
Png |
Describes the settings to produce a PNG image from the input video. |
Preset |
An object of optional configuration settings for encoder. |
Priority |
Sets the relative priority of the TransformOutputs within a Transform. This sets the priority that the service uses for processing TransformOutputs. The default priority is Normal. |
Rectangle |
Describes the properties of a rectangular window applied to the input media before processing it. |
Rotation |
The rotation, if any, to be applied to the input video, before it is encoded. Default is Auto |
Standard |
Describes all the settings to be used when encoding the input video with the Standard Encoder. |
Stretch |
The resizing mode - how the input video will be resized to fit the desired output resolution(s). Default is AutoSize |
system |
Metadata pertaining to creation and last modification of the resource. |
Transform |
A Transform encapsulates the rules or instructions for generating desired outputs from input media, such as by transcoding or by extracting insights. After the Transform is created, it can be applied to input media by creating Jobs. |
Transform |
A collection of Transform items. |
Transform |
Describes the properties of a TransformOutput, which are the rules to be applied while generating the desired output. |
Transport |
Describes the properties for generating an MPEG-2 Transport Stream (ISO/IEC 13818-1) output video file(s). |
Video |
Describes the basic properties for encoding the input video. |
Video |
A video analyzer preset that extracts insights (rich metadata) from both audio and video, and outputs a JSON format file. |
Video |
Describes the properties of a video overlay. |
Video |
The Video Sync Mode |
AacAudio
Describes Advanced Audio Codec (AAC) audio encoding settings.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
bitrate |
integer |
The bitrate, in bits per second, of the output encoded audio. |
channels |
integer |
The number of channels in the audio. |
label |
string |
An optional label for the codec. The label can be used to control muxing behavior. |
profile |
The encoding profile to be used when encoding audio with AAC. |
|
samplingRate |
integer |
The sampling rate to use for encoding in hertz. |
AacAudioProfile
The encoding profile to be used when encoding audio with AAC.
Name | Type | Description |
---|---|---|
AacLc |
string |
Specifies that the output audio is to be encoded into AAC Low Complexity profile (AAC-LC). |
HeAacV1 |
string |
Specifies that the output audio is to be encoded into HE-AAC v1 profile. |
HeAacV2 |
string |
Specifies that the output audio is to be encoded into HE-AAC v2 profile. |
AnalysisResolution
Specifies the maximum resolution at which your video is analyzed. The default behavior is "SourceResolution," which will keep the input video at its original resolution when analyzed. Using "StandardDefinition" will resize input videos to standard definition while preserving the appropriate aspect ratio. It will only resize if the video is of higher resolution. For example, a 1920x1080 input would be scaled to 640x360 before processing. Switching to "StandardDefinition" will reduce the time it takes to process high resolution video. It may also reduce the cost of using this component (see https://azure.microsoft.com/en-us/pricing/details/media-services/#analytics for details). However, faces that end up being too small in the resized video may not be detected.
Name | Type | Description |
---|---|---|
SourceResolution |
string |
|
StandardDefinition |
string |
Audio
Defines the common properties for all audio codecs.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
bitrate |
integer |
The bitrate, in bits per second, of the output encoded audio. |
channels |
integer |
The number of channels in the audio. |
label |
string |
An optional label for the codec. The label can be used to control muxing behavior. |
samplingRate |
integer |
The sampling rate to use for encoding in hertz. |
AudioAnalysisMode
Determines the set of audio analysis operations to be performed. If unspecified, the Standard AudioAnalysisMode would be chosen.
Name | Type | Description |
---|---|---|
Basic |
string |
This mode performs speech-to-text transcription and generation of a VTT subtitle/caption file. The output of this mode includes an Insights JSON file including only the keywords, transcription,and timing information. Automatic language detection and speaker diarization are not included in this mode. |
Standard |
string |
Performs all operations included in the Basic mode, additionally performing language detection and speaker diarization. |
AudioAnalyzerPreset
The Audio Analyzer preset applies a pre-defined set of AI-based analysis operations, including speech transcription. Currently, the preset supports processing of content with a single audio track.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
audioLanguage |
string |
The language for the audio payload in the input using the BCP-47 format of 'language tag-region' (e.g: 'en-US'). If you know the language of your content, it is recommended that you specify it. The language must be specified explicitly for AudioAnalysisMode::Basic, since automatic language detection is not included in basic mode. If the language isn't specified or set to null, automatic language detection will choose the first language detected and process with the selected language for the duration of the file. It does not currently support dynamically switching between languages after the first language is detected. The automatic detection works best with audio recordings with clearly discernable speech. If automatic detection fails to find the language, transcription would fallback to 'en-US'." The list of supported languages is available here: https://go.microsoft.com/fwlink/?linkid=2109463 |
experimentalOptions |
object |
Dictionary containing key value pairs for parameters not exposed in the preset itself |
mode |
Determines the set of audio analysis operations to be performed. If unspecified, the Standard AudioAnalysisMode would be chosen. |
AudioOverlay
Describes the properties of an audio overlay.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
audioGainLevel |
number |
The gain level of audio in the overlay. The value should be in the range [0, 1.0]. The default is 1.0. |
end |
string |
The end position, with reference to the input video, at which the overlay ends. The value should be in ISO 8601 format. For example, PT30S to end the overlay at 30 seconds into the input video. If not specified or the value is greater than the input video duration, the overlay will be applied until the end of the input video if the overlay media duration is greater than the input video duration, else the overlay will last as long as the overlay media duration. |
fadeInDuration |
string |
The duration over which the overlay fades in onto the input video. The value should be in ISO 8601 duration format. If not specified the default behavior is to have no fade in (same as PT0S). |
fadeOutDuration |
string |
The duration over which the overlay fades out of the input video. The value should be in ISO 8601 duration format. If not specified the default behavior is to have no fade out (same as PT0S). |
inputLabel |
string |
The label of the job input which is to be used as an overlay. The Input must specify exactly one file. You can specify an image file in JPG, PNG, GIF or BMP format, or an audio file (such as a WAV, MP3, WMA or M4A file), or a video file. See https://aka.ms/mesformats for the complete list of supported audio and video file formats. |
start |
string |
The start position, with reference to the input video, at which the overlay starts. The value should be in ISO 8601 format. For example, PT05S to start the overlay at 5 seconds into the input video. If not specified the overlay starts from the beginning of the input video. |
BlurType
Blur type
Name | Type | Description |
---|---|---|
Black |
string |
Black: Black out filter |
Box |
string |
Box: debug filter, bounding box only |
High |
string |
High: Confuse blur filter |
Low |
string |
Low: box-car blur filter |
Med |
string |
Med: Gaussian blur filter |
BuiltInStandardEncoderPreset
Describes a built-in preset for encoding the input video with the Standard Encoder.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
configurations |
Optional configuration settings for encoder. Configurations is only supported for ContentAwareEncoding and H265ContentAwareEncoding BuiltInStandardEncoderPreset. |
|
presetName |
The built-in preset to be used for encoding videos. |
Complexity
Allows you to configure the encoder settings to control the balance between speed and quality. Example: set Complexity as Speed for faster encoding but less compression efficiency.
Name | Type | Description |
---|---|---|
Balanced |
string |
Configures the encoder to use settings that achieve a balance between speed and quality. |
Quality |
string |
Configures the encoder to use settings optimized to produce higher quality output at the expense of slower overall encode time. |
Speed |
string |
Configures the encoder to use settings optimized for faster encoding. Quality is sacrificed to decrease encoding time. |
CopyAudio
A codec flag, which tells the encoder to copy the input audio bitstream.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
label |
string |
An optional label for the codec. The label can be used to control muxing behavior. |
CopyVideo
A codec flag, which tells the encoder to copy the input video bitstream without re-encoding.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
label |
string |
An optional label for the codec. The label can be used to control muxing behavior. |
createdByType
The type of identity that created the resource.
Name | Type | Description |
---|---|---|
Application |
string |
|
Key |
string |
|
ManagedIdentity |
string |
|
User |
string |
DDAudio
Describes Dolby Digital Audio Codec (AC3) audio encoding settings. The current implementation for Dolby Digital Audio support are: Audio channel numbers at 1((mono), 2(stereo), 6(5.1side); Audio sampling frequency rates at: 32K/44.1K/48K Hz; Audio bitrate values as AC3 specification supports: 32000, 40000, 48000, 56000, 64000, 80000, 96000, 112000, 128000, 160000, 192000, 224000, 256000, 320000, 384000, 448000, 512000, 576000, 640000 bps.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
bitrate |
integer |
The bitrate, in bits per second, of the output encoded audio. |
channels |
integer |
The number of channels in the audio. |
label |
string |
An optional label for the codec. The label can be used to control muxing behavior. |
samplingRate |
integer |
The sampling rate to use for encoding in hertz. |
Deinterlace
Describes the de-interlacing settings.
Name | Type | Description |
---|---|---|
mode |
The deinterlacing mode. Defaults to AutoPixelAdaptive. |
|
parity |
The field parity for de-interlacing, defaults to Auto. |
DeinterlaceMode
The deinterlacing mode. Defaults to AutoPixelAdaptive.
Name | Type | Description |
---|---|---|
AutoPixelAdaptive |
string |
Apply automatic pixel adaptive de-interlacing on each frame in the input video. |
Off |
string |
Disables de-interlacing of the source video. |
DeinterlaceParity
The field parity for de-interlacing, defaults to Auto.
Name | Type | Description |
---|---|---|
Auto |
string |
Automatically detect the order of fields |
BottomFieldFirst |
string |
Apply bottom field first processing of input video. |
TopFieldFirst |
string |
Apply top field first processing of input video. |
EncoderNamedPreset
The built-in preset to be used for encoding videos.
Name | Type | Description |
---|---|---|
AACGoodQualityAudio |
string |
Produces a single MP4 file containing only AAC stereo audio encoded at 192 kbps. |
AdaptiveStreaming |
string |
Produces a set of GOP aligned MP4 files with H.264 video and stereo AAC audio. Auto-generates a bitrate ladder based on the input resolution, bitrate and frame rate. The auto-generated preset will never exceed the input resolution. For example, if the input is 720p, output will remain 720p at best. |
ContentAwareEncoding |
string |
Produces a set of GOP-aligned MP4s by using content-aware encoding. Given any input content, the service performs an initial lightweight analysis of the input content, and uses the results to determine the optimal number of layers, appropriate bitrate and resolution settings for delivery by adaptive streaming. This preset is particularly effective for low and medium complexity videos, where the output files will be at lower bitrates but at a quality that still delivers a good experience to viewers. The output will contain MP4 files with video and audio interleaved. |
ContentAwareEncodingExperimental |
string |
Exposes an experimental preset for content-aware encoding. Given any input content, the service attempts to automatically determine the optimal number of layers, appropriate bitrate and resolution settings for delivery by adaptive streaming. The underlying algorithms will continue to evolve over time. The output will contain MP4 files with video and audio interleaved. |
CopyAllBitrateNonInterleaved |
string |
Copy all video and audio streams from the input asset as non-interleaved video and audio output files. This preset can be used to clip an existing asset or convert a group of key frame (GOP) aligned MP4 files as an asset that can be streamed. |
DDGoodQualityAudio |
string |
Produces a single MP4 file containing only DD(Digital Dolby) stereo audio encoded at 192 kbps. |
H264MultipleBitrate1080p |
string |
Produces a set of 8 GOP-aligned MP4 files, ranging from 6000 kbps to 400 kbps, and stereo AAC audio. Resolution starts at 1080p and goes down to 180p. |
H264MultipleBitrate720p |
string |
Produces a set of 6 GOP-aligned MP4 files, ranging from 3400 kbps to 400 kbps, and stereo AAC audio. Resolution starts at 720p and goes down to 180p. |
H264MultipleBitrateSD |
string |
Produces a set of 5 GOP-aligned MP4 files, ranging from 1900kbps to 400 kbps, and stereo AAC audio. Resolution starts at 480p and goes down to 240p. |
H264SingleBitrate1080p |
string |
Produces an MP4 file where the video is encoded with H.264 codec at 6750 kbps and a picture height of 1080 pixels, and the stereo audio is encoded with AAC-LC codec at 128 kbps. |
H264SingleBitrate720p |
string |
Produces an MP4 file where the video is encoded with H.264 codec at 4500 kbps and a picture height of 720 pixels, and the stereo audio is encoded with AAC-LC codec at 128 kbps. |
H264SingleBitrateSD |
string |
Produces an MP4 file where the video is encoded with H.264 codec at 2200 kbps and a picture height of 480 pixels, and the stereo audio is encoded with AAC-LC codec at 128 kbps. |
H265AdaptiveStreaming |
string |
Produces a set of GOP aligned MP4 files with H.265 video and stereo AAC audio. Auto-generates a bitrate ladder based on the input resolution, bitrate and frame rate. The auto-generated preset will never exceed the input resolution. For example, if the input is 720p, output will remain 720p at best. |
H265ContentAwareEncoding |
string |
Produces a set of GOP-aligned MP4s by using content-aware encoding. Given any input content, the service performs an initial lightweight analysis of the input content, and uses the results to determine the optimal number of layers, appropriate bitrate and resolution settings for delivery by adaptive streaming. This preset is particularly effective for low and medium complexity videos, where the output files will be at lower bitrates but at a quality that still delivers a good experience to viewers. The output will contain MP4 files with video and audio interleaved. |
H265SingleBitrate1080p |
string |
Produces an MP4 file where the video is encoded with H.265 codec at 3500 kbps and a picture height of 1080 pixels, and the stereo audio is encoded with AAC-LC codec at 128 kbps. |
H265SingleBitrate4K |
string |
Produces an MP4 file where the video is encoded with H.265 codec at 9500 kbps and a picture height of 2160 pixels, and the stereo audio is encoded with AAC-LC codec at 128 kbps. |
H265SingleBitrate720p |
string |
Produces an MP4 file where the video is encoded with H.265 codec at 1800 kbps and a picture height of 720 pixels, and the stereo audio is encoded with AAC-LC codec at 128 kbps. |
EntropyMode
The entropy mode to be used for this layer. If not specified, the encoder chooses the mode that is appropriate for the profile and level.
Name | Type | Description |
---|---|---|
Cabac |
string |
Context Adaptive Binary Arithmetic Coder (CABAC) entropy encoding. |
Cavlc |
string |
Context Adaptive Variable Length Coder (CAVLC) entropy encoding. |
ErrorAdditionalInfo
The resource management error additional info.
Name | Type | Description |
---|---|---|
info |
object |
The additional info. |
type |
string |
The additional info type. |
ErrorDetail
The error detail.
Name | Type | Description |
---|---|---|
additionalInfo |
The error additional info. |
|
code |
string |
The error code. |
details |
The error details. |
|
message |
string |
The error message. |
target |
string |
The error target. |
ErrorResponse
Error response
Name | Type | Description |
---|---|---|
error |
The error object. |
FaceDetectorPreset
Describes all the settings to be used when analyzing a video in order to detect (and optionally redact) all the faces present.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
blurType |
Blur type |
|
experimentalOptions |
object |
Dictionary containing key value pairs for parameters not exposed in the preset itself |
mode |
This mode provides the ability to choose between the following settings: 1) Analyze - For detection only.This mode generates a metadata JSON file marking appearances of faces throughout the video.Where possible, appearances of the same person are assigned the same ID. 2) Combined - Additionally redacts(blurs) detected faces. 3) Redact - This enables a 2-pass process, allowing for selective redaction of a subset of detected faces.It takes in the metadata file from a prior analyze pass, along with the source video, and a user-selected subset of IDs that require redaction. |
|
resolution |
Specifies the maximum resolution at which your video is analyzed. The default behavior is "SourceResolution," which will keep the input video at its original resolution when analyzed. Using "StandardDefinition" will resize input videos to standard definition while preserving the appropriate aspect ratio. It will only resize if the video is of higher resolution. For example, a 1920x1080 input would be scaled to 640x360 before processing. Switching to "StandardDefinition" will reduce the time it takes to process high resolution video. It may also reduce the cost of using this component (see https://azure.microsoft.com/en-us/pricing/details/media-services/#analytics for details). However, faces that end up being too small in the resized video may not be detected. |
FaceRedactorMode
This mode provides the ability to choose between the following settings: 1) Analyze - For detection only.This mode generates a metadata JSON file marking appearances of faces throughout the video.Where possible, appearances of the same person are assigned the same ID. 2) Combined - Additionally redacts(blurs) detected faces. 3) Redact - This enables a 2-pass process, allowing for selective redaction of a subset of detected faces.It takes in the metadata file from a prior analyze pass, along with the source video, and a user-selected subset of IDs that require redaction.
Name | Type | Description |
---|---|---|
Analyze |
string |
Analyze mode detects faces and outputs a metadata file with the results. Allows editing of the metadata file before faces are blurred with Redact mode. |
Combined |
string |
Combined mode does the Analyze and Redact steps in one pass when editing the analyzed faces is not desired. |
Redact |
string |
Redact mode consumes the metadata file from Analyze mode and redacts the faces found. |
Fade
Describes the properties of a Fade effect applied to the input media.
Name | Type | Description |
---|---|---|
duration |
string |
The Duration of the fade effect in the video. The value can be in ISO 8601 format (For example, PT05S to fade In/Out a color during 5 seconds), or a frame count (For example, 10 to fade 10 frames from the start time), or a relative value to stream duration (For example, 10% to fade 10% of stream duration) |
fadeColor |
string |
The Color for the fade In/Out. it can be on the CSS Level1 colors https://developer.mozilla.org/en-US/docs/Web/CSS/color_value/color_keywords or an RGB/hex value: e.g: rgb(255,0,0), 0xFF0000 or #FF0000 |
start |
string |
The position in the input video from where to start fade. The value can be in ISO 8601 format (For example, PT05S to start at 5 seconds), or a frame count (For example, 10 to start at the 10th frame), or a relative value to stream duration (For example, 10% to start at 10% of stream duration). Default is 0 |
Filters
Describes all the filtering operations, such as de-interlacing, rotation etc. that are to be applied to the input media before encoding.
Name | Type | Description |
---|---|---|
crop |
The parameters for the rectangular window with which to crop the input video. |
|
deinterlace |
The de-interlacing settings. |
|
fadeIn |
Describes the properties of a Fade effect applied to the input media. |
|
fadeOut |
Describes the properties of a Fade effect applied to the input media. |
|
overlays | Overlay[]: |
The properties of overlays to be applied to the input video. These could be audio, image or video overlays. |
rotation |
The rotation, if any, to be applied to the input video, before it is encoded. Default is Auto |
H264Complexity
Tells the encoder how to choose its encoding settings. The default value is Balanced.
Name | Type | Description |
---|---|---|
Balanced |
string |
Tells the encoder to use settings that achieve a balance between speed and quality. |
Quality |
string |
Tells the encoder to use settings that are optimized to produce higher quality output at the expense of slower overall encode time. |
Speed |
string |
Tells the encoder to use settings that are optimized for faster encoding. Quality is sacrificed to decrease encoding time. |
H264Layer
Describes the settings to be used when encoding the input video into a desired output bitrate layer with the H.264 video codec.
Name | Type | Description |
---|---|---|
adaptiveBFrame |
boolean |
Whether or not adaptive B-frames are to be used when encoding this layer. If not specified, the encoder will turn it on whenever the video profile permits its use. |
bFrames |
integer |
The number of B-frames to be used when encoding this layer. If not specified, the encoder chooses an appropriate number based on the video profile and level. |
bitrate |
integer |
The average bitrate in bits per second at which to encode the input video when generating this layer. This is a required field. |
bufferWindow |
string |
The VBV buffer window length. The value should be in ISO 8601 format. The value should be in the range [0.1-100] seconds. The default is 5 seconds (for example, PT5S). |
crf |
number |
The value of CRF to be used when encoding this layer. This setting takes effect when RateControlMode of video codec is set at CRF mode. The range of CRF value is between 0 and 51, where lower values would result in better quality, at the expense of higher file sizes. Higher values mean more compression, but at some point quality degradation will be noticed. Default value is 23. |
entropyMode |
The entropy mode to be used for this layer. If not specified, the encoder chooses the mode that is appropriate for the profile and level. |
|
frameRate |
string |
The frame rate (in frames per second) at which to encode this layer. The value can be in the form of M/N where M and N are integers (For example, 30000/1001), or in the form of a number (For example, 30, or 29.97). The encoder enforces constraints on allowed frame rates based on the profile and level. If it is not specified, the encoder will use the same frame rate as the input video. |
height |
string |
The height of the output video for this layer. The value can be absolute (in pixels) or relative (in percentage). For example 50% means the output video has half as many pixels in height as the input. |
label |
string |
The alphanumeric label for this layer, which can be used in multiplexing different video and audio layers, or in naming the output file. |
level |
string |
We currently support Level up to 6.2. The value can be Auto, or a number that matches the H.264 profile. If not specified, the default is Auto, which lets the encoder choose the Level that is appropriate for this layer. |
maxBitrate |
integer |
The maximum bitrate (in bits per second), at which the VBV buffer should be assumed to refill. If not specified, defaults to the same value as bitrate. |
profile |
We currently support Baseline, Main, High, High422, High444. Default is Auto. |
|
referenceFrames |
integer |
The number of reference frames to be used when encoding this layer. If not specified, the encoder determines an appropriate number based on the encoder complexity setting. |
slices |
integer |
The number of slices to be used when encoding this layer. If not specified, default is zero, which means that encoder will use a single slice for each frame. |
width |
string |
The width of the output video for this layer. The value can be absolute (in pixels) or relative (in percentage). For example 50% means the output video has half as many pixels in width as the input. |
H264RateControlMode
The video rate control mode
Name | Type | Description |
---|---|---|
ABR |
string |
Average Bitrate (ABR) mode that hits the target bitrate: Default mode. |
CBR |
string |
Constant Bitrate (CBR) mode that tightens bitrate variations around target bitrate. |
CRF |
string |
Constant Rate Factor (CRF) mode that targets at constant subjective quality. |
H264Video
Describes all the properties for encoding a video with the H.264 codec.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
complexity |
Tells the encoder how to choose its encoding settings. The default value is Balanced. |
|
keyFrameInterval |
string |
The distance between two key frames. The value should be non-zero in the range [0.5, 20] seconds, specified in ISO 8601 format. The default is 2 seconds(PT2S). Note that this setting is ignored if VideoSyncMode.Passthrough is set, where the KeyFrameInterval value will follow the input source setting. |
label |
string |
An optional label for the codec. The label can be used to control muxing behavior. |
layers |
The collection of output H.264 layers to be produced by the encoder. |
|
rateControlMode |
The video rate control mode |
|
sceneChangeDetection |
boolean |
Whether or not the encoder should insert key frames at scene changes. If not specified, the default is false. This flag should be set to true only when the encoder is being configured to produce a single output video. |
stretchMode |
The resizing mode - how the input video will be resized to fit the desired output resolution(s). Default is AutoSize |
|
syncMode |
The Video Sync Mode |
H264VideoProfile
We currently support Baseline, Main, High, High422, High444. Default is Auto.
Name | Type | Description |
---|---|---|
Auto |
string |
Tells the encoder to automatically determine the appropriate H.264 profile. |
Baseline |
string |
Baseline profile |
High |
string |
High profile. |
High422 |
string |
High 4:2:2 profile. |
High444 |
string |
High 4:4:4 predictive profile. |
Main |
string |
Main profile |
H265Complexity
Tells the encoder how to choose its encoding settings. Quality will provide for a higher compression ratio but at a higher cost and longer compute time. Speed will produce a relatively larger file but is faster and more economical. The default value is Balanced.
Name | Type | Description |
---|---|---|
Balanced |
string |
Tells the encoder to use settings that achieve a balance between speed and quality. |
Quality |
string |
Tells the encoder to use settings that are optimized to produce higher quality output at the expense of slower overall encode time. |
Speed |
string |
Tells the encoder to use settings that are optimized for faster encoding. Quality is sacrificed to decrease encoding time. |
H265Layer
Describes the settings to be used when encoding the input video into a desired output bitrate layer with the H.265 video codec.
Name | Type | Description |
---|---|---|
adaptiveBFrame |
boolean |
Specifies whether or not adaptive B-frames are to be used when encoding this layer. If not specified, the encoder will turn it on whenever the video profile permits its use. |
bFrames |
integer |
The number of B-frames to be used when encoding this layer. If not specified, the encoder chooses an appropriate number based on the video profile and level. |
bitrate |
integer |
The average bitrate in bits per second at which to encode the input video when generating this layer. For example: a target bitrate of 3000Kbps or 3Mbps means this value should be 3000000 This is a required field. |
bufferWindow |
string |
The VBV buffer window length. The value should be in ISO 8601 format. The value should be in the range [0.1-100] seconds. The default is 5 seconds (for example, PT5S). |
crf |
number |
The value of CRF to be used when encoding this layer. This setting takes effect when RateControlMode of video codec is set at CRF mode. The range of CRF value is between 0 and 51, where lower values would result in better quality, at the expense of higher file sizes. Higher values mean more compression, but at some point quality degradation will be noticed. Default value is 28. |
frameRate |
string |
The frame rate (in frames per second) at which to encode this layer. The value can be in the form of M/N where M and N are integers (For example, 30000/1001), or in the form of a number (For example, 30, or 29.97). The encoder enforces constraints on allowed frame rates based on the profile and level. If it is not specified, the encoder will use the same frame rate as the input video. |
height |
string |
The height of the output video for this layer. The value can be absolute (in pixels) or relative (in percentage). For example 50% means the output video has half as many pixels in height as the input. |
label |
string |
The alphanumeric label for this layer, which can be used in multiplexing different video and audio layers, or in naming the output file. |
level |
string |
We currently support Level up to 6.2. The value can be Auto, or a number that matches the H.265 profile. If not specified, the default is Auto, which lets the encoder choose the Level that is appropriate for this layer. |
maxBitrate |
integer |
The maximum bitrate (in bits per second), at which the VBV buffer should be assumed to refill. If not specified, defaults to the same value as bitrate. |
profile |
We currently support Main. Default is Auto. |
|
referenceFrames |
integer |
The number of reference frames to be used when encoding this layer. If not specified, the encoder determines an appropriate number based on the encoder complexity setting. |
slices |
integer |
The number of slices to be used when encoding this layer. If not specified, default is zero, which means that encoder will use a single slice for each frame. |
width |
string |
The width of the output video for this layer. The value can be absolute (in pixels) or relative (in percentage). For example 50% means the output video has half as many pixels in width as the input. |
H265Video
Describes all the properties for encoding a video with the H.265 codec.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
complexity |
Tells the encoder how to choose its encoding settings. Quality will provide for a higher compression ratio but at a higher cost and longer compute time. Speed will produce a relatively larger file but is faster and more economical. The default value is Balanced. |
|
keyFrameInterval |
string |
The distance between two key frames. The value should be non-zero in the range [0.5, 20] seconds, specified in ISO 8601 format. The default is 2 seconds(PT2S). Note that this setting is ignored if VideoSyncMode.Passthrough is set, where the KeyFrameInterval value will follow the input source setting. |
label |
string |
An optional label for the codec. The label can be used to control muxing behavior. |
layers |
The collection of output H.265 layers to be produced by the encoder. |
|
sceneChangeDetection |
boolean |
Specifies whether or not the encoder should insert key frames at scene changes. If not specified, the default is false. This flag should be set to true only when the encoder is being configured to produce a single output video. |
stretchMode |
The resizing mode - how the input video will be resized to fit the desired output resolution(s). Default is AutoSize |
|
syncMode |
The Video Sync Mode |
H265VideoProfile
We currently support Main. Default is Auto.
Name | Type | Description |
---|---|---|
Auto |
string |
Tells the encoder to automatically determine the appropriate H.265 profile. |
Main |
string |
Main profile (https://x265.readthedocs.io/en/default/cli.html?highlight=profile#profile-level-tier) |
Main10 |
string |
Main 10 profile (https://en.wikipedia.org/wiki/High_Efficiency_Video_Coding#Main_10) |
Image
Describes the basic properties for generating thumbnails from the input video
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
keyFrameInterval |
string |
The distance between two key frames. The value should be non-zero in the range [0.5, 20] seconds, specified in ISO 8601 format. The default is 2 seconds(PT2S). Note that this setting is ignored if VideoSyncMode.Passthrough is set, where the KeyFrameInterval value will follow the input source setting. |
label |
string |
An optional label for the codec. The label can be used to control muxing behavior. |
range |
string |
The position relative to transform preset start time in the input video at which to stop generating thumbnails. The value can be in ISO 8601 format (For example, PT5M30S to stop at 5 minutes and 30 seconds from start time), or a frame count (For example, 300 to stop at the 300th frame from the frame at start time. If this value is 1, it means only producing one thumbnail at start time), or a relative value to the stream duration (For example, 50% to stop at half of stream duration from start time). The default value is 100%, which means to stop at the end of the stream. |
start |
string |
The position in the input video from where to start generating thumbnails. The value can be in ISO 8601 format (For example, PT05S to start at 5 seconds), or a frame count (For example, 10 to start at the 10th frame), or a relative value to stream duration (For example, 10% to start at 10% of stream duration). Also supports a macro {Best}, which tells the encoder to select the best thumbnail from the first few seconds of the video and will only produce one thumbnail, no matter what other settings are for Step and Range. The default value is macro {Best}. |
step |
string |
The intervals at which thumbnails are generated. The value can be in ISO 8601 format (For example, PT05S for one image every 5 seconds), or a frame count (For example, 30 for one image every 30 frames), or a relative value to stream duration (For example, 10% for one image every 10% of stream duration). Note: Step value will affect the first generated thumbnail, which may not be exactly the one specified at transform preset start time. This is due to the encoder, which tries to select the best thumbnail between start time and Step position from start time as the first output. As the default value is 10%, it means if stream has long duration, the first generated thumbnail might be far away from the one specified at start time. Try to select reasonable value for Step if the first thumbnail is expected close to start time, or set Range value at 1 if only one thumbnail is needed at start time. |
stretchMode |
The resizing mode - how the input video will be resized to fit the desired output resolution(s). Default is AutoSize |
|
syncMode |
The Video Sync Mode |
ImageFormat
Describes the properties for an output image file.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
filenamePattern |
string |
The file naming pattern used for the creation of output files. The following macros are supported in the file name: {Basename} - An expansion macro that will use the name of the input video file. If the base name(the file suffix is not included) of the input video file is less than 32 characters long, the base name of input video files will be used. If the length of base name of the input video file exceeds 32 characters, the base name is truncated to the first 32 characters in total length. {Extension} - The appropriate extension for this format. {Label} - The label assigned to the codec/layer. {Index} - A unique index for thumbnails. Only applicable to thumbnails. {AudioStream} - string "Audio" plus audio stream number(start from 1). {Bitrate} - The audio/video bitrate in kbps. Not applicable to thumbnails. {Codec} - The type of the audio/video codec. {Resolution} - The video resolution. Any unsubstituted macros will be collapsed and removed from the filename. |
InsightsType
Defines the type of insights that you want the service to generate. The allowed values are 'AudioInsightsOnly', 'VideoInsightsOnly', and 'AllInsights'. The default is AllInsights. If you set this to AllInsights and the input is audio only, then only audio insights are generated. Similarly if the input is video only, then only video insights are generated. It is recommended that you not use AudioInsightsOnly if you expect some of your inputs to be video only; or use VideoInsightsOnly if you expect some of your inputs to be audio only. Your Jobs in such conditions would error out.
Name | Type | Description |
---|---|---|
AllInsights |
string |
Generate both audio and video insights. Fails if either audio or video Insights fail. |
AudioInsightsOnly |
string |
Generate audio only insights. Ignore video even if present. Fails if no audio is present. |
VideoInsightsOnly |
string |
Generate video only insights. Ignore audio if present. Fails if no video is present. |
InterleaveOutput
Sets the interleave mode of the output to control how audio and video are stored in the container format. Example: set InterleavedOutput as NonInterleavedOutput to produce audio-only and video-only outputs in separate MP4 files.
Name | Type | Description |
---|---|---|
InterleavedOutput |
string |
The output includes both audio and video. |
NonInterleavedOutput |
string |
The output is video-only or audio-only. |
JpgFormat
Describes the settings for producing JPEG thumbnails.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
filenamePattern |
string |
The file naming pattern used for the creation of output files. The following macros are supported in the file name: {Basename} - An expansion macro that will use the name of the input video file. If the base name(the file suffix is not included) of the input video file is less than 32 characters long, the base name of input video files will be used. If the length of base name of the input video file exceeds 32 characters, the base name is truncated to the first 32 characters in total length. {Extension} - The appropriate extension for this format. {Label} - The label assigned to the codec/layer. {Index} - A unique index for thumbnails. Only applicable to thumbnails. {AudioStream} - string "Audio" plus audio stream number(start from 1). {Bitrate} - The audio/video bitrate in kbps. Not applicable to thumbnails. {Codec} - The type of the audio/video codec. {Resolution} - The video resolution. Any unsubstituted macros will be collapsed and removed from the filename. |
JpgImage
Describes the properties for producing a series of JPEG images from the input video.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
keyFrameInterval |
string |
The distance between two key frames. The value should be non-zero in the range [0.5, 20] seconds, specified in ISO 8601 format. The default is 2 seconds(PT2S). Note that this setting is ignored if VideoSyncMode.Passthrough is set, where the KeyFrameInterval value will follow the input source setting. |
label |
string |
An optional label for the codec. The label can be used to control muxing behavior. |
layers |
Jpg |
A collection of output JPEG image layers to be produced by the encoder. |
range |
string |
The position relative to transform preset start time in the input video at which to stop generating thumbnails. The value can be in ISO 8601 format (For example, PT5M30S to stop at 5 minutes and 30 seconds from start time), or a frame count (For example, 300 to stop at the 300th frame from the frame at start time. If this value is 1, it means only producing one thumbnail at start time), or a relative value to the stream duration (For example, 50% to stop at half of stream duration from start time). The default value is 100%, which means to stop at the end of the stream. |
spriteColumn |
integer |
Sets the number of columns used in thumbnail sprite image. The number of rows are automatically calculated and a VTT file is generated with the coordinate mappings for each thumbnail in the sprite. Note: this value should be a positive integer and a proper value is recommended so that the output image resolution will not go beyond JPEG maximum pixel resolution limit 65535x65535. |
start |
string |
The position in the input video from where to start generating thumbnails. The value can be in ISO 8601 format (For example, PT05S to start at 5 seconds), or a frame count (For example, 10 to start at the 10th frame), or a relative value to stream duration (For example, 10% to start at 10% of stream duration). Also supports a macro {Best}, which tells the encoder to select the best thumbnail from the first few seconds of the video and will only produce one thumbnail, no matter what other settings are for Step and Range. The default value is macro {Best}. |
step |
string |
The intervals at which thumbnails are generated. The value can be in ISO 8601 format (For example, PT05S for one image every 5 seconds), or a frame count (For example, 30 for one image every 30 frames), or a relative value to stream duration (For example, 10% for one image every 10% of stream duration). Note: Step value will affect the first generated thumbnail, which may not be exactly the one specified at transform preset start time. This is due to the encoder, which tries to select the best thumbnail between start time and Step position from start time as the first output. As the default value is 10%, it means if stream has long duration, the first generated thumbnail might be far away from the one specified at start time. Try to select reasonable value for Step if the first thumbnail is expected close to start time, or set Range value at 1 if only one thumbnail is needed at start time. |
stretchMode |
The resizing mode - how the input video will be resized to fit the desired output resolution(s). Default is AutoSize |
|
syncMode |
The Video Sync Mode |
JpgLayer
Describes the settings to produce a JPEG image from the input video.
Name | Type | Description |
---|---|---|
height |
string |
The height of the output video for this layer. The value can be absolute (in pixels) or relative (in percentage). For example 50% means the output video has half as many pixels in height as the input. |
label |
string |
The alphanumeric label for this layer, which can be used in multiplexing different video and audio layers, or in naming the output file. |
quality |
integer |
The compression quality of the JPEG output. Range is from 0-100 and the default is 70. |
width |
string |
The width of the output video for this layer. The value can be absolute (in pixels) or relative (in percentage). For example 50% means the output video has half as many pixels in width as the input. |
Mp4Format
Describes the properties for an output ISO MP4 file.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
filenamePattern |
string |
The file naming pattern used for the creation of output files. The following macros are supported in the file name: {Basename} - An expansion macro that will use the name of the input video file. If the base name(the file suffix is not included) of the input video file is less than 32 characters long, the base name of input video files will be used. If the length of base name of the input video file exceeds 32 characters, the base name is truncated to the first 32 characters in total length. {Extension} - The appropriate extension for this format. {Label} - The label assigned to the codec/layer. {Index} - A unique index for thumbnails. Only applicable to thumbnails. {AudioStream} - string "Audio" plus audio stream number(start from 1). {Bitrate} - The audio/video bitrate in kbps. Not applicable to thumbnails. {Codec} - The type of the audio/video codec. {Resolution} - The video resolution. Any unsubstituted macros will be collapsed and removed from the filename. |
outputFiles |
The list of output files to produce. Each entry in the list is a set of audio and video layer labels to be muxed together . |
MultiBitrateFormat
Describes the properties for producing a collection of GOP aligned multi-bitrate files. The default behavior is to produce one output file for each video layer which is muxed together with all the audios. The exact output files produced can be controlled by specifying the outputFiles collection.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
filenamePattern |
string |
The file naming pattern used for the creation of output files. The following macros are supported in the file name: {Basename} - An expansion macro that will use the name of the input video file. If the base name(the file suffix is not included) of the input video file is less than 32 characters long, the base name of input video files will be used. If the length of base name of the input video file exceeds 32 characters, the base name is truncated to the first 32 characters in total length. {Extension} - The appropriate extension for this format. {Label} - The label assigned to the codec/layer. {Index} - A unique index for thumbnails. Only applicable to thumbnails. {AudioStream} - string "Audio" plus audio stream number(start from 1). {Bitrate} - The audio/video bitrate in kbps. Not applicable to thumbnails. {Codec} - The type of the audio/video codec. {Resolution} - The video resolution. Any unsubstituted macros will be collapsed and removed from the filename. |
outputFiles |
The list of output files to produce. Each entry in the list is a set of audio and video layer labels to be muxed together . |
OnErrorType
A Transform can define more than one outputs. This property defines what the service should do when one output fails - either continue to produce other outputs, or, stop the other outputs. The overall Job state will not reflect failures of outputs that are specified with 'ContinueJob'. The default is 'StopProcessingJob'.
Name | Type | Description |
---|---|---|
ContinueJob |
string |
Tells the service that if this TransformOutput fails, then allow any other TransformOutput to continue. |
StopProcessingJob |
string |
Tells the service that if this TransformOutput fails, then any other incomplete TransformOutputs can be stopped. |
OutputFile
Represents an output file produced.
Name | Type | Description |
---|---|---|
labels |
string[] |
The list of labels that describe how the encoder should multiplex video and audio into an output file. For example, if the encoder is producing two video layers with labels v1 and v2, and one audio layer with label a1, then an array like '[v1, a1]' tells the encoder to produce an output file with the video track represented by v1 and the audio track represented by a1. |
PngFormat
Describes the settings for producing PNG thumbnails.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
filenamePattern |
string |
The file naming pattern used for the creation of output files. The following macros are supported in the file name: {Basename} - An expansion macro that will use the name of the input video file. If the base name(the file suffix is not included) of the input video file is less than 32 characters long, the base name of input video files will be used. If the length of base name of the input video file exceeds 32 characters, the base name is truncated to the first 32 characters in total length. {Extension} - The appropriate extension for this format. {Label} - The label assigned to the codec/layer. {Index} - A unique index for thumbnails. Only applicable to thumbnails. {AudioStream} - string "Audio" plus audio stream number(start from 1). {Bitrate} - The audio/video bitrate in kbps. Not applicable to thumbnails. {Codec} - The type of the audio/video codec. {Resolution} - The video resolution. Any unsubstituted macros will be collapsed and removed from the filename. |
PngImage
Describes the properties for producing a series of PNG images from the input video.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
keyFrameInterval |
string |
The distance between two key frames. The value should be non-zero in the range [0.5, 20] seconds, specified in ISO 8601 format. The default is 2 seconds(PT2S). Note that this setting is ignored if VideoSyncMode.Passthrough is set, where the KeyFrameInterval value will follow the input source setting. |
label |
string |
An optional label for the codec. The label can be used to control muxing behavior. |
layers |
Png |
A collection of output PNG image layers to be produced by the encoder. |
range |
string |
The position relative to transform preset start time in the input video at which to stop generating thumbnails. The value can be in ISO 8601 format (For example, PT5M30S to stop at 5 minutes and 30 seconds from start time), or a frame count (For example, 300 to stop at the 300th frame from the frame at start time. If this value is 1, it means only producing one thumbnail at start time), or a relative value to the stream duration (For example, 50% to stop at half of stream duration from start time). The default value is 100%, which means to stop at the end of the stream. |
start |
string |
The position in the input video from where to start generating thumbnails. The value can be in ISO 8601 format (For example, PT05S to start at 5 seconds), or a frame count (For example, 10 to start at the 10th frame), or a relative value to stream duration (For example, 10% to start at 10% of stream duration). Also supports a macro {Best}, which tells the encoder to select the best thumbnail from the first few seconds of the video and will only produce one thumbnail, no matter what other settings are for Step and Range. The default value is macro {Best}. |
step |
string |
The intervals at which thumbnails are generated. The value can be in ISO 8601 format (For example, PT05S for one image every 5 seconds), or a frame count (For example, 30 for one image every 30 frames), or a relative value to stream duration (For example, 10% for one image every 10% of stream duration). Note: Step value will affect the first generated thumbnail, which may not be exactly the one specified at transform preset start time. This is due to the encoder, which tries to select the best thumbnail between start time and Step position from start time as the first output. As the default value is 10%, it means if stream has long duration, the first generated thumbnail might be far away from the one specified at start time. Try to select reasonable value for Step if the first thumbnail is expected close to start time, or set Range value at 1 if only one thumbnail is needed at start time. |
stretchMode |
The resizing mode - how the input video will be resized to fit the desired output resolution(s). Default is AutoSize |
|
syncMode |
The Video Sync Mode |
PngLayer
Describes the settings to produce a PNG image from the input video.
Name | Type | Description |
---|---|---|
height |
string |
The height of the output video for this layer. The value can be absolute (in pixels) or relative (in percentage). For example 50% means the output video has half as many pixels in height as the input. |
label |
string |
The alphanumeric label for this layer, which can be used in multiplexing different video and audio layers, or in naming the output file. |
width |
string |
The width of the output video for this layer. The value can be absolute (in pixels) or relative (in percentage). For example 50% means the output video has half as many pixels in width as the input. |
PresetConfigurations
An object of optional configuration settings for encoder.
Name | Type | Description |
---|---|---|
complexity |
Allows you to configure the encoder settings to control the balance between speed and quality. Example: set Complexity as Speed for faster encoding but less compression efficiency. |
|
interleaveOutput |
Sets the interleave mode of the output to control how audio and video are stored in the container format. Example: set InterleavedOutput as NonInterleavedOutput to produce audio-only and video-only outputs in separate MP4 files. |
|
keyFrameIntervalInSeconds |
number |
The key frame interval in seconds. Example: set KeyFrameIntervalInSeconds as 2 to reduce the playback buffering for some players. |
maxBitrateBps |
integer |
The maximum bitrate in bits per second (threshold for the top video layer). Example: set MaxBitrateBps as 6000000 to avoid producing very high bitrate outputs for contents with high complexity. |
maxHeight |
integer |
The maximum height of output video layers. Example: set MaxHeight as 720 to produce output layers up to 720P even if the input is 4K. |
maxLayers |
integer |
The maximum number of output video layers. Example: set MaxLayers as 4 to make sure at most 4 output layers are produced to control the overall cost of the encoding job. |
minBitrateBps |
integer |
The minimum bitrate in bits per second (threshold for the bottom video layer). Example: set MinBitrateBps as 200000 to have a bottom layer that covers users with low network bandwidth. |
minHeight |
integer |
The minimum height of output video layers. Example: set MinHeight as 360 to avoid output layers of smaller resolutions like 180P. |
Priority
Sets the relative priority of the TransformOutputs within a Transform. This sets the priority that the service uses for processing TransformOutputs. The default priority is Normal.
Name | Type | Description |
---|---|---|
High |
string |
Used for TransformOutputs that should take precedence over others. |
Low |
string |
Used for TransformOutputs that can be generated after Normal and High priority TransformOutputs. |
Normal |
string |
Used for TransformOutputs that can be generated at Normal priority. |
Rectangle
Describes the properties of a rectangular window applied to the input media before processing it.
Name | Type | Description |
---|---|---|
height |
string |
The height of the rectangular region in pixels. This can be absolute pixel value (e.g 100), or relative to the size of the video (For example, 50%). |
left |
string |
The number of pixels from the left-margin. This can be absolute pixel value (e.g 100), or relative to the size of the video (For example, 50%). |
top |
string |
The number of pixels from the top-margin. This can be absolute pixel value (e.g 100), or relative to the size of the video (For example, 50%). |
width |
string |
The width of the rectangular region in pixels. This can be absolute pixel value (e.g 100), or relative to the size of the video (For example, 50%). |
Rotation
The rotation, if any, to be applied to the input video, before it is encoded. Default is Auto
Name | Type | Description |
---|---|---|
Auto |
string |
Automatically detect and rotate as needed. |
None |
string |
Do not rotate the video. If the output format supports it, any metadata about rotation is kept intact. |
Rotate0 |
string |
Do not rotate the video but remove any metadata about the rotation. |
Rotate180 |
string |
Rotate 180 degrees clockwise. |
Rotate270 |
string |
Rotate 270 degrees clockwise. |
Rotate90 |
string |
Rotate 90 degrees clockwise. |
StandardEncoderPreset
Describes all the settings to be used when encoding the input video with the Standard Encoder.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
codecs | Codec[]: |
The list of codecs to be used when encoding the input video. |
experimentalOptions |
object |
Dictionary containing key value pairs for parameters not exposed in the preset itself |
filters |
One or more filtering operations that are applied to the input media before encoding. |
|
formats | Format[]: |
The list of outputs to be produced by the encoder. |
StretchMode
The resizing mode - how the input video will be resized to fit the desired output resolution(s). Default is AutoSize
Name | Type | Description |
---|---|---|
AutoFit |
string |
Pad the output (with either letterbox or pillar box) to honor the output resolution, while ensuring that the active video region in the output has the same aspect ratio as the input. For example, if the input is 1920x1080 and the encoding preset asks for 1280x1280, then the output will be at 1280x1280, which contains an inner rectangle of 1280x720 at aspect ratio of 16:9, and pillar box regions 280 pixels wide at the left and right. |
AutoSize |
string |
Override the output resolution, and change it to match the display aspect ratio of the input, without padding. For example, if the input is 1920x1080 and the encoding preset asks for 1280x1280, then the value in the preset is overridden, and the output will be at 1280x720, which maintains the input aspect ratio of 16:9. |
None |
string |
Strictly respect the output resolution without considering the pixel aspect ratio or display aspect ratio of the input video. |
systemData
Metadata pertaining to creation and last modification of the resource.
Name | Type | Description |
---|---|---|
createdAt |
string |
The timestamp of resource creation (UTC). |
createdBy |
string |
The identity that created the resource. |
createdByType |
The type of identity that created the resource. |
|
lastModifiedAt |
string |
The timestamp of resource last modification (UTC) |
lastModifiedBy |
string |
The identity that last modified the resource. |
lastModifiedByType |
The type of identity that last modified the resource. |
Transform
A Transform encapsulates the rules or instructions for generating desired outputs from input media, such as by transcoding or by extracting insights. After the Transform is created, it can be applied to input media by creating Jobs.
Name | Type | Description |
---|---|---|
id |
string |
Fully qualified resource ID for the resource. Ex - /subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/{resourceProviderNamespace}/{resourceType}/{resourceName} |
name |
string |
The name of the resource |
properties.created |
string |
The UTC date and time when the Transform was created, in 'YYYY-MM-DDThh:mm:ssZ' format. |
properties.description |
string |
An optional verbose description of the Transform. |
properties.lastModified |
string |
The UTC date and time when the Transform was last updated, in 'YYYY-MM-DDThh:mm:ssZ' format. |
properties.outputs |
An array of one or more TransformOutputs that the Transform should generate. |
|
systemData |
The system metadata relating to this resource. |
|
type |
string |
The type of the resource. E.g. "Microsoft.Compute/virtualMachines" or "Microsoft.Storage/storageAccounts" |
TransformCollection
A collection of Transform items.
Name | Type | Description |
---|---|---|
@odata.nextLink |
string |
A link to the next page of the collection (when the collection contains too many results to return in one response). |
value |
A collection of Transform items. |
TransformOutput
Describes the properties of a TransformOutput, which are the rules to be applied while generating the desired output.
Name | Type | Description |
---|---|---|
onError |
A Transform can define more than one outputs. This property defines what the service should do when one output fails - either continue to produce other outputs, or, stop the other outputs. The overall Job state will not reflect failures of outputs that are specified with 'ContinueJob'. The default is 'StopProcessingJob'. |
|
preset | Preset: |
Preset that describes the operations that will be used to modify, transcode, or extract insights from the source file to generate the output. |
relativePriority |
Sets the relative priority of the TransformOutputs within a Transform. This sets the priority that the service uses for processing TransformOutputs. The default priority is Normal. |
TransportStreamFormat
Describes the properties for generating an MPEG-2 Transport Stream (ISO/IEC 13818-1) output video file(s).
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
filenamePattern |
string |
The file naming pattern used for the creation of output files. The following macros are supported in the file name: {Basename} - An expansion macro that will use the name of the input video file. If the base name(the file suffix is not included) of the input video file is less than 32 characters long, the base name of input video files will be used. If the length of base name of the input video file exceeds 32 characters, the base name is truncated to the first 32 characters in total length. {Extension} - The appropriate extension for this format. {Label} - The label assigned to the codec/layer. {Index} - A unique index for thumbnails. Only applicable to thumbnails. {AudioStream} - string "Audio" plus audio stream number(start from 1). {Bitrate} - The audio/video bitrate in kbps. Not applicable to thumbnails. {Codec} - The type of the audio/video codec. {Resolution} - The video resolution. Any unsubstituted macros will be collapsed and removed from the filename. |
outputFiles |
The list of output files to produce. Each entry in the list is a set of audio and video layer labels to be muxed together . |
Video
Describes the basic properties for encoding the input video.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
keyFrameInterval |
string |
The distance between two key frames. The value should be non-zero in the range [0.5, 20] seconds, specified in ISO 8601 format. The default is 2 seconds(PT2S). Note that this setting is ignored if VideoSyncMode.Passthrough is set, where the KeyFrameInterval value will follow the input source setting. |
label |
string |
An optional label for the codec. The label can be used to control muxing behavior. |
stretchMode |
The resizing mode - how the input video will be resized to fit the desired output resolution(s). Default is AutoSize |
|
syncMode |
The Video Sync Mode |
VideoAnalyzerPreset
A video analyzer preset that extracts insights (rich metadata) from both audio and video, and outputs a JSON format file.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
audioLanguage |
string |
The language for the audio payload in the input using the BCP-47 format of 'language tag-region' (e.g: 'en-US'). If you know the language of your content, it is recommended that you specify it. The language must be specified explicitly for AudioAnalysisMode::Basic, since automatic language detection is not included in basic mode. If the language isn't specified or set to null, automatic language detection will choose the first language detected and process with the selected language for the duration of the file. It does not currently support dynamically switching between languages after the first language is detected. The automatic detection works best with audio recordings with clearly discernable speech. If automatic detection fails to find the language, transcription would fallback to 'en-US'." The list of supported languages is available here: https://go.microsoft.com/fwlink/?linkid=2109463 |
experimentalOptions |
object |
Dictionary containing key value pairs for parameters not exposed in the preset itself |
insightsToExtract |
Defines the type of insights that you want the service to generate. The allowed values are 'AudioInsightsOnly', 'VideoInsightsOnly', and 'AllInsights'. The default is AllInsights. If you set this to AllInsights and the input is audio only, then only audio insights are generated. Similarly if the input is video only, then only video insights are generated. It is recommended that you not use AudioInsightsOnly if you expect some of your inputs to be video only; or use VideoInsightsOnly if you expect some of your inputs to be audio only. Your Jobs in such conditions would error out. |
|
mode |
Determines the set of audio analysis operations to be performed. If unspecified, the Standard AudioAnalysisMode would be chosen. |
VideoOverlay
Describes the properties of a video overlay.
Name | Type | Description |
---|---|---|
@odata.type |
string:
#Microsoft. |
The discriminator for derived types. |
audioGainLevel |
number |
The gain level of audio in the overlay. The value should be in the range [0, 1.0]. The default is 1.0. |
cropRectangle |
An optional rectangular window used to crop the overlay image or video. |
|
end |
string |
The end position, with reference to the input video, at which the overlay ends. The value should be in ISO 8601 format. For example, PT30S to end the overlay at 30 seconds into the input video. If not specified or the value is greater than the input video duration, the overlay will be applied until the end of the input video if the overlay media duration is greater than the input video duration, else the overlay will last as long as the overlay media duration. |
fadeInDuration |
string |
The duration over which the overlay fades in onto the input video. The value should be in ISO 8601 duration format. If not specified the default behavior is to have no fade in (same as PT0S). |
fadeOutDuration |
string |
The duration over which the overlay fades out of the input video. The value should be in ISO 8601 duration format. If not specified the default behavior is to have no fade out (same as PT0S). |
inputLabel |
string |
The label of the job input which is to be used as an overlay. The Input must specify exactly one file. You can specify an image file in JPG, PNG, GIF or BMP format, or an audio file (such as a WAV, MP3, WMA or M4A file), or a video file. See https://aka.ms/mesformats for the complete list of supported audio and video file formats. |
opacity |
number |
The opacity of the overlay. This is a value in the range [0 - 1.0]. Default is 1.0 which mean the overlay is opaque. |
position |
The location in the input video where the overlay is applied. |
|
start |
string |
The start position, with reference to the input video, at which the overlay starts. The value should be in ISO 8601 format. For example, PT05S to start the overlay at 5 seconds into the input video. If not specified the overlay starts from the beginning of the input video. |
VideoSyncMode
The Video Sync Mode
Name | Type | Description |
---|---|---|
Auto |
string |
This is the default method. Chooses between Cfr and Vfr depending on muxer capabilities. For output format MP4, the default mode is Cfr. |
Cfr |
string |
Input frames will be repeated and/or dropped as needed to achieve exactly the requested constant frame rate. Recommended when the output frame rate is explicitly set at a specified value |
Passthrough |
string |
The presentation timestamps on frames are passed through from the input file to the output file writer. Recommended when the input source has variable frame rate, and are attempting to produce multiple layers for adaptive streaming in the output which have aligned GOP boundaries. Note: if two or more frames in the input have duplicate timestamps, then the output will also have the same behavior |
Vfr |
string |
Similar to the Passthrough mode, but if the input has frames that have duplicate timestamps, then only one frame is passed through to the output, and others are dropped. Recommended when the number of output frames is expected to be equal to the number of input frames. For example, the output is used to calculate a quality metric like PSNR against the input |