DML_ACTIVATION_SWISH_OPERATOR_DESC structure (directml.h)

Performs a swish activation function on every element in InputTensor, placing the result into the corresponding element of OutputTensor.

f(x) = x * Sigmoid(SigmoidInputScale * x)

This operator supports in-place execution, meaning that the output tensor is permitted to alias InputTensor during binding.

Important

This API is available as part of the DirectML standalone redistributable package (see Microsoft.AI.DirectML version 1.13 and later. Also see DirectML version history.

Syntax

struct DML_ACTIVATION_SWISH_OPERATOR_DESC
{
    const DML_TENSOR_DESC* InputTensor;
    const DML_TENSOR_DESC* OutputTensor;
    FLOAT SigmoidInputScale;
};

Members

InputTensor

Type: const DML_TENSOR_DESC*

The input tensor to read from.

OutputTensor

Type: const DML_TENSOR_DESC*

The output tensor to write the results to.

SigmoidInputScale

Type: FLOAT

The constant coefficient. A typical default for this value is 1.0.

Availability

This operator was introduced in DML_FEATURE_LEVEL_6_2.

Tensor constraints

InputTensor and OutputTensor must have the same DataType, DimensionCount, and Sizes.

Tensor support

Tensor Kind Supported dimension counts Supported data types
InputTensor Input 1 to 8 FLOAT32, FLOAT16
OutputTensor Output 1 to 8 FLOAT32, FLOAT16

Requirements

   
Header directml.h