Using 'None' for Compression Type/Level Parameter in ADF

Question

I am working on an ADF pipeline where I am trying to use a common, paramaterized dataset.

I have created parameters for the compression type/compression level, with default values of 'None'.

However, whenever I try to test run the pipeline, I get this error:

> ErrorCode=UserErrorInvalidPluginType,'Type=Microsoft.DataTransfer.Common.Shared.PluginNotRegisteredException,Message=Invalid type 'None' is provided in 'compression'. Please correct the type in payload and retry.,Source=Microsoft.DataTransfer.ClientLibrary,'

I have tried everything from physically typing 'None' in the parameter field, using "" or '', etc. but nothing seems to work. Any advice would be appreciated.

Answer 1

Hello @krisande ,

Thanks for the question and using MS Q&A platform.

From my understanding, you are trying to set the compression type - None through parameters i.e. dynamically.

I had tested at my end, and I was able to reproduce the issue at my end & I understand this is the case only with None compression type.

------------------

Cause of the issue :

When you set a compression type. There is a line added to the code of the pipeline.

When you mention the compression type as None in UI. You will not see the CompressionCodec in the code view.

Now in your case when you dynamically set the Compression Type dynamically as none.

**CompressionCodec is set as None value as part of the expression ** as opposed to above snippet

Hence the error.

-------------------

Upon checking with the Product Team further. Dynamically setting the compression type to None will not work currently.

Having said that, at this point of time - the alternate way /workaround to achieve this dynamically - to have an if activity in the pipeline that executes different copy activities depending on if it needs compression or not.

You would then need two datasets, one without compression and one with (You can still have dynamic compression type).

Note : If you don't want Compression Type to be Dynamic, you can set the compression type in the UI.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how

Answer 2

In Synapse Analytics I tried with none, @null , false and 0 and get same erro 2200. > "errorCode": "2200", > "message": "ErrorCode=UserErrorInvalidPluginType,'Type=Microsoft.DataTransfer.Common.Shared.PluginNotRegisteredException,Message=Invalid type 'none' is provided in 'compression'. Please correct the type in payload and retry.,Source=Microsoft.DataTransfer.ClientLibrary,'", > "failureType": "UserError", > "target": "Copy data1", > "details": [] In case Source (not Compressed) and Sink (Compressed) or from compressed to no compressed Unfortunately you must have Two Integration datasets is only way solution - One with Compression (with Parameters Types where we can set the type compression) and the Second without parameters. If someday in integration dataset in Compression Type will allow some parameter like none or empty could be unnecessary two Integration Datasets. ![173602-screen-shot-2022-02-11-at-104922.png][1] ![173580-screen-shot-2022-02-11-at-104940.png][2] ![173623-screen-shot-2022-02-11-at-105433.png][3] [1]: /api/attachments/173602-screen-shot-2022-02-11-at-104922.png?platform=QnA [2]: /api/attachments/173580-screen-shot-2022-02-11-at-104940.png?platform=QnA [3]: /api/attachments/173623-screen-shot-2022-02-11-at-105433.png?platform=QnA