This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(300.8, 8%, 39%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EC%3C/text%3E%3C/svg%3E)
I have a simple data factory.
Source dataset, alter row (insert or update), sink to destination table. Source and destination are Azure SQLServer
I am having trouble with one column. It is defined as tinyint in both databases.
When I data preview on the source dataset the column has a value
When I data preview on the data flow the column has a null value.
Source and destination mappings are correct.
What is the data type set as in your data flow for that column? When you execute the data from from a pipeline, is the correct value loaded into the target table?
The data type is byte. No the correct value is not being loaded into the target table. The value is always null for the column even though it has non null values.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(137.6, 61%, 23%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMK%3C/text%3E%3C/svg%3E)
Let's give Kiran's suggestion below a shot and see if it helps you out in this scenario. Basically, what he's saying is to clear the schema in the dataset and then on the data flow source transformation, click "Import Projection" on the Projection tab.
I did that. It is now showing the column as an integer and the column values are displaying correctly.
I am still getting an error when writing to the destination table because the destination is a tinyint.
I did not see a function to convert an integer to a byte.
+@Kiran-MSFT should we try toShort() here to convert to target DB column type "tinyint"?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(118.4, 17%, 21%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKM%3C/text%3E%3C/svg%3E)
There is a toByte function also but most likely this is because tinyInt is unsigned in SQL but byte is signed in dataflow.
You should be able to write dataflow integer/short to tinyInt.
What is the error you see when you write to SQL? Are those errors for values above 128?
This is the error
"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'RuleSink': Column(s) [RuleTypeId] do not exist or their datatypes do not match the store datatypes","Details":"at Sink 'RuleSink': Column(s) [RuleTypeId] do not exist or their datatypes do not match the store datatypes"}
There are only 2 values for that column 1 or 2
I don't see the toByte function in the list in the expression builder
Can you uncheck the validateSchema option on the sink and try again?
That worked. Not getting any errors but the data is not getting written to the destination.
I am running debug on the pipeline. That should still write data to the destination correct?
Did you clear the schema of your sink dataset also to create empty dataset?
Use the "mapping tab" in sink to include/exclude columns.
The problem was in the alter row. All is working now. Thank you for your help.
As a workaround, can you create an empty dataset with no schema. Import the schema in dataflow in the projection tab and then preview.