Id value seems too high for ADF to retrieve

Question

Hello,

I have a json file as below where the id is an integer. But oddly, the source or any activity within dataflow is not able to parse it and always shows as null. but if the value is of a smaller value then it displays. the selectivevalue is properly displayed in the data preview but not the ID.

Any recommendations on how to resolve this.

"values":[{"id":10004295182,"selectivevalue":247587945,"note_field":35920350,"value":"Exercise goal set","created_at":"2023-05-22T20:17:08","updated_at":"2023-05-22T20:18:45"}]

Answer 1

@sam nick Thanks for using Microsoft Q&A forum and posting your query.

The reason for showing the value of Id column as null is beacause by default data flow detecting it as an integer, where as the actual value of Id column is BIGINT/LONG . In dataflow when source value is not compatible with the provided/detected datatype then the value is displayed as null in the preview or in the expression output.

To resolve this issue, please go to your Source -> Projection - click on Import Projection this will import the actual datatype as LONG and the value will be displayed as expected.

Please Note: Importing the schema here will override the projection defined in the dataset. The dataset object won't be changed.

Default datatype detection:

Data type detection after importing Projection:

Data preview after importing Projection:

Hope this info helps.

---

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.