How to load the different api data dynamically into corresponding tables

sivaranjani somana 26 Reputation points
2021-01-28T10:13:49.807+00:00

Hi @HarithaMaddi-MSFT ,
Do you have any idea on how to load the api data dynamically into corresponding tables? As mentioned in the earlier question i have created tables for the url's ,schema mapping and corresponding destination tables. As part of loading the first urls has loaded successfully into the table but the three and four correct schema mapping is happening but data load is not happening into the destination.
Am getting the following error ""Code": 11806,
"Message": "ErrorCode=UserErrorSchemaMappingCannotInferSinkColumnType,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Data type of column 'name' can't be inferred from 1st row of data, please specify its data type in mappings of copy activity or structure of DataSet.,Source=Microsoft.DataTransfer.Common,'",
Please help me with this issue.
In copy Mapping i have provided as this "@json (activity('GetSchemaDetails').output.value[0].json_output)"

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,196 questions
{count} votes

1 answer

Sort by: Most helpful
  1. HarithaMaddi-MSFT 10,136 Reputation points
    2021-02-02T09:55:50.267+00:00

    Hi @sivaranjani somana ,

    Thanks for your patience. I got an update from the product team that this error happens when we cannot detect the column type from the source first row as the value is null. Please set column type in column mapping to workaround this issue as below.

    "mappings": [  
              {  
                "source": {  
                  "name": "user_id"  
                },  
                "sink": {  
                  "name": "user_id",  
                  "type": "string"  
                }  
              },  
    

    Hope this helps! Please let us know for further queries and we will be glad to assist.

    --

    • Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification.
    1 person found this answer helpful.