How to edit existing json file in adf for adding metadata property

Question

Hi Team, i am using adf for getting data from sourec and storing data into json format (array of object ) . Data storing correctly but i want to append few things on that out put file and store back that with new json file . Data format of output file is :

[
        {
            "Address1": null,
            "Address2": null,
            "AddressCity": null,
            "ApprovedDate": null,
    }
]

// Data format requited for desired  output after modification by
// addding few static metaadata on just on top of that file as nentioend  below   
{
      "ObjectClass": "ProcurementCompanyData",
    "RowData": [
        {
            "Address1": null,
            "Address2": null,
            "AddressCity": null,
            "ApprovedDate": null,
        }
}

Answer 1

ADF doesn't directly modify files but allows you to read data from a source, transform it, and then output it to a destination. Then develop a Databricks notebook that reads your JSON file, performs the necessary transformation by adding the metadata, and then writes the modified JSON back to the desired location.

import json

# Simulate reading a JSON file
data = [
    {"Address1": None, "Address2": None, "AddressCity": None, "ApprovedDate": None}
]

# Add metadata
modified_data = {
    "ObjectClass": "ProcurementCompanyData",
    "RowData": data
}

# Write the modified JSON to a file (or back to a storage service)
with open('modified_data.json', 'w') as f:
    json.dump(modified_data, f, indent=4)