How to create manifest and model.json files in data lake folder ?

Amar Agnihotri 926 Reputation points
2022-06-07T12:40:08.097+00:00

Hi,
I want to use datalake folder as a CDM folder but according to the below documentation manifest and model.json files are needed in a folder to use that folder as a CDM folder -

https://learn.microsoft.com/en-us/common-data-model/data-lake

I am having 300 csv files in a data lake folder and these files are coming from a sftp server as a result of adf copy activity. Files are dumping in data lake but there are no manifest and model.json files creating automatically. Please suggest a way to create those files so that i can use data lake folder as a CDM folder.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 26,161 Reputation points
    2022-06-08T21:52:11+00:00

    Hello @Amar Agnihotri and welcome to Microsoft Q&A.

    As I understand, the ask is how to create the metadata files for existing data.

    Here is link to tutorial on how to create them.
    https://learn.microsoft.com/en-us/common-data-model/creating-schemas

    Here is link to code to aid in creating them.
    https://learn.microsoft.com/en-us/common-data-model/faq#where-can-i-find-libraries-to-help-read-and-write-common-data-model-metadata

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators
    1 person found this answer helpful.

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.