How to open the dataset exported from Azure ML Designer?

kbennett 1 Reputation point
2023-01-24T03:21:51.6733333+00:00

I authored a simple pipeline in Azure ML Designer that does the following:

  1. Imports a dataset from my datastore.
  2. Edits the metadata for 2 columns of the total 480 to ensure they're labeled as categorical.
  3. Performs a Filter Based Feature Selection to obtain top 30 features of the dataset on the target.
  4. Exports Filtered Dataset to a .csv in my storage container.
  5. Exports Features to a .csv in same path as #4.

However, when the pipeline completes, I cannot find either of the .csv files. Instead, there are two files--Block blob types--both titled as I wrote them in the Export Data parameter for 'Path' field. Additionally, from this pipeline, there are 6 additional files created with the following filenames:

  • meta.yaml
  • samples.json
  • data.dataset
  • data.dataset.parquet
  • data.visualization
  • schema/schema.json

None of these are the csv file I requested. I very well could have something set incorrectly as this is the first time I've used this component of Azure. But the parameters seemed pretty intuitive so I don't understand why a .csv file isn't created in the path I submitted below. Can someone please help me?pipeline snip

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,108 questions
{count} votes

1 answer

Sort by: Most helpful
  1. romungi-MSFT 48,526 Reputation points Microsoft Employee
    2023-01-30T14:25:36.59+00:00

    kbennett I think you are missing the component convert to CSV between steps 3 and 4. Since the output of your component from step 3 is a dataset as listed in the file names above you will have to use convert to CSV module to convert the dataset to a CSV. This ensures the CSV output of this module is used as input to the export data module and the correct CSV file is available in your container.

    In the current setup the export data module takes the output of the input module and tried to export the same, if you click on the module above export data and view the job details the same would be available in the Outputs + Logs tab.

    -Please kindly accept the answer if the answer was helpful to support the community, thanks.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.