Azure Machine Learning
An Azure machine learning service for building and deploying models.
3,000 questions
Azure ML Designer is not able to read dataset that is a csv file in a blob storage
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(297.6, 28.999999999999996%, 38%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECA%3C/text%3E%3C/svg%3E)
Chandan Agrawal
0
Reputation points
Hi,
I have a pipeline in AzureML designer that reads data from a blob storage and then does a very step e.g. Clean Missing Data.
The data is read in the first step without any issues. I can 'Preview data' also.
But I get the following error as soon as I try to read this data in the subsequent 'Clean Missing data' step.
I dont get this kind of error if I try the above with a 'Sample data' within the designer. I dont get this error when reading the same data using Python in the 'Notebooks'.
I have tried googling a lot but cannot find the setting that the error is talking about.
Somebody please help.
AzureMLException: Message: Error Code: ScriptExecution.StreamAccess.Unexpected Native Error: error in streaming from input data sources StreamError(Unknown("Dataflow at inmemory://dataflow/787945681c12f518bad542fa0ed9e555 is not valid.", Some(DataflowInvalid("inmemory://dataflow/787945681c12f518bad542fa0ed9e555", VisitError(ExecutionError(ArgumentError(InvalidArgument { argument: "writer", expected: "delimited|parquet|preppy", actual: "dfd" }))))))) => Dataflow at inmemory://dataflow/787945681c12f518bad542fa0ed9e555 is not valid. Unknown("Dataflow at inmemory://dataflow/787945681c12f518bad542fa0ed9e555 is not valid.", Some(DataflowInvalid("inmemory://dataflow/787945681c12f518bad542fa0ed9e555", VisitError(ExecutionError(ArgumentError(InvalidArgument { argument: "writer", expected: "delimited|parquet|preppy", actual: "dfd" })))))) => Dataflow at inmemory://dataflow/787945681c12f518bad542fa0ed9e555 is not valid. DataflowInvalid("inmemory://dataflow/787945681c12f518bad542fa0ed9e555", VisitError(ExecutionError(ArgumentError(InvalidArgument { argument: "writer", expected: "delimited|parquet|preppy", actual: "dfd" })))) Error Message: Got unexpected error: Dataflow at inmemory://dataflow/787945681c12f518bad542fa0ed9e555 is not valid.. DataflowInvalid("inmemory://dataflow/787945681c12f518bad542fa0ed9e555", VisitError(ExecutionError(ArgumentError(InvalidArgument { argument: "writer", expected: "delimited|parquet|preppy", actual: "dfd" }))))| session_id=63f50d89-fe91-4d84-850b-66476d80d200 InnerException None ErrorResponse { "error": { "message": "\nError Code: ScriptExecution.StreamAccess.Unexpected\nNative Error: error in streaming from input data sources\n\tStreamError(Unknown("Dataflow at inmemory://dataflow/787945681c12f518bad542fa0ed9e555 is not valid.", Some(DataflowInvalid("inmemory://dataflow/787945681c12f518bad542fa0ed9e555", VisitError(ExecutionError(ArgumentError(InvalidArgument { argument: "writer", expected: "delimited|parquet|preppy", actual: "dfd" })))))))\n=> Dataflow at inmemory://dataflow/787945681c12f518bad542fa0ed9e555 is not valid.\n\tUnknown("Dataflow at inmemory://dataflow/787945681c12f518bad542fa0ed9e555 is not valid.", Some(DataflowInvalid("inmemory://dataflow/787945681c12f518bad542fa0ed9e555", VisitError(ExecutionError(ArgumentError(InvalidArgument { argument: "writer", expected: "delimited|parquet|preppy", actual: "dfd" }))))))\n=> Dataflow at inmemory://dataflow/787945681c12f518bad542fa0ed9e555 is not valid.\n\tDataflowInvalid("inmemory://dataflow/787945681c12f518bad542fa0ed9e555", VisitError(ExecutionError(ArgumentError(InvalidArgument { argument: "writer", expected: "delimited|parquet|preppy", actual: "dfd" }))))\nError Message: Got unexpected error: Dataflow at inmemory://dataflow/787945681c12f518bad542fa0ed9e555 is not valid.. DataflowInvalid("inmemory://dataflow/787945681c12f518bad542fa0ed9e555", VisitError(ExecutionError(ArgumentError(InvalidArgument { argument: "writer"
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(163.2, 92%, 25%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Michael Schmidt 200 Reputation points2024-11-28T12:49:06.9833333+00:00 Hi Chandan,
it seems the data is transferred from AC1 as DFD/data flow diagram. Are you sure the source is prorperly formatted as CSV?
Maybe (!) it would help to create an MLTable file in the storage.
paths: - file: ./your-file.csv transformations: - read_delimited: delimiter: "," encoding: "utf-8"Bye
Michael
-
Chandan Agrawal 0 Reputation points
2024-11-28T12:51:45.96+00:00 Hi Michael,
Yes, the data is properly formatted. Like i said, if I 'preview data' in the first step, it shows me the data perfectly fine.
-
romungi-MSFT 47,236 Reputation points Microsoft Employee2024-11-28T16:10:05.0466667+00:00 @Chandan Agrawal I think this is a recent issue that might be related to the ones mentioned in these threads.
How to correct Error Code: ScriptExecution.StreamAccess.Unexpected - Microsoft Q&A
I have reported this internally to check for known issues, I will update this thread as soon as I have an update. Thanks!!
-
Chandan Agrawal 0 Reputation points
2024-11-28T16:15:25.92+00:00 Hi,
yes, you are right. These are the same issues. Happy to have a session with you and show you the issue.
Please let me know what you find out.
Thanks
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(3.2, 4%, 10%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3ECI%3C/text%3E%3C/svg%3E)
Chukwuebuka Ijezie 0 Reputation points2024-11-29T18:12:20.95+00:00 I have this exact same issue and error code. Have you managed to resolve this?
-
Chukwuebuka Ijezie 0 Reputation points
2024-11-29T18:13:59.4366667+00:00 I have this exact same issue and error code, have you been able to resolve it?
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(131.20000000000002, 55.00000000000001%, 22%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EKV%3C/text%3E%3C/svg%3E)
Korimerla,Vidhisha 0 Reputation points2024-12-02T05:33:36.4633333+00:00 The same issue persists. Has it been resolved?
Sign in to comment
Sign in to answer