Relative Path in Absolute URI error while setting up Data Flow Source in ADF V2

Question

I am getting error below while setting up Source Options in ADF Data flow , I wanted to pickup all four .csv files under my Data lake folder MyFolder/2020/11/ alter the same column name Account ID in them using Derived Column , When I set the source setting I get error below in Data preview , also data preview only pick the first file and not sample rows from all files

at Source 'SrcSegFile': java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: dbo_AccessValue2020-11-23T00:45:10.3100276Z.csv

I have Attached the screen shot of error
Below is my Script
parameters{
WildcardPathYear as string (toString(currentUTC(),'YYYY')),
WildcardPathMonth as string (toString(currentUTC(),'MM'))
}
source(output(
AccessValueID as string,
SegmentModelID as string,
Name as string,
Description as string,
CreatedDate as string,
UpdatedDate as string
),
allowSchemaDrift: false,
validateSchema: false,
ignoreNoFilesFound: false,
limit: 4,
rowUrlColumn: 'SegmentFileNames',
wildcardPaths:[('MCF(Segments)/'+$WildcardPathYear+'/'+$WildcardPathMonth+'/'+'*.csv')]) ~> SrcSegFile
SrcSegFile alterRow(updateIf(AccessValueID!=' '),
partitionBy('hash', 1)) ~> AlterRow1
AlterRow1 derive(AccessValueID = AccessValueID == 'XXXX',
partitionBy('hash', 1)) ~> DerivedColumn1
DerivedColumn1 sink(allowSchemaDrift: true,
validateSchema: false,
partitionBy('hash', 1),
skipDuplicateMapInputs: true,
skipDuplicateMapOutputs: true) ~> SegFinalDest

Answer 1

Hi @AzeemK ,

Welcome to Microsoft Q&A Platform again! Thanks for posting the additional details for the query.

I have seen the recent issues on the similar error and it is mentioned on the limitation of having ":" character in the file name which will cause this error when using it as source in dataflow. I was able to reproduce this issue and observed that replacing the ":" character will resolve this.

Please suggest if this helps in resolving the issue. Looking forward for your response!

----

• Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
• Want a reminder to come back and check responses? Here is how to subscribe to a notification.