The issue you are experiencing, where certain data files are not copying to Azure Blob Storage while others do, is likely due to the length of the file names. In your case, two specific files with longer names were not copying. When the file names were shortened, they copied successfully.
To resolve this issue, ensure that the file names adhere to the limitations set by Azure Blob Storage. The maximum path length and blob name length should not exceed 256 characters. If a file name is too long, it may prevent the file from being copied successfully.
Here are the steps to troubleshoot and resolve the issue:
Check File Name Length: Review the length of the file names that are not copying. Ensure they do not exceed the 256-character limit.
Shorten File Names: If the file names are too long, shorten them and attempt to copy the files again.
Test with Shortened Names: Perform a test by copying files with shortened names to confirm that the issue is resolved.
Review Documentation: Refer to the official Azure documentation on naming and referencing containers, blobs, and metadata to understand the limitations and best practices.
Resources:
Hope this helps. If you have any follow-up questions, please let me know. I would be happy to help.
Please do not forget to "Accept the answer" and "up-vote" wherever the information provided helps you, as this can be beneficial to other community members.