Synapse df.to_parquet Write to Data Lake error

Question

I am having this problem when trying to write the parquet file using the df.to_parquet command in the notebook. The command was working perfectly but now it does not work as intended.

import fsspec
import pandas
from datetime import datetime

if ('' + output_timestamp == ''):
output_timestamp = datetime.utcnow().isoformat().replace(":", "") + "0Z"

sas_key = TokenLibrary.getConnectionString(linked_service_name)

fsspec_handle = fsspec.open(output_folder_path_full + '/' + output_timestamp + '/' + output_file_name, sas_token=sas_key, mode='wt')
with fsspec_handle.open() as f:
f.write(response.text)

module 'fsspec_wrapper' has no attribute 'AzureBlobFileSystem'

Answer 1

Hello @SoonJoo@Genting ,
Thanks for the question and using MS Q&A platform.
As we understand the ask here is get rid of the error called out above , please do let us know if its not accurate.
It appears that the the package fsspec is not the latest one and hence this issue .
Please update the ppackage and that will resolve the issue .
install fsspec
More on the same issue here
Please do let me if you have any queries.
Thanks
Himanshu

---

• Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
  • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators