This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(108.80000000000001, 40%, 20%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBH%3C/text%3E%3C/svg%3E)
Hi,
I would like to add a .so file to one of the sys.path directories.
I have attempted to use shutil to copy over from adls, but shutil doesn't recognise this path.
Any ideas?
Thanks
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 70%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMM%3C/text%3E%3C/svg%3E)
Hello @Ben Holden and welcome to Microsoft Q&A.
If I understand correctly, you are working in a PySpark notebook in Synapse Analytics. You are trying to copy a file of extension ".so" from ADLS gen 2 to the cluster. The specific location is one of the results of running
import shutil
import sys
print(sys.path)
Please let me know if my understanding is correct. When you try this, one of the paths are not recognized. Is this the path in your ADLS source, or the destination?
When I run the above code, the results start with
/mnt/var/hadoop/tmp/...
/opt/spark/python/...
/home/trusted-service-user/...
/usr/hdp/current/...
If the path starts with one of these, which one?
Hi @MartinJaffer-MSFT , thanks for the warm welcome :).
Yes, that is exactly what I'm doing, sorry if i was too vague.
The path that isn't working is the ADLS path, which i have tried to input using the abfss path, the URL etc.
The destination path I was targeting started with /home/trusted-service-user/...
@Ben Holden , have you configured access to your ADLS? See pre-requisites here. Also, is this file in the default storage account, or an additional one?
There are several possible things happening here. I have not tried shutil in pyspark before now, so I do not know if it can work. shutil may not be compatible with the abfss driver.
Hi @MartinJaffer-MSFT ,
So, this ADLS is configured and is the default one.
I thought it might be that abfss is the problem.
Is there any other way to add a file to the /home directory?
The file doesn't have to be moved using shutil, or moved from ADLS.
Thanks
You can use the built-in file utilities.
@Ben Holden