Deploying Python Web App that requires GDAL to Azure App Services fails

Question

Deploying Python Web App that requires GDAL to Azure App Services fails

Granada, Luis 5

Hello,

I'm trying to deploy a web app built with Python and Dash (Flask) to Azure App Services. This web app requires GDAL to work. When I try to deploy via VS Code I get the errors shown below. Can anyone help please?


11:52:28 AM test-gen-abc: [09:52:19+0000] Collecting GDAL==3.7.0
11:52:28 AM test-gen-abc: [09:52:19+0000]   Downloading GDAL-3.7.0.tar.gz (775 kB)
11:52:28 AM test-gen-abc: [09:52:19+0000]      ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 775.5/775.5 kB 1.9 MB/s eta 0:00:00
11:52:28 AM test-gen-abc: [09:52:19+0000]   Preparing metadata (setup.py): started
11:52:28 AM test-gen-abc: [09:52:20+0000]   Preparing metadata (setup.py): finished with status 'error'
11:52:28 AM test-gen-abc:   error: subprocess-exited-with-error
11:52:28 AM test-gen-abc:   
11:52:28 AM test-gen-abc:   × python setup.py egg_info did not run successfully.
11:52:28 AM test-gen-abc:   │ exit code: 1
11:52:28 AM test-gen-abc:   ╰─> [94 lines of output]
11:52:28 AM test-gen-abc:       WARNING: numpy not available!  Array support will not be enabled
11:52:28 AM test-gen-abc:       running egg_info
11:52:28 AM test-gen-abc:       creating /tmp/pip-pip-egg-info-dh67mqbk/GDAL.egg-info
11:52:28 AM test-gen-abc:       writing /tmp/pip-pip-egg-info-dh67mqbk/GDAL.egg-info/PKG-INFO
11:52:28 AM test-gen-abc:       writing dependency_links to /tmp/pip-pip-egg-info-dh67mqbk/GDAL.egg-info/dependency_links.txt
11:52:28 AM test-gen-abc:       writing requirements to /tmp/pip-pip-egg-info-dh67mqbk/GDAL.egg-info/requires.txt
11:52:29 AM test-gen-abc:       writing top-level names to /tmp/pip-pip-egg-info-dh67mqbk/GDAL.egg-info/top_level.txt
11:52:29 AM test-gen-abc:       writing manifest file '/tmp/pip-pip-egg-info-dh67mqbk/GDAL.egg-info/SOURCES.txt'
11:52:29 AM test-gen-abc:       Traceback (most recent call last):
11:52:29 AM test-gen-abc:         File "/tmp/pip-install-2ai2grh7/gdal_5f36f7946f2c49f5a3622e4d2208607b/setup.py", line 87, in fetch_config
11:52:29 AM test-gen-abc:           p = subprocess.Popen([command, args], stdout=subprocess.PIPE)
11:52:29 AM test-gen-abc:               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
11:52:29 AM test-gen-abc:         File "/tmp/oryx/platforms/python/3.11.0/lib/python3.11/subprocess.py", line 1022, in __init__
11:52:29 AM test-gen-abc:           self._execute_child(args, executable, preexec_fn, close_fds,
11:52:29 AM test-gen-abc:         File "/tmp/oryx/platforms/python/3.11.0/lib/python3.11/subprocess.py", line 1899, in _execute_child
11:52:29 AM test-gen-abc:           raise child_exception_type(errno_num, err_msg, err_filename)
11:52:29 AM test-gen-abc:       FileNotFoundError: [Errno 2] No such file or directory: 'gdal-config'
11:52:29 AM test-gen-abc:       
11:52:29 AM test-gen-abc:       During handling of the above exception, another exception occurred:
11:52:29 AM test-gen-abc:       
11:52:29 AM test-gen-abc:       Traceback (most recent call last):
11:52:29 AM test-gen-abc:         File "/tmp/pip-install-2ai2grh7/gdal_5f36f7946f2c49f5a3622e4d2208607b/setup.py", line 188, in get_gdal_config
11:52:29 AM test-gen-abc:           return fetch_config(option, gdal_config=self.gdal_config)
11:52:29 AM test-gen-abc:                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
11:52:29 AM test-gen-abc:         File "/tmp/pip-install-2ai2grh7/gdal_5f36f7946f2c49f5a3622e4d2208607b/setup.py", line 90, in fetch_config
11:52:29 AM test-gen-abc:           raise gdal_config_error(e)
11:52:29 AM test-gen-abc:       gdal_config_error: [Errno 2] No such file or directory: 'gdal-config'
11:52:29 AM test-gen-abc:       
11:52:29 AM test-gen-abc:       During handling of the above exception, another exception occurred:
11:52:29 AM test-gen-abc:       
11:52:29 AM test-gen-abc:       Traceback (most recent call last):
11:52:29 AM test-gen-abc:         File "

SnehaAgrawal-MSFT 22,706 Reputation points Moderator

2023-06-15T16:20:47.71+00:00
@Granada, Luis Thanks for reaching here!

The error message- FileNotFoundError: [Errno 2] No such file or directory: 'gdal-config'

You are seeing is due to the missing GDAL library. You can try to install the GDAL library in your local environment and then deploy the web app to Azure App Services.

Alternatively, you can try to use a Docker container to deploy your web app to Azure App Services. Dockerfile installs the GDAL library using the apt-get package manager, installs the Python dependencies using pip, and then runs the app.py script.

To use this Dockerfile, you will need to build a Docker image and then deploy the image to Azure App Services.

You can find more information on how to deploy a Python web app to Azure App Services in the following documents:

Quickstart: Deploy a Python (Django or Flask) web app to Azure.

Quickstart: Create a Python app in the Azure portal.
SnehaAgrawal-MSFT 22,706 Reputation points Moderator

2023-06-19T04:29:07.7066667+00:00

@Granada, Luis

Just checking if you have chance to see recent response.

Please let us know if further query or issue remains.
Granada, Luis 5 Reputation points

2023-06-19T07:47:42.2+00:00

Hi @SnehaAgrawal-MSFT , my understanding was that I needed to provide the app along with the "requirements.txt" file and the packages would install automatically via pip while deploying the app to Azure, and that is what I did, and I added GDAL to the "requirements.txt" file, and that is not working. You are suggesting I should install GDAL on my local environment (which I have by the way) and then deploy everything (app + local environment) to Azure right? My local environment is not in the same folder as the app I'm deploying so if that is the case I would need to create the local environment in the app folder and re-deploy to see if it works.
SnehaAgrawal-MSFT 22,706 Reputation points Moderator

2023-06-21T09:57:45.3566667+00:00

@Granada, Luis Also i can see-

(setup.py): finished with status 'error

This means that the Oryx build process failed to find your requirements.txt file. To resolve this its suggested to Connect to the web app's container via SSH and verify that requirements.txt is named correctly and exists directly under site/wwwroot.

If it doesn't exist, make site the file exists in your repository and is included in your deployment. If it exists in a separate folder, move it to the root.

Let us know.
Granada, Luis 5 Reputation points

2023-06-23T12:18:16.8666667+00:00

I confirm that the requirements.txt file is there, and that's why it's installing GDAL, because it is in the requirements. I didn't send the whole log, but in the log you can see that all packages from requirements.txt are installed until reaches GDAL.
SnehaAgrawal-MSFT 22,706 Reputation points Moderator

2023-06-26T06:14:46.2966667+00:00

@Granada, Luis Thanks for reply! Please reach out to us by sending an email with subject line “Attn:Sneha |thread title” to AzCommunity[at]microsoft[dot]com referencing this thread, for deeper investigation on this issue.

1 answer

Your answer

SnehaAgrawal-MSFT 22,706 Reputation points Moderator

2023-06-15T16:20:47.71+00:00

@Granada, Luis Thanks for reaching here!

The error message- FileNotFoundError: [Errno 2] No such file or directory: 'gdal-config'

You are seeing is due to the missing GDAL library. You can try to install the GDAL library in your local environment and then deploy the web app to Azure App Services.

Alternatively, you can try to use a Docker container to deploy your web app to Azure App Services. Dockerfile installs the GDAL library using the apt-get package manager, installs the Python dependencies using pip, and then runs the app.py script.

To use this Dockerfile, you will need to build a Docker image and then deploy the image to Azure App Services.

You can find more information on how to deploy a Python web app to Azure App Services in the following documents:

Quickstart: Deploy a Python (Django or Flask) web app to Azure.

Quickstart: Create a Python app in the Azure portal.
SnehaAgrawal-MSFT 22,706 Reputation points Moderator

2023-06-19T04:29:07.7066667+00:00

@Granada, Luis

Just checking if you have chance to see recent response.

Please let us know if further query or issue remains.
Granada, Luis 5 Reputation points

2023-06-19T07:47:42.2+00:00

Hi @SnehaAgrawal-MSFT , my understanding was that I needed to provide the app along with the "requirements.txt" file and the packages would install automatically via pip while deploying the app to Azure, and that is what I did, and I added GDAL to the "requirements.txt" file, and that is not working. You are suggesting I should install GDAL on my local environment (which I have by the way) and then deploy everything (app + local environment) to Azure right? My local environment is not in the same folder as the app I'm deploying so if that is the case I would need to create the local environment in the app folder and re-deploy to see if it works.
SnehaAgrawal-MSFT 22,706 Reputation points Moderator

2023-06-21T09:57:45.3566667+00:00

@Granada, Luis Also i can see-

(setup.py): finished with status 'error

This means that the Oryx build process failed to find your requirements.txt file. To resolve this its suggested to Connect to the web app's container via SSH and verify that requirements.txt is named correctly and exists directly under site/wwwroot.

If it doesn't exist, make site the file exists in your repository and is included in your deployment. If it exists in a separate folder, move it to the root.

Let us know.
Granada, Luis 5 Reputation points

2023-06-23T12:18:16.8666667+00:00

I confirm that the requirements.txt file is there, and that's why it's installing GDAL, because it is in the requirements. I didn't send the whole log, but in the log you can see that all packages from requirements.txt are installed until reaches GDAL.
SnehaAgrawal-MSFT 22,706 Reputation points Moderator

2023-06-26T06:14:46.2966667+00:00

@Granada, Luis Thanks for reply! Please reach out to us by sending an email with subject line “Attn:Sneha |thread title” to AzCommunity[at]microsoft[dot]com referencing this thread, for deeper investigation on this issue.

Answer 1

Granada, Luis 5

I have solved the problem for now by installing a custom GDAL wheel for Linux since the web app is installed on Linux. In the requirements.txt file, I replaced:

GDAL==3.7.0

with

./wheelhouse/GDAL-3.4.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl

And then stored the file "GDAL-3.4.1-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl" in a folder called "wheelhouse" inside the project.

It works.

SnehaAgrawal-MSFT 22,706 Reputation points Moderator

2023-07-07T08:30:05.6333333+00:00

@Granada, Luis Glad to know, thanks for sharing.

Share via

Deploying Python Web App that requires GDAL to Azure App Services fails

1 answer

Your answer