Share via


Serverless GPU environment version 5 (Beta)

Important

Serverless GPU compute on Databricks is in Beta. During Beta, the contents of the supported environments, including the list of packages or versions of installed packages, might change.

This page outlines the system environment information for Serverless GPU environment version 5.

Serverless GPU environment 5 is built on top of serverless environment 5 (CPU). See what's new in serverless environment 5 (CPU). It includes two different environments:

To ensure compatibility for the application, Serverless GPU workloads use a versioned API, known as the environment version, which remains compatible with newer server versions.

You can select the environment version using the Environment side panel in your serverless notebooks. See Set up serverless GPU compute.

New features and improvements

In version 5, Databricks is providing a minimal environment that supports only serverless GPU API, the Databricks dependencies, and MLflow. Users can customize the environment to their needs. The default base environment in version 5 does not include certain packages present in the CPU environment, in order to provide a minimal functional GPU environment. Users wanting a complete environment with comprehensive AI libraries should use the Databricks AI environment.

Packages added to Databricks AI environment

The following new packages have been added to the Databricks AI environment in version 5:

  • catboost 1.2.8
  • trl 0.23.0
  • unsloth 2025.11.3
  • vllm 0.13.0
  • omegaconf 2.3.0
  • statsmodels 0.14.4
  • networkx 3.4.2

Packages removed from Databricks AI environment

The following packages have been removed from the Databricks AI environment in version 5:

  • spacy
  • sentencepiece

Packages not included in base environment

The following packages are not included in the base environment but remain available in the CPU environment:

  • scipy
  • seaborn
  • scikit-learn

The following packages are not included in the base environment but remain available in the Databricks AI environment:

  • flash-attention
  • torch
  • torchvision

System environment

  • Operating System: Ubuntu 24.04.2 LTS
  • Python: 3.12.3
  • Databricks Connect: 18.0.0
  • NVIDIA CUDA Toolkit: 12.9

Installed Python libraries

Default base environment

To reproduce serverless GPU environment 5 in your local Python virtual environment, download the requirements-env-gpu-5.txt file and run pip install -r requirements-env-gpu-5.txt. This command installs all of the open source libraries from serverless environment 5.

Library Version Library Version Library Version
aiohappyeyeballs 2.4.4 aiohttp 3.11.10 aiosignal 1.2.0
annotated-doc 0.0.4 annotated-types 0.7.0 anyio 4.7.0
argon2-cffi 21.3.0 argon2-cffi-bindings 21.2.0 arro3-core 0.6.5
arrow 1.3.0 asttokens 3.0.0 astunparse 1.6.3
async-lru 2.0.4 attrs 24.3.0 azure-common 1.1.28
azure-core 1.37.0 azure-identity 1.20.0 azure-mgmt-core 1.6.0
azure-mgmt-web 8.0.0 azure-storage-blob 12.28.0 azure-storage-file-datalake 12.22.0
babel 2.16.0 beautifulsoup4 4.12.3 black 24.10.0
bleach 6.2.0 blinker 1.7.0 boto3 1.40.45
botocore 1.40.45 cachetools 5.5.1 certifi 2025.4.26
cffi 1.17.1 chardet 4.0.0 charset-normalizer 3.3.2
click 8.1.8 cloudpickle 3.0.0 comm 0.2.1
contourpy 1.3.1 cryptography 44.0.1 cycler 0.11.0
Cython 3.1.5 databricks-agents 1.9.1 databricks-connect 18.0.0
databricks-sdk 0.67.0 databricks.serverless_gpu 0.5.11 dataclasses-json 0.6.7
dbus-python 1.3.2 debugpy 1.8.11 decorator 5.1.1
defusedxml 0.7.1 deltalake 1.1.4 Deprecated 1.2.18
distlib 0.3.9 distro 1.9.0 distro-info 1.7+build1
docstring-to-markdown 0.11 executing 1.2.0 facets-overview 1.1.1
fastapi 0.128.0 fastjsonschema 2.21.1 filelock 3.17.0
fonttools 4.55.3 fqdn 1.5.1 frozenlist 1.5.0
fsspec 2023.5.0 future 1.0.0 gitdb 4.0.11
GitPython 3.1.43 google-api-core 2.28.1 google-auth 2.47.0
google-cloud-core 2.5.0 google-cloud-storage 3.7.0 google-crc32c 1.8.0
google-resumable-media 2.8.0 googleapis-common-protos 1.65.0 grpcio 1.67.0
grpcio-status 1.67.0 h11 0.16.0 hf-xet 1.2.0
httpcore 1.0.9 httplib2 0.20.4 httpx 0.28.1
huggingface_hub 1.2.4 idna 3.7 importlib_metadata 8.5.0
iniconfig 1.1.1 ipyflow-core 0.0.209 ipykernel 6.29.5
ipython 8.30.0 ipython-genutils 0.2.0 ipywidgets 7.8.1
isodate 0.7.2 isoduration 20.11.0 jedi 0.19.2
Jinja2 3.1.6 jiter 0.12.0 jmespath 1.0.1
joblib 1.4.2 json5 0.9.25 jsonpatch 1.33
jsonpointer 3.0.0 jsonschema 4.23.0 jsonschema-specifications 2023.7.1
jupyter_client 8.6.3 jupyter_core 5.7.2 jupyter-events 0.12.0
jupyter-lsp 2.2.5 jupyter_server 2.15.0 jupyter_server_terminals 0.5.3
jupyterlab 4.3.4 jupyterlab_pygments 0.3.0 jupyterlab_server 2.27.3
jupyterlab_widgets 1.1.11 kiwisolver 1.4.8 langchain-core 1.2.6
langchain-openai 1.1.6 langsmith 0.6.1 launchpadlib 1.11.0
lazr.restfulclient 0.14.6 lazr.uri 1.0.6 litellm 1.75.9
markdown-it-py 2.2.0 MarkupSafe 3.0.2 marshmallow 3.26.2
matplotlib 3.10.0 matplotlib-inline 0.1.7 mccabe 0.7.0
mdurl 0.1.0 mistune 3.1.2 mlflow-skinny 3.8.1
mmh3 5.2.0 msal 1.34.0 msal-extensions 1.3.1
multidict 6.1.0 mypy-extensions 1.0.0 nbclient 0.10.2
nbconvert 7.16.6 nbformat 5.10.4 nest-asyncio 1.6.0
nodeenv 1.10.0 notebook 7.3.2 notebook_shim 0.2.4
numpy 2.1.3 nvidia-ml-py 13.590.44 oauthlib 3.2.2
openai 2.14.0 opentelemetry-api 1.39.1 opentelemetry-proto 1.39.1
opentelemetry-sdk 1.39.1 opentelemetry-semantic-conventions 0.60b1 orjson 3.11.5
overrides 7.4.0 packaging 24.2 pandas 2.2.3
pandocfilters 1.5.0 parambench-train-comms 0.0.0 parso 0.8.4
pathspec 0.10.3 patsy 1.0.1 pexpect 4.8.0
pillow 11.1.0 pip 25.0.1 platformdirs 4.3.7
plotly 5.24.1 pluggy 1.5.0 prometheus_client 0.21.1
prompt-toolkit 3.0.43 propcache 0.3.1 proto-plus 1.27.0
protobuf 5.29.4 psutil 5.9.0 psycopg2 2.9.11
ptyprocess 0.7.0 pure-eval 0.2.2 py4j 0.10.9.9
pyarrow 21.0.0 pyasn1 0.4.8 pyasn1-modules 0.2.8
pyccolo 0.0.71 pycparser 2.21 pydantic 2.10.6
pydantic_core 2.27.2 pydot 4.0.0 pyflakes 3.2.0
Pygments 2.19.1 PyGObject 3.48.2 pyiceberg 0.10.0
PyJWT 2.10.1 pyodbc 5.2.0 pyparsing 3.2.0
pyright 1.1.394 pyroaring 1.0.3 pyspark 4.1.0+databricks.connect.18.0.0
pytest 8.3.5 python-apt 2.7.7+ubuntu5.1 python-dateutil 2.9.0.post0
python-dotenv 1.2.1 python-json-logger 3.2.1 python-lsp-jsonrpc 1.1.2
python-lsp-server 1.12.2 pytoolconfig 1.2.6 pytz 2024.1
PyYAML 6.0.2 pyzmq 26.2.0 referencing 0.30.2
regex 2024.11.6 requests 2.32.3 requests-toolbelt 1.0.0
rfc3339-validator 0.1.4 rfc3986-validator 0.1.1 rich 13.9.4
rope 1.13.0 rpds-py 0.22.3 rsa 4.9.1
s3transfer 0.14.0 Send2Trash 1.8.2 setuptools 78.1.1
shellingham 1.5.4 six 1.17.0 smmap 5.0.0
sniffio 1.3.0 sortedcontainers 2.4.0 soupsieve 2.5
sqlparse 0.5.5 ssh-import-id 5.11 stack-data 0.6.3
starlette 0.50.0 strictyaml 1.7.3 tenacity 9.0.0
terminado 0.17.1 threadpoolctl 3.5.0 tiktoken 0.12.0
tinycss2 1.4.0 tokenize_rt 6.1.0 tokenizers 0.22.2
tomli 2.0.1 tornado 6.5.1 tqdm 4.67.1
traitlets 5.14.3 typer-slim 0.21.1 types-python-dateutil 2.9.0.20251115
typing_extensions 4.12.2 typing-inspect 0.9.0 tzdata 2024.1
ujson 5.10.0 unattended-upgrades 0.1 uri-template 1.3.0
urllib3 2.3.0 uuid_utils 0.12.0 uvicorn 0.40.0
virtualenv 20.29.3 wadllib 1.3.6 wcwidth 0.2.5
webcolors 25.10.0 webencodings 0.5.1 websocket-client 1.8.0
whatthepatch 1.0.2 wheel 0.45.1 whenever 0.7.3
widgetsnbextension 3.6.6 wrapt 1.17.0 yapf 0.40.2
yarl 1.18.0 zipp 3.21.0 zstandard 0.23.0

AI environment

The AI environment includes all the packages from the default base environment, as well as the following packages. This environment includes PyTorch and comprehensive machine learning libraries:

  • torch 2.9.0
  • torchvision 0.24.0
  • flash_attn 2.8.3
  • catboost 1.2.8
  • langchain 0.3.27
  • lightgbm 4.6.0
  • openai 2.7.0
  • optuna 4.5.0
  • pytorch-lightning 2.5.4
  • ray 2.51.1
  • scikit-learn 1.6.1
  • scipy 1.15.3
  • seaborn 0.13.2
  • sentence-transformers 5.1.2
  • transformers 4.57.1
  • trl 0.23.0
  • unsloth 2025.11.3
  • vllm 0.13.0
  • xgboost 3.0.4

To reproduce AI environment V5 in your local Python virtual environment, download the requirements-ai-gpu-5.txt file and run pip install -r requirements-ai-gpu-5.txt. This command installs all the open source libraries from AI environment.

Library Version Library Version Library Version
absl-py 2.3.1 accelerate 1.11.0 aiohappyeyeballs 2.4.4
aiohttp 3.11.10 aiohttp-cors 0.8.1 aiosignal 1.2.0
alembic 1.18.0 annotated-doc 0.0.4 annotated-types 0.7.0
anthropic 0.71.0 antlr4-python3-runtime 4.9.3 anyio 4.7.0
apache-tvm-ffi 0.1.8.post2 argon2-cffi 21.3.0 argon2-cffi-bindings 21.2.0
arro3-core 0.6.5 arrow 1.3.0 astor 0.8.1
asttokens 3.0.0 astunparse 1.6.3 async-lru 2.0.4
attrs 24.3.0 audioread 3.1.0 azure-common 1.1.28
azure-core 1.37.0 azure-identity 1.20.0 azure-mgmt-core 1.6.0
azure-mgmt-web 8.0.0 azure-storage-blob 12.28.0 azure-storage-file-datalake 12.22.0
babel 2.16.0 bcrypt 4.3.0 beautifulsoup4 4.12.3
bitsandbytes 0.49.1 black 24.10.0 blake3 1.0.8
bleach 6.2.0 blinker 1.7.0 boto3 1.40.45
botocore 1.40.45 brotli 1.2.0 cachetools 5.5.1
catalogue 2.0.10 catboost 1.2.8 cbor2 5.8.0
certifi 2025.4.26 cffi 1.17.1 chardet 4.0.0
charset-normalizer 3.3.2 circuitbreaker 2.1.3 click 8.1.8
cloudpickle 3.0.0 colorful 0.5.8 colorlog 6.10.1
comm 0.2.1 compressed-tensors 0.12.2 contourpy 1.3.1
cramjam 2.11.0 cryptography 44.0.1 cuda-bindings 13.1.1
cuda-pathfinder 1.3.3 cuda-python 13.1.1 cupy-cuda12x 13.6.0
cut-cross-entropy 25.1.1 cycler 0.11.0 Cython 3.1.5
databricks-agents 1.9.1 databricks-connect 18.0.0 databricks-sdk 0.67.0
databricks.serverless_gpu 0.5.11 dataclasses-json 0.6.7 datasets 4.3.0
dbus-python 1.3.2 debugpy 1.8.11 decorator 5.1.1
defusedxml 0.7.1 deltalake 1.1.4 Deprecated 1.2.18
depyf 0.20.0 diffusers 0.36.0 dill 0.3.8
diskcache 5.6.3 distlib 0.3.9 distro 1.9.0
distro-info 1.7+build1 dm-tree 0.1.9 dnspython 2.8.0
docstring_parser 0.17.0 docstring-to-markdown 0.11 einops 0.8.1
email-validator 2.3.0 evaluate 0.4.6 executing 1.2.0
facets-overview 1.1.1 Farama-Notifications 0.0.4 fastapi 0.128.0
fastapi-cli 0.0.20 fastapi-cloud-cli 0.9.0 fastar 0.8.0
fastjsonschema 2.21.1 fastrlock 0.8.3 filelock 3.17.0
flash_attn 2.8.3 flashinfer-python 0.5.3 fonttools 4.55.3
fqdn 1.5.1 frozenlist 1.5.0 fsspec 2023.5.0
future 1.0.0 gguf 0.17.1 gitdb 4.0.11
GitPython 3.1.43 google-api-core 2.28.1 google-auth 2.47.0
google-cloud-core 2.5.0 google-cloud-storage 3.2.0 google-crc32c 1.8.0
google-resumable-media 2.8.0 googleapis-common-protos 1.65.0 graphviz 0.21
greenlet 3.1.1 grpcio 1.67.0 grpcio-status 1.67.0
gymnasium 1.1.1 h11 0.16.0 hf_transfer 0.1.9
hf-xet 1.2.0 httpcore 1.0.9 httplib2 0.20.4
httptools 0.7.1 httpx 0.28.1 httpx-sse 0.4.3
huggingface-hub 0.34.4 idna 3.7 ijson 3.4.0.post0
importlib_metadata 8.5.0 iniconfig 1.1.1 interegular 0.3.3
ipyflow-core 0.0.209 ipykernel 6.29.5 ipython 8.30.0
ipython-genutils 0.2.0 ipywidgets 7.8.1 isodate 0.7.2
isoduration 20.11.0 jedi 0.19.2 Jinja2 3.1.6
jiter 0.12.0 jmespath 1.0.1 joblib 1.4.2
json5 0.9.25 jsonpatch 1.33 jsonpointer 3.0.0
jsonschema 4.23.0 jsonschema-specifications 2023.7.1 jupyter_client 8.6.3
jupyter_core 5.7.2 jupyter-events 0.12.0 jupyter-lsp 2.2.5
jupyter_server 2.15.0 jupyter_server_terminals 0.5.3 jupyterlab 4.3.4
jupyterlab_pygments 0.3.0 jupyterlab_server 2.27.3 jupyterlab_widgets 1.1.11
kiwisolver 1.4.8 langchain 0.3.27 langchain-community 0.3.31
langchain-core 0.3.79 langchain-openai 0.3.35 langchain-text-splitters 0.3.11
langsmith 0.6.1 lark 1.2.2 launchpadlib 1.11.0
lazr.restfulclient 0.14.6 lazr.uri 1.0.6 lazy_loader 0.4
librosa 0.11.0 lightgbm 4.6.0 lightning-utilities 0.15.2
litellm 1.75.9 llguidance 1.3.0 llvmlite 0.44.0
lm-format-enforcer 0.11.3 loguru 0.7.3 lz4 4.3.2
Mako 1.3.10 markdown-it-py 2.2.0 MarkupSafe 3.0.2
marshmallow 3.26.2 matplotlib 3.10.0 matplotlib-inline 0.1.7
mccabe 0.7.0 mcp 1.25.0 mdurl 0.1.0
mistral_common 1.8.8 mistune 3.1.2 mlflow-skinny 3.8.1
mmh3 5.2.0 model-hosting-container-standards 0.1.13 mosaicml-streaming 0.13.0
mpmath 1.3.0 msal 1.34.0 msal-extensions 1.3.1
msgpack 1.1.2 msgspec 0.20.0 multidict 6.1.0
multiprocess 0.70.16 mypy-extensions 1.0.0 nbclient 0.10.2
nbconvert 7.16.6 nbformat 5.10.4 nest-asyncio 1.6.0
networkx 3.4.2 ninja 1.13.0 nodeenv 1.10.0
notebook 7.3.2 notebook_shim 0.2.4 numba 0.61.2
numpy 2.1.3 nvidia-cublas-cu12 12.8.4.1 nvidia-cuda-cupti-cu12 12.8.90
nvidia-cuda-nvrtc-cu12 12.8.93 nvidia-cuda-runtime-cu12 12.8.90 nvidia-cudnn-cu12 9.10.2.21
nvidia-cudnn-frontend 1.17.0 nvidia-cufft-cu12 11.3.3.83 nvidia-cufile-cu12 1.13.1.3
nvidia-curand-cu12 10.3.9.90 nvidia-cusolver-cu12 11.7.3.90 nvidia-cusparse-cu12 12.5.8.93
nvidia-cusparselt-cu12 0.7.1 nvidia-cutlass-dsl 4.3.5 nvidia-ml-py 13.590.44
nvidia-nccl-cu12 2.27.5 nvidia-nvjitlink-cu12 12.8.93 nvidia-nvshmem-cu12 3.3.20
nvidia-nvtx-cu12 12.8.90 oauthlib 3.2.2 oci 2.165.0
omegaconf 2.3.0 openai 2.7.0 openai-harmony 0.0.8
opencensus 0.11.4 opencensus-context 0.1.3 opencv-python 4.12.0.88
opencv-python-headless 4.12.0.88 opentelemetry-api 1.39.1 opentelemetry-exporter-prometheus 0.60b1
opentelemetry-proto 1.39.1 opentelemetry-sdk 1.39.1 opentelemetry-semantic-conventions 0.60b1
optuna 4.5.0 optuna-integration 4.5.0 orjson 3.11.5
ormsgpack 1.7.0 outlines_core 0.2.11 overrides 7.4.0
packaging 24.2 pandas 2.2.3 pandocfilters 1.5.0
parambench-train-comms 0.0.0 paramiko 3.5.1 parso 0.8.4
partial-json-parser 0.2.1.1.post7 pathspec 0.10.3 patsy 1.0.1
peft 0.17.1 pexpect 4.8.0 pillow 11.1.0
pip 25.0.1 platformdirs 4.3.7 plotly 5.24.1
pluggy 1.5.0 pooch 1.8.2 prometheus_client 0.21.1
prometheus-fastapi-instrumentator 7.1.0 prompt-toolkit 3.0.43 propcache 0.3.1
proto-plus 1.27.0 protobuf 5.29.4 psutil 5.9.0
psycopg2 2.9.11 ptyprocess 0.7.0 pure-eval 0.2.2
py-cpuinfo 9.0.0 py-spy 0.4.1 py4j 0.10.9.9
pyarrow 21.0.0 pyasn1 0.4.8 pyasn1-modules 0.2.8
pybase64 1.4.3 pyccolo 0.0.71 pycountry 24.6.1
pycparser 2.21 pydantic 2.12.0 pydantic_core 2.41.1
pydantic-extra-types 2.11.0 pydantic-settings 2.12.0 pydot 4.0.0
pyflakes 3.2.0 Pygments 2.19.1 PyGObject 3.48.2
pyiceberg 0.10.0 PyJWT 2.10.1 PyNaCl 1.5.0
pynndescent 0.6.0 pyodbc 5.2.0 pyOpenSSL 25.0.0
pyparsing 3.2.0 pyright 1.1.394 pyroaring 1.0.3
pyspark 4.1.0+databricks.connect.18.0.0 pytesseract 0.3.13 pytest 8.3.5
python-apt 2.7.7+ubuntu5.1 python-dateutil 2.9.0.post0 python-dotenv 1.1.1
python-json-logger 3.2.1 python-lsp-jsonrpc 1.1.2 python-lsp-server 1.12.2
python-multipart 0.0.21 python-snappy 0.7.3 pytoolconfig 1.2.6
pytorch-lightning 2.5.4 pytorch-ranger 0.1.1 pytz 2024.1
PyYAML 6.0.2 pyzmq 26.2.0 ray 2.51.1
referencing 0.30.2 regex 2024.11.6 requests 2.32.5
requests-toolbelt 1.0.0 rfc3339-validator 0.1.4 rfc3986-validator 0.1.1
rich 13.9.4 rich-toolkit 0.17.1 rignore 0.7.6
rope 1.13.0 rpds-py 0.22.3 rsa 4.9.1
s3transfer 0.14.0 safetensors 0.7.0 scikit-learn 1.6.1
scipy 1.15.3 seaborn 0.13.2 Send2Trash 1.8.2
sentence-transformers 5.1.2 sentencepiece 0.2.1 sentry-sdk 2.49.0
setproctitle 1.3.7 setuptools 78.1.1 shap 0.49.1
shellingham 1.5.4 six 1.17.0 slicer 0.0.8
smart_open 7.5.0 smmap 5.0.0 sniffio 1.3.0
sortedcontainers 2.4.0 soundfile 0.13.1 soupsieve 2.5
soxr 1.0.0 SQLAlchemy 2.0.39 sqlparse 0.5.5
sse-starlette 3.1.2 ssh-import-id 5.11 stack-data 0.6.3
starlette 0.50.0 statsmodels 0.14.4 stevedore 5.6.0
strictyaml 1.7.3 supervisor 4.3.0 sympy 1.13.3
tabulate 0.9.0 tenacity 9.0.0 tensorboardX 2.6.4
terminado 0.17.1 threadpoolctl 3.5.0 tiktoken 0.9.0
tinycss2 1.4.0 tokenize_rt 6.1.0 tokenizers 0.22.1
tomli 2.0.1 torch 2.9.0 torch-optimizer 0.3.0
torchao 0.15.0 torchaudio 2.9.0 torchmetrics 1.8.2
torchvision 0.24.0 tornado 6.5.1 tqdm 4.67.1
traitlets 5.14.3 transformers 4.57.1 triton 3.5.0
trl 0.23.0 typeguard 4.4.4 typer 0.21.1
typer-slim 0.21.1 types-python-dateutil 2.9.0.20251115 typing_extensions 4.14.1
typing-inspect 0.9.0 typing-inspection 0.4.2 tyro 1.0.4
tzdata 2024.1 ujson 5.10.0 umap-learn 0.5.9.post2
unattended-upgrades 0.1 unsloth 2025.11.3 unsloth_zoo 2026.1.2
uri-template 1.3.0 urllib3 2.3.0 uuid_utils 0.12.0
uvicorn 0.40.0 uvloop 0.22.1 virtualenv 20.29.3
virtualenv-clone 0.5.7 virtualenvwrapper 6.1.1 vllm 0.13.0
wadllib 1.3.6 watchfiles 1.1.1 wcwidth 0.2.5
webcolors 25.10.0 webencodings 0.5.1 websocket-client 1.8.0
websockets 16.0 whatthepatch 1.0.2 wheel 0.45.1
whenever 0.7.3 widgetsnbextension 3.6.6 wrapt 1.17.0
xformers 0.0.33.post1 xgboost 3.0.4 xgboost-ray 0.1.19
xgrammar 0.1.27 xxhash 3.5.0 yapf 0.40.2
yarl 1.18.0 zipp 3.21.0 zstandard 0.23.0
zstd 1.5.5.1