Azure Synapse Runtime for Apache Spark 3.2 (Fim do suporte anunciado)
O Azure Synapse Analytics dá suporte a vários tempos de execução para o Apache Spark. Este documento abordará os componentes e versões de tempo de execução para o Azure Synapse Runtime for Apache Spark 3.2.
Importante
- O fim do suporte anunciado para o Azure Synapse Runtime for Apache Spark 3.2 foi anunciado em 8 de julho de 2023.
- O tempo de execução anunciado para o fim do suporte não terá correções de bugs e recursos. Será efetuado o backport das correções de segurança com base na avaliação de risco.
- De acordo com a política de ciclo de vida do tempo de execução do Synapse para Apache Spark, o tempo de execução do Azure Synapse para Apache Spark 3.2 será desativado e desativado a partir de 8 de julho de 2024. Após a data de fim do suporte, os tempos de execução desativados não estão disponíveis para novos pools do Spark e os fluxos de trabalho existentes não podem ser executados. Os metadados permanecerão temporariamente no espaço de trabalho Sinapse.
- É altamente recomendável que você atualize suas cargas de trabalho do Apache Spark 3.2 para o Azure Synapse Runtime for Apache Spark 3.4 (GA) antes de 8 de julho de 2024.
Versões de componentes
| Componente | Versão |
|---|---|
| Apache Spark | 3.2.1 |
| Sistema operativo | Ubuntu 18.04 |
| Java | 1.8.0_282 |
| Scala | 2.12.15 |
| Hadoop | 3.3.1 |
| .NET Core | 3.1 |
| .NET | 2.0.0 |
| Delta Lake | 1.2 |
| Python | 3,8 |
| R (Pré-visualização) | 4.2 |
Synapse-Python38-CPU.yml contém a lista de bibliotecas fornecidas no ambiente Python 3.8 padrão no Azure Synapse Spark.
Bibliotecas Scala e Java
HikariCP-2.5.1.jar
JLargeArrays-1.5.jar
JTransforms-3.1.jar
RoaringBitmap-0.9.0.jar
ST4-4.0.4.jar
SparkCustomEvents-3.2.0-1.0.0.jar
TokenLibrary-assembly-3.0.0.jar
VegasConnector-1.1.01_2.12_3.2.0-SNAPSHOT.jar
activation-1.1.1.jar
adal4j-1.6.3.jar
aircompressor-0.21.jar
algebra_2.12-2.0.1.jar
aliyun-java-sdk-core-3.4.0.jar
aliyun-java-sdk-ecs-4.2.0.jar
aliyun-java-sdk-ram-3.0.0.jar
aliyun-java-sdk-sts-3.0.0.jar
aliyun-sdk-oss-3.4.1.jar
annotations-17.0.0.jar
antlr-runtime-3.5.2.jar
antlr4-runtime-4.8.jar
aopalliance-repackaged-2.6.1.jar
apache-log4j-extras-1.2.17.jar
apiguardian-api-1.1.0.jar
arpack-2.2.1.jar
arpack_combined_all-0.1.jar
arrow-format-2.0.0.jar
arrow-memory-core-2.0.0.jar
arrow-memory-netty-2.0.0.jar
arrow-vector-2.0.0.jar
audience-annotations-0.5.0.jar
avro-1.10.2.jar
avro-ipc-1.10.2.jar
avro-mapred-1.10.2.jar
aws-java-sdk-bundle-1.11.901.jar
azure-data-lake-store-sdk-2.3.6.jar
azure-eventhubs-3.3.0.jar
azure-eventhubs-spark_2.12-2.3.21.jar
azure-keyvault-core-1.0.0.jar
azure-storage-7.0.1.jar
azure-synapse-ml-pandas_2.12-1.0.0.jar
azure-synapse-ml-predict_2.12-1.0.jar
blas-2.2.1.jar
bonecp-0.8.0.RELEASE.jar
breeze-macros_2.12-1.2.jar
breeze_2.12-1.2.jar
cats-kernel_2.12-2.1.1.jar
chill-java-0.10.0.jar
chill_2.12-0.10.0.jar
client-sdk-1.14.0.jar
cntk-2.4.jar
commons-cli-1.2.jar
commons-codec-1.15.jar
commons-collections-3.2.2.jar
commons-compiler-3.0.16.jar
commons-compress-1.21.jar
commons-crypto-1.1.0.jar
commons-dbcp-1.4.jar
commons-io-2.8.0.jar
commons-lang-2.6.jar
commons-lang3-3.12.0.jar
commons-logging-1.1.3.jar
commons-math3-3.4.1.jar
commons-net-3.1.jar
commons-pool-1.5.4.jar
commons-pool2-2.6.2.jar
commons-text-1.6.jar
compress-lzf-1.0.3.jar
config-1.3.4.jar
core-1.1.2.jar
cos_api-bundle-5.6.19.jar
cosmos-analytics-spark-3.2.1-connector-1.6.0.jar
cudf-22.02.0-cuda11.jar
curator-client-2.13.0.jar
curator-framework-2.13.0.jar
curator-recipes-2.13.0.jar
datanucleus-api-jdo-4.2.4.jar
datanucleus-core-4.1.17.jar
datanucleus-rdbms-4.1.19.jar
delta-core_2.12-1.2.1.2.jar
derby-10.14.2.0.jar
dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar
flatbuffers-java-1.9.0.jar
fluent-logger-jar-with-dependencies-jdk8.jar
gson-2.8.6.jar
guava-14.0.1.jar
hadoop-aliyun-3.3.1.5.0-57088972.jar
hadoop-annotations-3.3.1.5.0-57088972.jar
hadoop-aws-3.3.1.5.0-57088972.jar
hadoop-azure-3.3.1.5.0-57088972.jar
hadoop-azure-datalake-3.3.1.5.0-57088972.jar
hadoop-client-api-3.3.1.5.0-57088972.jar
hadoop-client-runtime-3.3.1.5.0-57088972.jar
hadoop-cloud-storage-3.3.1.5.0-57088972.jar
hadoop-cos-3.3.1.5.0-57088972.jar
hadoop-openstack-3.3.1.5.0-57088972.jar
hadoop-shaded-guava-1.1.0.jar
hadoop-yarn-server-web-proxy-3.3.1.5.0-57088972.jar
hdinsight-spark-metrics-3.2.0-1.0.0.jar
hive-beeline-2.3.9.jar
hive-cli-2.3.9.jar
hive-common-2.3.9.jar
hive-exec-2.3.9-core.jar
hive-jdbc-2.3.9.jar
hive-llap-common-2.3.9.jar
hive-metastore-2.3.9.jar
hive-serde-2.3.9.jar
hive-service-rpc-3.1.2.jar
hive-shims-0.23-2.3.9.jar
hive-shims-2.3.9.jar
hive-shims-common-2.3.9.jar
hive-shims-scheduler-2.3.9.jar
hive-storage-api-2.7.2.jar
hive-vector-code-gen-2.3.9.jar
hk2-api-2.6.1.jar
hk2-locator-2.6.1.jar
hk2-utils-2.6.1.jar
htrace-core4-4.1.0-incubating.jar
httpclient-4.5.13.jar
httpclient-4.5.6.jar
httpcore-4.4.14.jar
httpmime-4.5.13.jar
httpmime-4.5.6.jar
hyperspace-core-spark3.2_2.12-0.5.1-synapse.jar
impulse-core_spark3.2_2.12-0.1.8.jar
impulse-telemetry-mds_spark3.2_2.12-0.1.8.jar
isolation-forest_3.2.0_2.12-2.0.8.jar
istack-commons-runtime-3.0.8.jar
ivy-2.5.0.jar
jackson-annotations-2.12.3.jar
jackson-core-2.12.3.jar
jackson-core-asl-1.9.13.jar
jackson-databind-2.12.3.jar
jackson-dataformat-cbor-2.12.3.jar
jackson-mapper-asl-1.9.13.jar
jackson-module-scala_2.12-2.12.3.jar
jakarta.annotation-api-1.3.5.jar
jakarta.inject-2.6.1.jar
jakarta.servlet-api-4.0.3.jar
jakarta.validation-api-2.0.2.jar
jakarta.ws.rs-api-2.1.6.jar
jakarta.xml.bind-api-2.3.2.jar
janino-3.0.16.jar
javassist-3.25.0-GA.jar
javatuples-1.2.jar
javax.jdo-3.2.0-m3.jar
javolution-5.5.1.jar
jaxb-api-2.2.11.jar
jaxb-runtime-2.3.2.jar
jcl-over-slf4j-1.7.30.jar
jdo-api-3.0.1.jar
jdom-1.1.jar
jersey-client-2.34.jar
jersey-common-2.34.jar
jersey-container-servlet-2.34.jar
jersey-container-servlet-core-2.34.jar
jersey-hk2-2.34.jar
jersey-server-2.34.jar
jettison-1.1.jar
jetty-util-9.4.43.v20210629.jar
jetty-util-ajax-9.4.43.v20210629.jar
jline-2.14.6.jar
joda-time-2.10.10.jar
jodd-core-3.5.2.jar
jpam-1.1.jar
jsch-0.1.54.jar
json-1.8.jar
json-20090211.jar
json-20210307.jar
json-simple-1.1.jar
json4s-ast_2.12-3.7.0-M11.jar
json4s-core_2.12-3.7.0-M11.jar
json4s-jackson_2.12-3.7.0-M11.jar
json4s-scalap_2.12-3.7.0-M11.jar
jsr305-3.0.0.jar
jta-1.1.jar
jul-to-slf4j-1.7.30.jar
junit-jupiter-5.5.2.jar
junit-jupiter-api-5.5.2.jar
junit-jupiter-engine-5.5.2.jar
junit-jupiter-params-5.5.2.jar
junit-platform-commons-1.5.2.jar
junit-platform-engine-1.5.2.jar
kafka-clients-2.8.0.jar
kryo-shaded-4.0.2.jar
kusto-data-2.7.0.jar
kusto-ingest-2.7.0.jar
kusto-spark_3.0_2.12-2.7.5.jar
lapack-2.2.1.jar
leveldbjni-all-1.8.jar
libfb303-0.9.3.jar
libshufflejni.so
libthrift-0.12.0.jar
libvegasjni.so
lightgbmlib-3.2.110.jar
log4j-1.2.17.jar
lz4-java-1.7.1.jar
macro-compat_2.12-1.1.1.jar
mdsdclientdynamic-2.0.jar
metrics-core-4.2.0.jar
metrics-graphite-4.2.0.jar
metrics-jmx-4.2.0.jar
metrics-json-4.2.0.jar
metrics-jvm-4.2.0.jar
microsoft-catalog-metastore-client-1.0.63.jar
microsoft-log4j-etwappender-1.0.jar
microsoft-spark.jar
minlog-1.3.0.jar
mmlspark-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-cognitive-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-core-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-deep-learning-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-lightgbm-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-opencv-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-vw-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mssql-jdbc-8.4.1.jre8.jar
mysql-connector-java-8.0.18.jar
netty-all-4.1.68.Final.jar
notebook-utils-3.2.0-20220208.5.jar
objenesis-2.6.jar
onnxruntime_gpu-1.8.1.jar
opencsv-2.3.jar
opencv-3.2.0-1.jar
opentest4j-1.2.0.jar
orc-core-1.6.12.jar
orc-mapreduce-1.6.12.jar
orc-shims-1.6.12.jar
oro-2.0.8.jar
osgi-resource-locator-1.0.3.jar
paranamer-2.8.jar
parquet-column-1.12.2.jar
parquet-common-1.12.2.jar
parquet-encoding-1.12.2.jar
parquet-format-structures-1.12.2.jar
parquet-hadoop-1.12.2.jar
parquet-jackson-1.12.2.jar
peregrine-spark-0.10.jar
postgresql-42.2.9.jar
protobuf-java-2.5.0.jar
proton-j-0.33.8.jar
py4j-0.10.9.3.jar
pyrolite-4.30.jar
qpid-proton-j-extensions-1.2.4.jar
rapids-4-spark_2.12-22.02.0-SNAPSHOT.jar
rocksdbjni-6.20.3.jar
scala-collection-compat_2.12-2.1.1.jar
scala-compiler-2.12.15.jar
scala-java8-compat_2.12-0.9.0.jar
scala-library-2.12.15.jar
scala-parser-combinators_2.12-1.1.2.jar
scala-reflect-2.12.15.jar
scala-xml_2.12-1.2.0.jar
scalactic_2.12-3.0.5.jar
shapeless_2.12-2.3.3.jar
shims-0.9.0.jar
slf4j-api-1.7.30.jar
slf4j-log4j12-1.7.16.jar
snappy-java-1.1.8.4.jar
spark-3.2-rpc-history-server-app-listener_2.12-1.0.0.jar
spark-3.2-rpc-history-server-core_2.12-1.0.0.jar
spark-avro_2.12-3.2.1.5.0-57088972.jar
spark-catalyst_2.12-3.2.1.5.0-57088972.jar
spark-cdm-connector-assembly-1.19.2.jar
spark-core_2.12-3.2.1.5.0-57088972.jar
spark-enhancement_2.12-3.2.1.5.0-57088972.jar
spark-enhancementui_2.12-3.0.0.jar
spark-graphx_2.12-3.2.1.5.0-57088972.jar
spark-hadoop-cloud_2.12-3.2.1.5.0-57088972.jar
spark-hive-thriftserver_2.12-3.2.1.5.0-57088972.jar
spark-hive_2.12-3.2.1.5.0-57088972.jar
spark-kusto-synapse-connector_3.1_2.12-1.0.0.jar
spark-kvstore_2.12-3.2.1.5.0-57088972.jar
spark-launcher_2.12-3.2.1.5.0-57088972.jar
spark-microsoft-tools_2.12-3.2.1.5.0-57088972.jar
spark-mllib-local_2.12-3.2.1.5.0-57088972.jar
spark-mllib_2.12-3.2.1.5.0-57088972.jar
spark-mssql-connector-1.2.0.jar
spark-network-common_2.12-3.2.1.5.0-57088972.jar
spark-network-shuffle_2.12-3.2.1.5.0-57088972.jar
spark-repl_2.12-3.2.1.5.0-57088972.jar
spark-sketch_2.12-3.2.1.5.0-57088972.jar
spark-sql-kafka-0-10_2.12-3.2.1.5.0-57088972.jar
spark-sql_2.12-3.2.1.5.0-57088972.jar
spark-streaming-kafka-0-10-assembly_2.12-3.2.1.5.0-57088972.jar
spark-streaming-kafka-0-10_2.12-3.2.1.5.0-57088972.jar
spark-streaming_2.12-3.2.1.5.0-57088972.jar
spark-tags_2.12-3.2.1.5.0-57088972.jar
spark-token-provider-kafka-0-10_2.12-3.2.1.5.0-57088972.jar
spark-unsafe_2.12-3.2.1.5.0-57088972.jar
spark-yarn_2.12-3.2.1.5.0-57088972.jar
spark_diagnostic_cli-1.0.11_spark-3.2.0.jar
spire-macros_2.12-0.17.0.jar
spire-platform_2.12-0.17.0.jar
spire-util_2.12-0.17.0.jar
spire_2.12-0.17.0.jar
spray-json_2.12-1.3.2.jar
sqlanalyticsconnector_3.2.0-1.0.0.jar
stax-api-1.0.1.jar
stream-2.9.6.jar
structuredstreamforspark_2.12-3.0.1-2.1.3.jar
super-csv-2.2.0.jar
synapse-spark-telemetry_2.12-0.0.6.jar
synfs-3.2.0-20220208.5.jar
threeten-extra-1.5.0.jar
tink-1.6.0.jar
transaction-api-1.1.jar
univocity-parsers-2.9.1.jar
velocity-1.5.jar
vw-jni-8.9.1.jar
wildfly-openssl-1.0.7.Final.jar
xbean-asm9-shaded-4.20.jar
xz-1.8.jar
zookeeper-3.6.2.5.0-57088972.jar
zookeeper-jute-3.6.2.5.0-57088972.jar
zstd-jni-1.5.0-4.jar
Bibliotecas Python (VMs normais)
_libgcc_mutex=0,1
_openmp_mutex=4,5
_py-xgboost-mutex=2,0
Abapel-CPP=20210324.0
absl-py=0,13,0
Adal=1.2.7
ADLFs=0,7.7
aiohttp=3.7.4.post0
ALSA-LIB=1.2.3
appdirs=1.4.4
seta-cpp=3.0.0
astor=0,8,1
Astunparse=1.6.3
async-timeout=3.0.1
attrs=21.2.0
aws-c-cal=0.5.11
aws-c-comum=0.6.2
aws-c-event-stream=0.2.7
aws-c-io=0,10,5
aws-soma de verificação=0.1.11
aws-sdk-cpp=1.8.186
azure-datalake-store=0.0.51
azure-identity=2021.03.15b1
azure-storage-blob=12.8.1
chamada de retorno=0.2.0
backports=1,0
backports.functools_lru_cache=1.6.4
beautifulsoup4=4.9.3
blas=2,109
blas-devel=3.9.0=9_mkl
pisca-pisca=1,4
blosc=1,21,0
bokeh=2.3.2
Brotli=1,0,9
Brotli-bin=1.0.9
Brotli-python=1.0.9
brotlipia=0,7,0
Brunsli=0,1
bzip2 = 1,0,8
c-ares=1.17.1
CA-certificados=2021.7.5
cachetools=4.2.2
Cairo=1.16.0
certificado=2021.5.30
CFFI=1,14,5
chardet=4.0.0
charls=2.2.0
clique=8.0.1
Cloudpickle=1.6.0
conda=4,9,2
conda-embalagem-manuseamento=1.7.3
configparser=5.0.2
criptografia=3.4.7
cudatoolkit=11.1.1
ciclor=0,10,0
cython=0.29.23
cytoolz=0,11,0
traço=1.20.0
dash-core-componentes=1.16.0
traço-html-components=1.1.3
traço-renderer=1.9.1
tabela de traços=4.11.3
dash_cytoscape=0,2.0
dask-core=2021.6.2
databricks-cli=0.12.1
classes de dados=0,8
dbus=1.13.18
depuração=1.3.0
decorador=4.4.2
endro=0,3,4
pontos de entrada=0,3
et_xmlfile=1.1.0
expatriado=2.4.1
fogo=0,4,0
balão=2.0.1
frasco-compressa=1.10.1
fontconfig=2.13.1
Tipo Livre=2.10.4
fsspec=2021.6.1
futuro=0.18.2
gast=0,3.3
género=3.8.3
geográficoslib=1,52
geopy=2.1.0
gettext=0,21,0
gevent=21.1.2
gflags=2.2.2
giflib=5.2.1
gitdb=4,0,7
gitpython=3.1.18
glib=2,68,3
glib-tools=2.68.3
glog=0,5,0
gobject-introspecção=1.68.0
google-auth=1.32.1
google-auth-oauthlib=0.4.1
google-pasta=0.2.0
greenlet=1.1.0
grpc-cpp=1.37.1
grpcio=1.37.1
gst-plugins-base=1.18.4
gstreamer=1.18.4
h5py=2.10.0
hdf5=1.10.6
html5lib=1,1
beija-flor-ml=0,4.0
UCI=68,1
IDNA=2,10
imagecodecs=2021.3.31
imagem=2.9.0
importlib-metadata=4.6.1
intel-openmp=2021.2.0
interpretar=0.2.4
interpretar-core=0.2.4
ipykernel=6.0.1
IPypython=7.23.1
ipython_genutils=0,2.0
isodato=0,6.0
seuperigoso=2.0.1
JDCAL=1.4.1
Jedi=0,18,0
Jinja2=3.0.1
joblib=1,0.1
jpeg = 9d
jupyter_client=6.1.12
jupyter_core=4.7.1
jxrlib=1,1
keras-aplicações=1.0.8
keras-pré-processamento=1.1.2
keras2onnx=1.6.5
kiwisolver=1.3.1
coalas=1.8.0
krb5=1.19.1
LCMS2=2,12
ld_impl_linux-64=2.36.1
lerc=2.2.1
LIAC-ARFF=2.5.0
libaec=1,0.5
libblas=3.9.0=9_mkl
libbrotlicommon=1.0.9
libbrotlidec=1.0.9
libbrotlienc=1.0.9
libcblas=3.9.0=9_mkl
libclang=11.1.0
libcurl=7,77,0
libdeflate=1,7
libedit=3.1.20210216
libev=4,33
libevent=2.1.10
libffi=3,3
libgcc-ng=9.3.0
libgfortran-ng=9.3.0
libgfortran5=9.3.0
libglib=2,68,3
libiconv=1,16
liblapack=3.9.0=9_mkl
liblapacke=3.9.0=9_mkl
libllvm10=10.0.1
libllvm11=11.1.0
libnghttp2=1.43.0
libogg=1,3.5
libopus=1.3.1
libpng=1.6.37
libpq=13,3
libprotobuf=3.15.8
libssódico=1.0.18
libssh2=1.9.0
libstdcxx-ng=9.3.0
libtrifta=0,14.1
libtiff=4.2.0
libutf8proc=2.6.1
libuuid=2.32.1
libuv=1,41,1
libvorbis=1.3.7
libwebp-base=1.2.0
libxcb=1,14
libxgboost=1.4.0
libxkbcommon=1.0.3
libxml2=2.9.12
libzopfli=1,0.3
luzgbm=3.2.1
limão=0.2.0.1
llvm-openmp=11.1.0
llvmlite=0,36,0
locket=0.2.1
lz4-c=1.9.3
marcação=3.3.4
marcação=2.0.1
matplotlib=3.4.2
matplotlib-base=3.4.2
matplotlib-inline=0.1.2
mkl=2021.2.0
mkl-devel=2021.2.0
mkl-include=2021.2.0
mleap=0,17,0
mlflow-skinny=1.18.0
MSAL=2021.06.08
msal-extensões=2021.06.08
msrest=2021.06.01
multidito=5.1.0
mysql-common=8.0.25
mysql-libs=8.0.25
ncurses=6,2
redex=2.5.1
ninja=1.10.2
nltk=3.6.2
NSPR=4,30
NSS=3,67
numba=0,53,1
numpy=1.19.4
oauthlib=3.1.1
olefile=0,46
onnx=1,9,0
onnxconverter-common=1.7.0
onnxmltools=1.7.0
onnxruntime=1.7.2
openjpeg = 2.4.0
OpenpyXL=3.0.7
openssl=1.1.1k
opt_einsum=3.3.0
orc=1.6.7
embalagem=21,0
pandas=1.2.3
Parquet-CPP=1.5.1=1
parso=0,8.2
partd=1.2.0
patsy=0,5.1
PCRE=8,45
esperado=4.8.0
pickleshare=0,7,5
travesseiro=8.2.0
pip=21.1.1
pixman=0,40,0
Plotly=4.14.3
pmdarima=1.8.2
cão=1.4.0
portalocker=1.7.1
prompt-toolkit=3.0.19
protobuf=3.15.8
PSUTIL=5.8.0
ptyprocess=0.7.0
py-xgboost=1.4.0
PY4J=0,10,9
Piarrow=3.0.0
Piasn1=0,4.8
pyasn1-módulos=0.2.8
Picairo=1.20.1
Picosat=0,6.3
pycparser=2,20
Pigments=2.9.0
pygobject=3.40.1
pyjwt=2.1.0
pyodbc=4.0.30
pyopenssl=20.0.1
Pyparsing=2.4.7
pyqt=5.12.3
pyqt-impl=5.12.3
PYQT5-SIP=4.19.18
pyqtchart=5,12
pyqtwebengine=5.12.1
Pimeias=1.7.1
python=3.8.10
python-dateutil=2.8.1
python-flatbuffers=1,12
python_abi=3,8=2_cp38
pytorch=1.8.1.8_cuda11.1_cudnn8.0.5_0
pytz=2021.1
PYU2F=0.1.5
Piwavelets=1.1.1
pyyaml=5.4.1
pyzmq=22.1.0
qt=5,12,9
RE2=2021.04.01
linha de leitura=8,1
regex=2021.7.6
pedidos=2.25.1
pedidos-oauthlib=1.3.0
repetindo=1.3.3
RSA=4,7,2
ruamel_yaml=0.15.100
s2n=1.0.10
Salib=1.3.11
scikit-imagem=0.18.1
scikit-aprender=0.23.2
scipy=1.5.3
seaborn=0.11.1
base-marinha=0.11.1
setuptools=49.6.0
PASP=0,39,0
seis=1,16,0
skl2onnx=1.8.0.1
sklearn-pandas=2.2.0
segmentação de dados=0,0,7
smart_open=5.1.0
SMMAP=3,0,5
snappy=1.1.8
soupsieve=2.2.1
SQLITE=3.36.0
statsmodels=0.12.2
tabular=0,8,9
tenacidade=7.0.0
Tensorboard=2.4.1
tensorboard-plugin-wit=1.8.0
Tensorflow=2.4.1
tensorflow-base=2.4.1
tensorflow-estimator=2.4.0
termcolor=1.1.0
textblob=0.15.3
threadpoolctl=2.1.0
TIFFFILE=2021.4.8
tk=8,6,10
ferramentaz=0.11.1
tornado=6,1
tqdm=4,61,2
traços=5.0.5
tipo-extensões=3.10.0.0
typing_extensions=3.10.0.0
unixodbc=2.3.9
urllib3=1.26.4
wcwidth=0.2.5
webencodings=0.5.1
werkzeug=2,0.1
roda=0,36,2
wrapt=1.12.1
xgboost=1,4,0
xorg-kbproto=1.0.7
xorg-libice=1.0.10
xorg-libsm=1.2.3
xorg-libx11=1.7.2
XORG-libxext=1.3.4
xorg-libxrender=0.9.10
xorg-renderproto=0.11.1
xorg-xextproto=7.3.0
xorg-xproto=7.0.31
xz=5,2,5
yaml=0,2.5
yarl=1,6.3
zeromq=4.3.4
ZFP=0,5,5
zipp=3.5.0
zlib=1.2.11
zope.evento=4.5.0
zope.interface=5.4.0
zstd=1.4.9
ApplicationInsights==0.11.10
Argônio2-CFFI==21.3.0
argon2-cffi-bindings==21.2.0
Azure-Common==1.1.27
azure-core==1.16.0
Azure-graphrbac==0.61.1
azure-identity==1.4.1
azure-mgmt-authorization==0.61.0
azure-mgmt-containerregistry==8.0.0
azure-mgmt-core==1.3.0
azure-mgmt-keyvault==2.2.0
azure-mgmt-resource==13.0.0
azure-mgmt-storage==11.2.0
azureml-core==1.34.0
azureml-dataprep==2.22.2
azureml-dataprep-nativo==38.0.0
azureml-dataprep-rslex==1.20.2
azureml-dataset-runtime==1.34.0
Azureml-MLFLOW==1.34.0
azureml-opendatasets==1.34.0
telemetria azureml==1.34.0
backports-tempfile==1.0
backports-weakref==1.0.post1
lixívia==5.0.1
contextlib2==0.6.0.post1
defusedxml==0.7.1
distlib==0.3.6
Distro==1.7.0
Portuário==4.4.4
dotnetcore2==2.1.23
fastjsonschema==2.16.1
filelock==3.8.0
Fusível==3.0.1
importlib-resources==5.9.0
ipywidgets==7.6.3
Jeepney==0.6.0
jmespath==0.10.0
jsonpickle==2.0.0
jsonschema==4.15.0
Jupyterlab-pygments==0.2.2
jupyterlab-widgets==3.0.3
kqlmagiccustom==0.1.114.post8
LXML==4.6.5
Sintonização==2.0.4
msAL-extensões==0.2.2
msrestazure==0.6.4
mypy==0,780
Extensões mypy==0.4.3
nbclient==0.6.7
nbconvert==7.0.0
nbformat==5.4.0
ndg-httpsclient==0.5.1
nest-assincronia==1.5.5
Caderno==6.4.12
PandaSQL==0.7.3
PandocFilters==1.5.0
PathSpec==0.8.1
pkgutil-resolve-name==1.3.10
platformdirs==2.5.2
bonito==2.4.0
Prometheus-cliente==0.14.1
Pyperclip==1.8.2
pirsistent==0.18.1
Pyspark==3.2.1
ruamel-yaml==0.17.4
ruamel-yaml-clib==0.2.6
secretstorage==3.3.1
send2trash==1.8.0
SQLALCHEMY==1.4.20
terminado==0.15.0
tinycss2==1.1.1
Torchvision==0.9.1
Traços==5.3.0
digitado-ast==1.4.3
virtualenv==20.14.0
Websocket-cliente==1.1.0
widgetsnbextension==3.5.2
Bibliotecas Python (VMs aceleradas por GPU)
_libgcc_mutex=0,1
_openmp_mutex=4,5
_py-xgboost-mutex=2,0
_tflow_select=2.3.0
Abapel-CPP=20210324.1
absl-py=0,13,0
Adal=1.2.7
ADLFs=0,7.7
aiohttp=3.7.4.post0
appdirs=1.4.4
seta-cpp=3.0.0
astor=0,8,1
Astunparse=1.6.3
async-timeout=3.0.1
attrs=21.2.0
aws-c-cal=0.5.11
aws-c-comum=0.6.2
aws-c-event-stream=0.2.7
aws-c-io=0,10,5
aws-soma de verificação=0.1.11
aws-sdk-cpp=1.8.186
azure-datalake-store=0.0.51
azure-storage-blob=12.9.0
chamada de retorno=0.2.0
backports=1,0
backports.functools_lru_cache=1.6.4
beautifulsoup4=4.9.3
blas=2,111
blas-devel=3.9.0
pisca-pisca=1,4
bokeh=2.3.2
Brotli=1,0,9
Brotli-bin=1.0.9
Brotli-python=1.0.9
brotlipia=0,7,0
bzip2 = 1,0,8
C-ares=1.17.2
ca-certificados=2021.5.30
cachetools=4.2.2
Cairo=1.16.0
certificado=2021.5.30
CFFI=1.14.6
chardet=4.0.0
clique=8.0.1
colorama=0,4.4
conda=4,9,2
conda-embalagem-manuseamento=1.7.3
configparser=5.0.2
criptografia=3.4.7
cudatoolkit=11.1.1
ciclor=0,10,0
Cython=0.29.24
cytoolz=0,11,0
traço=1.21.0
dash-core-componentes=1.17.1
traço-html-components=1.1.4
traço-renderer=1.9.1
tabela-traço=4.12.0
dash_cytoscape=0,2.0
dask-core=2021.9.1
databricks-cli=0.12.1
classes de dados=0,8
dbus=1.13.18
depuração=1.4.1
decorador=5.1.0
endro=0,3,4
pontos de entrada=0,3
et_xmlfile=1.0.1001
expatriado=2.4.1
ffmpeg=4,3
fogo=0,4,0
balão=2.0.1
frasco-compressa=1.10.1
fontconfig=2.13.1
Tipo Livre=2.10.4
fsspec=2021.8.1
futuro=0.18.2
g-ir-build-tools=1.68.0
g-ir-host-tools=1.68.0
género=3.8.3
geográficoslib=1,52
geopy=2.1.0
gettext=0.19.8.1
gevent=21.8.0
gflags=2.2.2
gitdb=4,0,7
gitpython=3.1.23
glib=2,68,4
glib-tools=2.68.4
glog=0,5,0
BPF=6.2.1
gnutls=3.6.13
gobject-introspecção=1.68.0
google-auth=1.35.0
google-auth-oauthlib=0.4.6
google-pasta=0.2.0
greenlet=1.1.1
grpc-cpp=1.37.1
gst-plugins-base=1.14.0
gstreamer=1.14.0
h5py=2.10.0
hdf5=1.10.6
html5lib=1,1
beija-flor-ml=0,4.0
UCI=58,2
IDNA=2,10
imagecodecs-lite=2019.12.3
imagem=2.9.0
importlib-metadata=4.8.1
interpretar=0.2.4
interpretar-core=0.2.4
ipykernel=6.4.1
IPypython=7.23.1
ipython_genutils=0,2.0
isodato=0,6.0
seuperigoso=2.0.1
JDCAL=1.4.1
Jedi=0,18,0
Jinja2=3.0.1
joblib=1,0.1
JPEG=9B
jupyter_client=7.0.3
jupyter_core=4.8.1
Keras=2,4.3
keras-aplicações=1.0.8
keras-pré-processamento=1.1.2
keras2onnx=1.6.5
kiwisolver=1.3.2
coalas=1.8.0
krb5=1.19.2
coxo=3,100
ld_impl_linux-64=2.36.1
LIAC-ARFF=2.5.0
libblas=3.9.0
libbrotlicommon=1.0.9
libbrotlidec=1.0.9
libbrotlienc=1.0.9
libcblas=3.9.0
libcurl=7.79.1
libedit=3.1.20191231
libev=4,33
libevent=2.1.10
libffi=3.4.2
libgcc-ng=11.2.0
libgfortran-ng=11.2.0
libgfortran5=11.2.0
libgirepository=1.68.0
libglib=2,68,4
libiconv=1,16
liblapack=3.9.0
liblapacke=3.9.0
libllvm11=11.1.0
libnghttp2=1.43.0
libpng=1.6.37
libprotobuf=3.16.0
libssódico=1.0.18
libssh2=1.10.0
libstdcxx-ng=11.2.0
libtrifta=0,14.1
libtiff=4.2.0
libutf8proc=2.6.1
libuuid=2.32.1
libuv=1,42,0
libwebp-base=1.2.1
libxcb=1,13
libxgboost=1.4.0
libxml2 = 2.9.9
luzgbm=3.2.1
limão=0.2.0.1
llvm-openmp=12.0.1
llvmlite=0,37,0
locket=0,2.0
lz4-c=1.9.3
marcação=3.3.4
marcação=2.0.1
matplotlib=3.4.2
matplotlib-base=3.4.2
matplotlib-inline=0.1.3
mkl=2021.3.0
mkl-devel=2021.3.0
mkl-include=2021.3.0
mleap=0,17,0
mlflow-skinny=1.18.0
MSAL=2021.09.01
MSREST=2021.09.01
multidito=5.1.0
multiprocesso=0.70.12.2
ncurses=6,2
nest-assincronia=1.5.1
urtiga=3,6
redex=2,5
ninja=1.10.2
nltk=3.6.2
numba=0,54,0
numpy=1.19.4
oauthlib=3.1.1
olefile=0,46
onnx=1,9,0
onnxconverter-common=1.7.0
onnxmltools=1.7.0
onnxruntime=1.7.2
OpenH264=2.1.1
OpenpyXL=3.0.7
openssl=1.1.1l
opt_einsum=3.3.0
orc=1.6.7
embalagem=21,0
pandas=1.2.3
Parquet-CPP=1.5.1
parso=0,8.2
partd=1.2.0
pato=0,2.8
patsy=0,5.1
PCRE=8,45
esperado=4.8.0
pickleshare=0,7.5003
travesseiro=7.1.2
pip=21.1.1
pixman=0,38,0
pkg-config=0.29.2
Plotly=4.14.3
pmdarima=1.8.2
cão=1.5.1
portalocker=1.7.1
varíola=0,3,0
ppft=1.6.6.4
prompt-toolkit=3.0.20
Protobuf=3.16.0
PSUTIL=5.8.0
pthread-stubs=0,4
ptyprocess=0.7.0
py-xgboost=1.4.0
PY4J=0,10,9
Piarrow=3.0.0
Piasn1=0,4.8
pyasn1-módulos=0.2.7
Picairo=1.20.1
Picosat=0,6.3
pycparser=2,20
pydeprecate=0,3.1
Pigments=2.10.0
pygobject=3.40.1
pyjwt=2.1.0
pyodbc=4.0.30
pyopenssl=20.0.1
Pyparsing=2.4.7
pyqt=5.9.2
Pimeias=1.7.1
Pyspark=3.1.2
python=3.8.12
python-dateutil=2.8.2
python_abi=3,8
Pitorcha=1.8.1
Pitocha-relâmpago=1.4.2
pytz=2021.1
PYU2F=0.1.5
Piwavelets=1.1.1
pyyaml=5.4.1
pyzmq=22.3.0
qt=5,9,7
RE2=2021.04.01
linha de leitura=8,1
regex=2021.8.28
pedidos=2.25.1
pedidos-oauthlib=1.3.0
repetindo=1.3.3
RSA=4,7,2
ruamel_yaml=0.15.80
s2n=1.0.10
Salib=1,4,5
scikit-imagem=0.18.1
scikit-aprender=0.23.2
scipy=1.7.1
seaborn=0.11.1
base-marinha=0.11.1
setuptools=49.6.0
PASP=0,39,0
SIP=4.19.13
skl2onnx=1.8.0.1
sklearn-pandas=2.2.0
segmentação de dados=0,0,7
smart_open=5.2.1
SMMAP=3,0,5
snappy=1.1.8
Soupsieve=2.0.1
SQLITE=3.36.0
statsmodels=0.12.2
tabular=0,8,9
TBB=2021.3.0
tenacidade=8.0.1
Tensorboard=2.6.0
tensorboard-data-server=0.6.0
tensorboard-plugin-wit=1.8.0
Tensorflow=2.4.1
tensorflow-base=2.4.1
termcolor=1.1.0
textblob=0.15.3
threadpoolctl=2.2.0
TIFFFILE=2020.6.3
tk=8,6,11
ferramentaz=0.11.1
tocha=0.8.1
Torchmetrics=0.5.1
Torchvision=0.9.1
tornado=6,1
tqdm=4,62,3
traços=5.1.0
unixodbc=2.3.9
urllib3=1.26.4
wcwidth=0.2.5
webencodings=0.5.1
werkzeug=2,0.1
roda=0,37,0
wrapt=1.12.1
xgboost=1,4,0
xorg-kbproto=1.0.7
xorg-libice=1.0.10
xorg-libsm=1.2.3
xorg-libx11=1.7.2
xorg-libxau=1.0.9
xorg-libxdmcp=1.1.3
XORG-libxext=1.3.4
xorg-libxrender=0.9.10
xorg-renderproto=0.11.1
xorg-xextproto=7.3.0
xorg-xproto=7.0.31
xz=5,2,5
yaml=0,2.5
yarl=1,6.3
zeromq=4.3.4
zipp=3.5.0
zlib=1.2.11
zope.evento=4.5.0
zope.interface=5.4.0
zstd=1.4.9
ApplicationInsights==0.11.10
Argon2-CFFI==21.1.0
Azure-Common==1.1.27
azure-core==1.18.0
Azure-graphrbac==0.61.1
azure-identity==1.4.1
azure-mgmt-authorization==0.61.0
azure-mgmt-containerregistry==8.1.0
azure-mgmt-core==1.3.0
azure-mgmt-keyvault==9.1.0
azure-mgmt-resource==13.0.0
azure-mgmt-storage==11.2.0
azureml-core==1.34.0
azureml-dataprep==2.22.2
azureml-dataprep-nativo==38.0.0
azureml-dataprep-rslex==1.20.2
azureml-dataset-runtime==1.34.0
Azureml-MLFLOW==1.34.0
azureml-opendatasets==1.34.0
telemetria azureml==1.34.0
backports-tempfile==1.0
backports-weakref==1.0.post1
lixívia==4.1.0
Cloudpickle==1.6.0
contextlib2==21.6.0
defusedxml==0.7.1
Diskcache==5.2.1
Distro==1.6.0
Portuário==5.0.2
dotnetcore2==2.1.21
flatbuffers==1.12
Fusível==3.0.1
gast==0.3.3
GRPCIO==1.32.0
ipywidgets==7.6.5
Jeepney==0.7.1
jmespath==0.10.0
jsonpickle==2.0.0
jsonschema==4.1.2
Jupyterlab-pygments==0.1.2
jupyterlab-widgets==1.0.2
kqlmagiccustom==0.1.114.post8
lxml==4.7.1
Sintonia==0.8.4
msAL-extensões==0.2.2
msrestazure==0.6.4
mypy==0,780
Extensões mypy==0.4.3
nbclient==0.5.4
nbconvert==6.2.0
nbformat==5.1.3
ndg-httpsclient==0.5.1
Caderno==6.4.5
OpenCV-Python==4.5.3.56
PandaSQL==0.7.3
PandocFilters==1.5.0
PathSpec==0.9.0
Petastorm==0.11.3
bonito==3.0.0
Prometheus-cliente==0.12.0
Pyperclip==1.8.2
Pyrsistent==0.18.0
ruamel-yaml==0.17.4
ruamel-yaml-clib==0.2.6
secretstorage==3.3.1
send2trash==1.8.0
Seis==1.15.0
SQLALCHEMY==1.4.25
tensorfluxo-estimador==2.4.0
TensorFlow-GPU==2.4.1
terminado==0.12.1
TestPath==0.5.0
digitado-ast==1.4.3
tipo-extensões==3.7.4.3
Websocket-cliente==1.2.1
widgetsnbextension==3.5.2
Bibliotecas R (Pré-visualização)
| Biblioteca | Versão | Biblioteca | Versão | Biblioteca | Versão |
|---|---|---|---|---|---|
| AskPass | 1.1 | Carta Alta | 0.9.4 | Leitor | 2.1.3 |
| asserçãoat | 0.2.1 | mais alto | 0,9 | ReadXL | 1.4.1 |
| backports | 1.4.1 | HMS | 1.1.2 | receitas | 1.0.3 |
| base64enc | 0.1-3 | htmltools | 0.5.3 | revanche | 1.0.1 |
| bit | 4.0.5 | htmlwidgets | 1.5.4 | revanche2 | 2.1.2 |
| bit64 | 4.0.5 | Código http | 0.3.0 | Controles remotos | 2.4.2 |
| blob | 1.2.3 | httpuv | 1.6.6 | Reprex | 2.0.2 |
| brew | 1.0-8 | httr | 1.4.4 | remodelar2 | 1.4.4 |
| Brio | 1.1.3 | IDs | 1.0.1 | RJSON | 0.2.21 |
| vassoura | 1.0.1 | Gráfico | 1.3.5 | rlang | 1.0.6 |
| BSLIB | 0.4.1 | inferir | 1.0.3 | rlist | 0.4.6.2 |
| cachem | 1.0.6 | ini | 0.3.1 | rmarkdown | 2.18 |
| Chamador | 3.7.3 | ipred | 0.9-13 | RODBC | 1.3-19 |
| acento circunflexo | 6.0-93 | Isoband | 0.2.6 | roxygen2 | 7.2.2 |
| Cellranger | 1.1.0 | iteradores | 1.0.14 | rprojroot | 2.0.3 |
| cli | 3.4.1 | jquerylib | 0.1.4 | amostra rsample | 1.1.0 |
| Clipr | 0.8.0 | jsonlite | 1.8.3 | rstudioapi | 0.14 |
| relógio | 0.6.1 | Knitr | 1.41 | rversões | 2.1.2 |
| espaço em cores | 2.0-3 | etiquetagem | 0.4.2 | Rvest | 1.0.3 |
| marca comum | 1.8.1 | mais tarde | 1.3.0 | Sass | 0.4.4 |
| configuração | 0.3.1 | lava | 1.7.0 | escalas | 1.2.1 |
| conflituosos | 1.1.0 | lazyeval | 0.2.2 | seletor | 0.4-2 |
| coro | | 1.0.3 | LHS | 1.1.5 | sessioninfo | 1.2.2 |
| CPP11 | 0.4.3 | ciclo de vida | 1.0.3 | brilhante | 1.7.3 |
| lápis de cor | 1.5.2 | LightGBM | 3.3.3 | controle deslizante | 0.3.0 |
| credenciais | 1.3.2 | ouvirv | 0.8.0 | ferramentas de origem | 0.1.7 |
| conversa cruzada | 1.2.0 | Lobstr | 1.1.2 | sparklyr | 1.7.8 |
| Crul | 1.3 | lubridate | 1.9.0 | QUADRADO | 2021.1 |
| curl | 4.3.3 | magrittr | 2.0.3 | stringi | 1.7.8 |
| data.table | 1.14.6 | mapas | 3.4.1 | stringr | 1.4.1 |
| DBI | 1.1.3 | memoise | 2.0.1 | sys | 3.4.1 |
| DBPlyr | 2.2.1 | mime | 0,12 | fontes do sistema | 1.0.4 |
| desc | 1.4.2 | miniUI | 0.1.1.1 | testeatat | 3.1.5 |
| devtools | 2.4.5 | dados de modelo | 1.0.1 | formatação de texto | 0.3.6 |
| mostradores | 1.1.0 | Modelenv | 0.1.0 | tibble | 3.1.8 |
| DiceDesign | 1.9 | ModelMetrics | 1.2.2.2 | modelos arrumados | 1.0.0 |
| diffobj | 0.3.5 | Modelador | 0.1.10 | tidyr | 1.2.1 |
| resumo | 0.6.30 | munsell | 0.5.0 | tidyselect | 1.2.0 |
| Iluminação reduzida | 0.4.2 | numDeriv | 2016.8-1.1 | Tidyverse | 1.3.2 |
| dplyr | 1.0.10 | openssl | 2.0.4 | mudança de hora | 0.1.1 |
| DTPlyr | 1.2.2 | Paralelamente | 1.32.1 | timeDate | 4021.106 |
| E1071 | 1.7-12 | Parsnip | 1.0.3 | Tinytex | 0.42 |
| ellipsis | 0.3.2 | colcha de retalhos | 1.1.2 | tocha | 0.9.0 |
| evaluate | 0,18 | pilar | 1.8.1 | barba tripla | 0.3.0 |
| Fãsi | 1.0.3 | pkgbuild | 1.4.0 | TTR | 0.24.3 |
| Farver | 2.1.1 | pkgconfig | 2.0.3 | Sintonizar | 1.0.1 |
| mapa rápido | 1.1.0 | pkgdown | 2.0.6 | TZDB | 0.3.0 |
| fontawesome | 0.4.0 | pkgload | 1.3.2 | urlchecker | 1.0.1 |
| FORCATS | 0.5.2 | enredo | 4.10.1 | urltools | 1.7.3 |
| foreach | 1.5.2 | plyr | 1.8.8 | usethis | 2.1.6 |
| forjar | 0.2.0 | elogiar | 1.0.0 | UTF8 | 1.2.2 |
| FS | 1.5.2 | unidades bonitas | 1.1.1 | uuid | 1.1-0 |
| furrr | 0.3.1 | pROC | 1.18.0 | VCTRS | 0.5.1 |
| Futuro | 1.29.0 | processx | 3.8.0 | viridisLite | 0.4.1 |
| future.apply | 1.10.0 | prodlim | 2019.11.13 | vroom | 1.6.0 |
| gargarejo | 1.2.1 | Profvis | 0.3.7 | Waldo | 0.4.0 |
| Genéricos | 0.1.3 | Progresso | 1.2.2 | urdidura | 0.2.0 |
| Gert | 1.9.1 | progressor | 0.11.0 | whisker | 0.4 |
| ggplot2 | 3.4.0 | promessas | 1.2.0.1 | withr | 2.5.0 |
| GH | 1.3.1 | procuração | 0.4-27 | fluxos de trabalho | 1.1.2 |
| GISTR | 0.9.0 | Pryr | 0.1.5 | conjuntos de fluxos de trabalho | 1.0.0 |
| gitcreds | 0.1.2 | PS | 1.7.2 | xfun | 0,35 |
| Globais | 0.16.2 | purrr | 0.3.5 | xgboost | 1.6.0.1 |
| colar | 1.6.2 | Quantmod | 0.4.20 | XML | 3.99-0.12 |
| GoogleDrive | 2.0.0 | r2d3 | 0.2.6 | xml2 | 1.3.3 |
| googlesheets4 | 1.0.1 | R6 | 2.5.1 | xopen | 1.0.0 |
| gower | 1.0.0 | RAGG | 1.2.4 | xtable | 1.8-4 |
| GPfit | 1.0-8 | rappdirs | 0.3.3 | XTS | 0.12.2 |
| gtable | 0.3.1 | Rbokeh | 0.5.2 | yaml | 2.3.6 |
| capacete | 1.2.0 | rcmdcheck | 1.4.0 | Critério | 1.1.0 |
| Refúgio | 2.5.1 | RColorBrewer | 1.1-3 | zip | 2.2.2 |
| Hexbin | 1.28.2 | Rcpp | 1.0.9 | Jardim zoológico | 1.8-11 |
Próximos passos
Migração entre versões do Apache Spark - suporte
Para obter orientação sobre como migrar de versões de tempo de execução mais antigas para o Azure Synapse Runtime for Apache Spark 3.3 ou 3.4, consulte Visão geral do Runtime for Apache Spark.