Azure Synapse Runtime for Apache Spark 3.2 (A támogatás megszűnése bejelentett)
Az Azure Synapse Analytics több futtatókörnyezetet is támogat az Apache Sparkhoz. Ez a dokumentum az Apache Spark 3.2-hez készült Azure Synapse Runtime futtatókörnyezeti összetevőit és verzióit ismerteti.
Fontos
- Az Apache Spark 3.2-hez készült Azure Synapse Runtime támogatásának megszűnését 2023. július 8-án jelentették be.
- A támogatás megszűnéséről bejelentett futtatókörnyezetben nem lesznek hiba- és funkciójavítások. A biztonsági javítások a kockázatértékelés alapján kerülnek visszaportolásra.
- Az Apache Spark életciklus-szabályzatához tartozó Synapse-futtatókörnyezettel összhangban az Apache Spark 3.2-hez készült Azure Synapse-futtatókörnyezet 2024. július 8-tól megszűnik és le lesz tiltva. A támogatás megszűnésének dátuma után a kivont futtatókörnyezetek nem érhetők el az új Spark-készletekhez, és a meglévő munkafolyamatok nem hajthatók végre. A metaadatok ideiglenesen a Synapse-munkaterületen maradnak.
- Határozottan javasoljuk, hogy 2024. július 8-a előtt frissítse Az Apache Spark 3.2 számítási feladatait az Azure Synapse Runtime for Apache Spark 3.4 -re (GA ).
Összetevők verziói
| Összetevő | Verzió |
|---|---|
| Apache Spark | 3.2.1 |
| Operációs rendszer | Ubuntu 18.04 |
| Java | 1.8.0_282 |
| Scala | 2.12.15 |
| Hadoop | 3.3.1 |
| .NET Core | 3.1 |
| .NET | 2.0.0 |
| Delta Lake | 1,2 |
| Python | 3,8 |
| R (előzetes verzió) | 4.2 |
Synapse-Python38-CPU.yml tartalmazza az Azure Synapse Spark alapértelmezett Python 3.8-környezetében szállított kódtárak listáját.
Scala- és Java-kódtárak
HikariCP-2.5.1.jar
JLargeArrays-1.5.jar
JTransforms-3.1.jar
RoaringBitmap-0.9.0.jar
ST4-4.0.4.jar
SparkCustomEvents-3.2.0-1.0.0.jar
TokenLibrary-assembly-3.0.0.jar
Vegas Csatlakozás or-1.1.01_2.12_3.2.0-SNAPSHOT.jar
activation-1.1.1.jar
adal4j-1.6.3.jar
aircompressor-0.21.jar
algebra_2.12-2.0.1.jar
aliyun-java-sdk-core-3.4.0.jar
aliyun-java-sdk-ecs-4.2.0.jar
aliyun-java-sdk-ram-3.0.0.jar
aliyun-java-sdk-sts-3.0.0.jar
aliyun-sdk-oss-3.4.1.jar
annotations-17.0.0.jar
antlr-runtime-3.5.2.jar
antlr4-runtime-4.8.jar
aopalliance-repackaged-2.6.1.jar
apache-log4j-extras-1.2.17.jar
apiguardian-api-1.1.0.jar
arpack-2.2.1.jar
arpack_combined_all-0.1.jar
arrow-format-2.0.0.jar
arrow-memory-core-2.0.0.jar
arrow-memory-netty-2.0.0.jar
arrow-vector-2.0.0.jar
audience-annotations-0.5.0.jar
avro-1.10.2.jar
avro-ipc-1.10.2.jar
avro-mapred-1.10.2.jar
aws-java-sdk-bundle-1.11.901.jar
azure-data-lake-store-sdk-2.3.6.jar
azure-eventhubs-3.3.0.jar
azure-eventhubs-spark_2.12-2.3.21.jar
azure-keyvault-core-1.0.0.jar
azure-storage-7.0.1.jar
azure-synapse-ml-pandas_2.12-1.0.0.jar
azure-synapse-ml-predict_2.12-1.0.jar
blas-2.2.1.jar
bonecp-0.8.0.RELEA Standard kiadás.jar
breeze-macros_2.12-1.2.jar
breeze_2.12-1.2.jar
cats-kernel_2.12-2.1.1.jar
chill-java-0.10.0.jar
chill_2.12-0.10.0.jar
client-sdk-1.14.0.jar
cntk-2.4.jar
commons-cli-1.2.jar
commons-codec-1.15.jar
commons-collections-3.2.2.jar
commons-compiler-3.0.16.jar
commons-compress-1.21.jar
commons-crypto-1.1.0.jar
commons-dbcp-1.4.jar
commons-io-2.8.0.jar
commons-lang-2.6.jar
commons-lang3-3.12.0.jar
commons-logging-1.1.3.jar
commons-math3-3.4.1.jar
commons-net-3.1.jar
commons-pool-1.5.4.jar
commons-pool2-2.6.2.jar
commons-text-1.6.jar
compress-lzf-1.0.3.jar
config-1.3.4.jar
core-1.1.2.jar
cos_api-bundle-5.6.19.jar
cosmos-analytics-spark-3.2.1-connector-1.6.0.jar
cudf-22.02.0-cuda11.jar
curator-client-2.13.0.jar
curator-framework-2.13.0.jar
curator-recipes-2.13.0.jar
datanucleus-api-jdo-4.2.4.jar
datanucleus-core-4.1.17.jar
datanucleus-rdbms-4.1.19.jar
delta-core_2.12-1.2.1.2.jar
derby-10.14.2.0.jar
dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar
flatbuffers-java-1.9.0.jar
fluent-logger-jar-with-dependencies-jdk8.jar
gson-2.8.6.jar
guava-14.0.1.jar
hadoop-aliyun-3.3.1.5.0-57088972.jar
hadoop-annotations-3.3.1.5.0-57088972.jar
hadoop-aws-3.3.1.5.0-57088972.jar
hadoop-azure-3.3.1.5.0-57088972.jar
hadoop-azure-datalake-3.3.1.5.0-57088972.jar
hadoop-client-api-3.3.1.5.0-57088972.jar
hadoop-client-runtime-3.3.1.5.0-57088972.jar
hadoop-cloud-storage-3.3.1.5.0-57088972.jar
hadoop-cos-3.3.1.5.0-57088972.jar
hadoop-openstack-3.3.1.5.0-57088972.jar
hadoop-shaded-guava-1.1.0.jar
hadoop-yarn-server-web-proxy-3.3.1.5.0-57088972.jar
hdinsight-spark-metrics-3.2.0-1.0.0.jar
hive-beeline-2.3.9.jar
hive-cli-2.3.9.jar
hive-common-2.3.9.jar
hive-exec-2.3.9-core.jar
hive-jdbc-2.3.9.jar
hive-llap-common-2.3.9.jar
hive-metastore-2.3.9.jar
hive-serde-2.3.9.jar
hive-service-rpc-3.1.2.jar
hive-shims-0.23-2.3.9.jar
hive-shims-2.3.9.jar
hive-shims-common-2.3.9.jar
hive-shims-scheduler-2.3.9.jar
hive-storage-api-2.7.2.jar
hive-vector-code-gen-2.3.9.jar
hk2-api-2.6.1.jar
hk2-locator-2.6.1.jar
hk2-utils-2.6.1.jar
htrace-core4-4.1.0-incubating.jar
httpclient-4.5.13.jar
httpclient-4.5.6.jar
httpcore-4.4.14.jar
httpmime-4.5.13.jar
httpmime-4.5.6.jar
hyperspace-core-spark3.2_2.12-0.5.1-synapse.jar
impulse-core_spark3.2_2.12-0.1.8.jar
impulse-telemetry-mds_spark3.2_2.12-0.1.8.jar
isolation-forest_3.2.0_2.12-2.0.8.jar
istack-commons-runtime-3.0.8.jar
ivy-2.5.0.jar
jackson-annotations-2.12.3.jar
jackson-core-2.12.3.jar
jackson-core-asl-1.9.13.jar
jackson-databind-2.12.3.jar
jackson-dataformat-cbor-2.12.3.jar
jackson-mapper-asl-1.9.13.jar
jackson-module-scala_2.12-2.12.3.jar
jakarta.annotation-api-1.3.5.jar
jakarta.inject-2.6.1.jar
jakarta.servlet-api-4.0.3.jar
jakarta.validation-api-2.0.2.jar
jakarta.ws.rs-api-2.1.6.jar
jakarta.xml.bind-api-2.3.2.jar
janino-3.0.16.jar
javassist-3.25.0-GA.jar
javatuples-1.2.jar
javax.jdo-3.2.0-m3.jar
javolution-5.5.1.jar
jaxb-api-2.2.11.jar
jaxb-runtime-2.3.2.jar
jcl-over-slf4j-1.7.30.jar
jdo-api-3.0.1.jar
jdom-1.1.jar
jersey-client-2.34.jar
jersey-common-2.34.jar
jersey-container-servlet-2.34.jar
jersey-container-servlet-core-2.34.jar
jersey-hk2-2.34.jar
jersey-server-2.34.jar
jettison-1.1.jar
jetty-util-9.4.43.v20210629.jar
jetty-util-ajax-9.4.43.v20210629.jar
jline-2.14.6.jar
joda-time-2.10.10.jar
jodd-core-3.5.2.jar
jpam-1.1.jar
jsch-0.1.54.jar
json-1.8.jar
json-20090211.jar
json-20210307.jar
json-simple-1.1.jar
json4s-ast_2.12-3.7.0-M11.jar
json4s-core_2.12-3.7.0-M11.jar
json4s-jackson_2.12-3.7.0-M11.jar
json4s-scalap_2.12-3.7.0-M11.jar
jsr305-3.0.0.jar
jta-1.1.jar
jul-to-slf4j-1.7.30.jar
junit-jupiter-5.5.2.jar
junit-jupiter-api-5.5.2.jar
junit-jupiter-engine-5.5.2.jar
junit-jupiter-params-5.5.2.jar
junit-platform-commons-1.5.2.jar
junit-platform-engine-1.5.2.jar
kafka-clients-2.8.0.jar
kryo-shaded-4.0.2.jar
kusto-data-2.7.0.jar
kusto-ingest-2.7.0.jar
kusto-spark_3.0_2.12-2.7.5.jar
lapack-2.2.1.jar
leveldbjni-all-1.8.jar
libfb303-0.9.3.jar
libshufflejni.so
libthrift-0.12.0.jar
libvegasjni.so
lightgbmlib-3.2.110.jar
log4j-1.2.17.jar
lz4-java-1.7.1.jar
macro-compat_2.12-1.1.1.jar
mdsdclientdynamic-2.0.jar
metrics-core-4.2.0.jar
metrics-graphite-4.2.0.jar
metrics-jmx-4.2.0.jar
metrics-json-4.2.0.jar
metrics-jvm-4.2.0.jar
microsoft-catalog-metastore-client-1.0.63.jar
microsoft-log4j-etwappender-1.0.jar
microsoft-spark.jar
minlog-1.3.0.jar
mmlspark-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-cognitive-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-core-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-deep-learning-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-lightgbm-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-opencv-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mmlspark-vw-1.0.0-rc3-194-14bef9b1-SNAPSHOT.jar
mssql-jdbc-8.4.1.jre8.jar
mysql-connector-java-8.0.18.jar
netty-all-4.1.68.Final.jar
notebook-utils-3.2.0-20220208.5.jar
objenesis-2.6.jar
onnxruntime_gpu-1.8.1.jar
opencsv-2.3.jar
opencv-3.2.0-1.jar
opentest4j-1.2.0.jar
orc-core-1.6.12.jar
orc-mapreduce-1.6.12.jar
orc-shims-1.6.12.jar
oro-2.0.8.jar
osgi-resource-locator-1.0.3.jar
paranamer-2.8.jar
parquet-column-1.12.2.jar
parquet-common-1.12.2.jar
parquet-encoding-1.12.2.jar
parquet-format-structures-1.12.2.jar
parquet-hadoop-1.12.2.jar
parquet-jackson-1.12.2.jar
peregrine-spark-0.10.jar
postgresql-42.2.9.jar
protobuf-java-2.5.0.jar
proton-j-0.33.8.jar
py4j-0.10.9.3.jar
pyrolite-4.30.jar
qpid-proton-j-extensions-1.2.4.jar
rapids-4-spark_2.12-22.02.0-SNAPSHOT.jar
rocksdbjni-6.20.3.jar
scala-collection-compat_2.12-2.1.1.jar
scala-compiler-2.12.15.jar
scala-java8-compat_2.12-0.9.0.jar
scala-library-2.12.15.jar
scala-parser-combinators_2.12-1.1.2.jar
scala-reflect-2.12.15.jar
scala-xml_2.12-1.2.0.jar
scalactic_2.12-3.0.5.jar
shapeless_2.12-2.3.3.jar
shims-0.9.0.jar
slf4j-api-1.7.30.jar
slf4j-log4j12-1.7.16.jar
snappy-java-1.1.8.4.jar
spark-3.2-rpc-history-server-app-listener_2.12-1.0.0.jar
spark-3.2-rpc-history-server-core_2.12-1.0.0.jar
spark-avro_2.12-3.2.1.5.0-57088972.jar
spark-catalyst_2.12-3.2.1.5.0-57088972.jar
spark-cdm-connector-assembly-1.19.2.jar
spark-core_2.12-3.2.1.5.0-57088972.jar
spark-enhancement_2.12-3.2.1.5.0-57088972.jar
spark-enhancementui_2.12-3.0.0.jar
spark-graphx_2.12-3.2.1.5.0-57088972.jar
spark-hadoop-cloud_2.12-3.2.1.5.0-57088972.jar
spark-hive-thriftserver_2.12-3.2.1.5.0-57088972.jar
spark-hive_2.12-3.2.1.5.0-57088972.jar
spark-kusto-synapse-connector_3.1_2.12-1.0.0.jar
spark-kvstore_2.12-3.2.1.5.0-57088972.jar
spark-launcher_2.12-3.2.1.5.0-57088972.jar
spark-microsoft-tools_2.12-3.2.1.5.0-57088972.jar
spark-mllib-local_2.12-3.2.1.5.0-57088972.jar
spark-mllib_2.12-3.2.1.5.0-57088972.jar
spark-mssql-connector-1.2.0.jar
spark-network-common_2.12-3.2.1.5.0-57088972.jar
spark-network-shuffle_2.12-3.2.1.5.0-57088972.jar
spark-repl_2.12-3.2.1.5.0-57088972.jar
spark-sketch_2.12-3.2.1.5.0-57088972.jar
spark-sql-kafka-0-10_2.12-3.2.1.5.0-57088972.jar
spark-sql_2.12-3.2.1.5.0-57088972.jar
spark-streaming-kafka-0-10-assembly_2.12-3.2.1.5.0-57088972.jar
spark-streaming-kafka-0-10_2.12-3.2.1.5.0-57088972.jar
spark-streaming_2.12-3.2.1.5.0-57088972.jar
spark-tags_2.12-3.2.1.5.0-57088972.jar
spark-token-provider-kafka-0-10_2.12-3.2.1.5.0-57088972.jar
spark-unsafe_2.12-3.2.1.5.0-57088972.jar
spark-yarn_2.12-3.2.1.5.0-57088972.jar
spark_diagnostic_cli-1.0.11_spark-3.2.0.jar
spire-macros_2.12-0.17.0.jar
spire-platform_2.12-0.17.0.jar
spire-util_2.12-0.17.0.jar
spire_2.12-0.17.0.jar
spray-json_2.12-1.3.2.jar
sqlanalyticsconnector_3.2.0-1.0.0.jar
stax-api-1.0.1.jar
stream-2.9.6.jar
structuredstreamforspark_2.12-3.0.1-2.1.3.jar
super-csv-2.2.0.jar
synapse-spark-telemetry_2.12-0.0.6.jar
synfs-3.2.0-20220208.5.jar
threeten-extra-1.5.0.jar
tink-1.6.0.jar
transaction-api-1.1.jar
univocity-parsers-2.9.1.jar
velocity-1.5.jar
vw-jni-8.9.1.jar
wildfly-openssl-1.0.7.Final.jar
xbean-asm9-shaded-4.20.jar
xz-1.8.jar
zookeeper-3.6.2.5.0-57088972.jar
zookeeper-jute-3.6.2.5.0-57088972.jar
zstd-jni-1.5.0-4.jar
Python-kódtárak (normál virtuális gépek)
_libgcc_mutex=0,1
_openmp_mutex=4,5
_py-xgboost-mutex=2,0
abseil-cpp=20210324.0
absl-py=0.13.0
adal=1.2.7
adlfs=0.7.7
aiohttp=3.7.4.post0
alsa-lib=1.2.3
appdirs=1.4.4
nyíl-cpp=3.0.0
astor=0.8.1
astunparse=1.6.3
async-timeout=3.0.1
attrs=21.2.0
aws-c-cal=0.5.11
aws-c-common=0.6.2
aws-c-event-stream=0.2.7
aws-c-io=0.10.5
aws-checksums=0.1.11
aws-sdk-cpp=1.8.186
azure-datalake-store=0.0.51
azure-identity=2021.03.15b1
azure-storage-blob=12.8.1
backcall=0.2.0
backports=1.0
backports.functools_lru_cache=1.6.4
beautifulsoup4=4.9.3
blas=2.109
blas-devel=3.9.0=9_mkl
blinker=1,4
blosc=1.21.0
bokeh=2.3.2
brotli=1.0.9
brotli-bin=1.0.9
brotli-python=1.0.9
brotlipy=0.7.0
brunsli=0,1
bzip2=1.0.8
c-ares=1.17.1
ca-certificates=2021.7.5
cachetools=4.2.2
cairo=1.16.0
certifi=2021.5.30
cffi=1.14.5
chardet=4.0.0
charls=2.2.0
click=8.0.1
cloudpickle=1.6.0
conda=4.9.2
conda-package-handling=1.7.3
configparser=5.0.2
titkosítás=3.4.7
cudatoolkit=11.1.1
cycler=0.10.0
cython=0.29.23
citoolz=0.11.0
dash=1.20.0
dash-core-components=1.16.0
dash-html-components=1.1.3
dash-renderer=1.9.1
dash-table=4.11.3
dash_cytoscape=0.2.0
dask-core=2021.6.2
databricks-cli=0.12.1
dataclasses=0,8
dbus=1.13.18
debugpy=1.3.0
dekoratőr=4.4.2
dill=0.3.4
entrypoints=0.3
et_xmlfile=1.1.0
expat=2.4.1
fire=0.4.0
flask=2.0.1
flask-compress=1.10.1
fontconfig=2.13.1
freetype=2.10.4
fsspec=2021.6.1
future=0.18.2
gast=0.3.3
gensim=3.8.3
geographiclib=1,52
geopy=2.1.0
gettext=0.21.0
gevent=21.1.2
gflags=2.2.2
giflib=5.2.1
gitdb=4.0.7
gitpython=3.1.18
glib=2.68.3
glib-tools=2.68.3
glog=0.5.0
gobject-introspection=1.68.0
google-auth=1.32.1
google-auth-oauthlib=0.4.1
google-pasta=0.2.0
greenlet=1.1.0
grpc-cpp=1.37.1
grpcio=1.37.1
gst-plugins-base=1.18.4
gstreamer=1.18.4
h5py=2.10.0
hdf5=1.10.6
html5lib=1.1
kolibri-ml=0.4.0
icu=68.1
idna=2,10
imagecodecs=2021.3.31
imageio=2.9.0
importlib-metadata=4.6.1
intel-openmp=2021.2.0
interpret=0.2.4
interpret-core=0.2.4
ipykernel=6.0.1
ipython=7.23.1
ipython_genutils=0.2.0
isodate=0.6.0
itsdangerous=2.0.1
jdcal=1.4.1
jedi=0.18.0
jinja2=3.0.1
joblib=1.0.1
jpeg=9d
jupyter_client=6.1.12
jupyter_core=4.7.1
jxrlib=1,1
keras-applications=1.0.8
keras-preprocessing=1.1.2
keras2onnx=1.6.5
kiwisolver=1.3.1
koalas=1.8.0
krb5=1.19.1
lcms2=2,12
ld_impl_linux-64=2.36.1
lerc=2.2.1
liac-arff=2.5.0
libaec=1.0.5
libblas=3.9.0=9_mkl
libbrotlicommon=1.0.9
libbrotlidec=1.0.9
libbrotlienc=1.0.9
libcblas=3.9.0=9_mkl
libclang=11.1.0
libcurl=7.77.0
libdeflate=1,7
libedit=3.1.20210216
libev=4,33
libevent=2.1.10
libffi=3,3
libgcc-ng=9.3.0
libgfortran-ng=9.3.0
libgfortran5=9.3.0
libglib=2.68.3
libiconv=1,16
liblapack=3.9.0=9_mkl
liblapacke=3.9.0=9_mkl
libllvm10=10.0.1
libllvm11=11.1.0
libnghttp2=1.43.0
libogg=1.3.5
libopus=1.3.1
libpng=1.6.37
libpq=13.3
libprotobuf=3.15.8
libsodium=1.0.18
libssh2=1.9.0
libstdcxx-ng=9.3.0
libthrift=0.14.1
libtiff=4.2.0
libutf8proc=2.6.1
libuuid=2.32.1
libuv=1.41.1
libvorbis=1.3.7
libwebp-base=1.2.0
libxcb=1,14
libxgboost=1.4.0
libxkbcommon=1.0.3
libxml2=2.9.12
libzopfli=1.0.3
lightgbm=3.2.1
lime=0.2.0.1
llvm-openmp=11.1.0
llvmlite=0.36.0
locket=0.2.1
lz4-c=1.9.3
markdown=3.3.4
markupsafe=2.0.1
matplotlib=3.4.2
matplotlib-base=3.4.2
matplotlib-inline=0.1.2
mkl=2021.2.0
mkl-devel=2021.2.0
mkl-include=2021.2.0
mleap=0.17.0
mlflow-skinny=1.18.0
msal=2021.06.08
msal-extensions=2021.06.08
msrest=2021.06.01
multidict=5.1.0
mysql-common=8.0.25
mysql-libs=8.0.25
ncurses=6.2
networkx=2.5.1
ninja=1.10.2
nltk=3.6.2
nspr=4,30
nss=3,67
numba=0.53.1
numpy=1.19.4
oauthlib=3.1.1
olefile=0,46
onnx=1.9.0
onnxconverter-common=1.7.0
onnxmltools=1.7.0
onnxruntime=1.7.2
openjpeg=2.4.0
openpyxl=3.0.7
openssl=1.1.1k
opt_einsum=3.3.0
orc=1.6.7
packaging=21.0
pandas=1.2.3
parquet-cpp=1.5.1=1
parso=0.8.2
partd=1.2.0
patsy=0.5.1
pcre=8,45
pexpect=4.8.0
pickleshare=0.7.5
párna=8.2.0
pip=21.1.1
pixman=0.40.0
plotly=4.14.3
pmdarima=1.8.2
pooch=1.4.0
portalocker=1.7.1
prompt-toolkit=3.0.19
protobuf=3.15.8
psutil=5.8.0
ptyprocess=0.7.0
py-xgboost=1.4.0
py4j=0.10.9
pyarrow=3.0.0
pyasn1=0.4.8
pyasn1-modules=0.2.8
pycairo=1.20.1
pycosat=0.6.3
pycparser=2,20
pygments=2.9.0
pygobject=3.40.1
pyjwt=2.1.0
pyodbc=4.0.30
pyopenssl=20.0.1
pyparsing=2.4.7
pyqt=5.12.3
pyqt-impl=5.12.3
pyqt5-sip=4.19.18
pyqtchart=5,12
pyqtwebengine=5.12.1
pysocks=1.7.1
python=3.8.10
python-dateutil=2.8.1
python-flatbuffers=1,12
python_abi=3,8=2_cp38
pytorch=1.8.1.8_cuda11.1_cudnn8.0.5_0
pytz=2021.1
pyu2f=0.1.5
pywavelets=1.1.1
pyyaml=5.4.1
pyzmq=22.1.0
qt=5.12.9
re2=2021.04.01
readline=8.1
regex=2021.7.6
requests=2.25.1
requests-oauthlib=1.3.0
újrapróbálkozás=1.3.3
rsa=4.7.2
ruamel_yaml=0.15.100
s2n=1.0.10
salib=1.3.11
scikit-image=0.18.1
scikit-learn=0.23.2
scipy=1.5.3
seaborn=0.11.1
seaborn-base=0.11.1
setuptools=49.6.0
shap=0.39.0
six=1.16.0
skl2onnx=1.8.0.1
sklearn-pandas=2.2.0
szeletelő=0.0.7
smart_open=5.1.0
smmap=3.0.5
snappy=1.1.8
levessieve=2.2.1
sqlite=3.36.0
statsmodels=0.12.2
tabulátor=0.8.9
tenacity=7.0.0
tensorboard=2.4.1
tensorboard-plugin-wit=1.8.0
tensorflow=2.4.1
tensorflow-base=2.4.1
tensorflow-estimator=2.4.0
termcolor=1.1.0
textblob=0.15.3
threadpoolctl=2.1.0
tifffile=2021.4.8
tk=8.6.10
toolz=0.11.1
tornado=6,1
tqdm=4.61.2
traitlets=5.0.5
typing-extensions=3.10.0.0
typing_extensions=3.10.0.0
unixodbc=2.3.9
urllib3=1.26.4
wcwidth=0.2.5
webencodings=0.5.1
werkzeug=2.0.1
wheel=0.36.2
wrapt=1.12.1
xgboost=1.4.0
xorg-kbproto=1.0.7
xorg-libice=1.0.10
xorg-libsm=1.2.3
xorg-libx11=1.7.2
xorg-libxext=1.3.4
xorg-libxrender=0.9.10
xorg-renderproto=0.11.1
xorg-xextproto=7.3.0
xorg-xproto=7.0.31
xz=5.2.5
yaml=0.2.5
yarl=1.6.3
zeromq=4.3.4
zfp=0.5.5
zipp=3.5.0
zlib=1.2.11
zope.event=4.5.0
zope.interface=5.4.0
zstd=1.4.9
applicationinsights==0.11.10
argon2-cffi==21.3.0
argon2-cffi-bindings==21.2.0
azure-common==1.1.27
azure-core==1.16.0
azure-graphrbac==0.61.1
azure-identity==1.4.1
azure-mgmt-authorization==0.61.0
azure-mgmt-containerregistry==8.0.0
azure-mgmt-core==1.3.0
azure-mgmt-keyvault==2.2.0
azure-mgmt-resource==13.0.0
azure-mgmt-storage==11.2.0
azureml-core==1.34.0
azureml-dataprep==2.22.2
azureml-dataprep-native==38.0.0
azureml-dataprep-rslex==1.20.2
azureml-dataset-runtime==1.34.0
azureml-mlflow==1.34.0
azureml-opendatasets==1.34.0
azureml-telemetria==1.34.0
backports-tempfile==1.0
backports-weakref==1.0.post1
bleach==5.0.1
contextlib2==0.6.0.post1
defusedxml==0.7.1
distlib==0.3.6
distro==1.7.0
docker==4.4.4
dotnetcore2==2.1.23
fastjsonschema==2.16.1
filelock==3.8.0
fusepy==3.0.1
importlib-resources==5.9.0
ipywidgets==7.6.3
jeepney==0.6.0
jmespath==0.10.0
jsonpickle==2.0.0
jsonschema==4.15.0
jupyterlab-pygments==0.2.2
jupyterlab-widgets==3.0.3
kqlmagiccustom==0.1.114.post8
lxml==4.6.5
mistune==2.0.4
msal-extensions==0.2.2
msrestazure==0.6.4
mypy==0,780
mypy-extensions==0.4.3
nbclient==0.6.7
nbconvert==7.0.0
nbformat==5.4.0
ndg-httpsclient==0.5.1
nest-asyncio==1.5.5
notebook==6.4.12
pandasql==0.7.3
pandocfilters==1.5.0
pathspec==0.8.1
pkgutil-resolve-name==1.3.10
platformdirs==2.5.2
prettytable==2.4.0
prometheus-client==0.14.1
pyperclip==1.8.2
pyrsistent==0.18.1
pyspark==3.2.1
ruamel-yaml==0.17.4
ruamel-yaml-clib==0.2.6
secretstorage==3.3.1
send2trash==1.8.0
sqlalchemy==1.4.20
terminado==0.15.0
tinycss2==1.1.1
torchvision==0.9.1
traitlets==5.3.0
typed-ast==1.4.3
virtualenv==20.14.0
websocket-client==1.1.0
widgetsnbextension==3.5.2
Python-kódtárak (GPU-val gyorsított virtuális gépek)
_libgcc_mutex=0,1
_openmp_mutex=4,5
_py-xgboost-mutex=2,0
_tflow_select=2.3.0
abseil-cpp=20210324.1
absl-py=0.13.0
adal=1.2.7
adlfs=0.7.7
aiohttp=3.7.4.post0
appdirs=1.4.4
nyíl-cpp=3.0.0
astor=0.8.1
astunparse=1.6.3
async-timeout=3.0.1
attrs=21.2.0
aws-c-cal=0.5.11
aws-c-common=0.6.2
aws-c-event-stream=0.2.7
aws-c-io=0.10.5
aws-checksums=0.1.11
aws-sdk-cpp=1.8.186
azure-datalake-store=0.0.51
azure-storage-blob=12.9.0
backcall=0.2.0
backports=1.0
backports.functools_lru_cache=1.6.4
beautifulsoup4=4.9.3
blas=2,111
blas-devel=3.9.0
blinker=1,4
bokeh=2.3.2
brotli=1.0.9
brotli-bin=1.0.9
brotli-python=1.0.9
brotlipy=0.7.0
bzip2=1.0.8
c-ares=1.17.2
ca-certificates=2021.5.30
cachetools=4.2.2
cairo=1.16.0
certifi=2021.5.30
cffi=1.14.6
chardet=4.0.0
click=8.0.1
colorama=0.4.4
conda=4.9.2
conda-package-handling=1.7.3
configparser=5.0.2
titkosítás=3.4.7
cudatoolkit=11.1.1
cycler=0.10.0
cython=0.29.24
citoolz=0.11.0
dash=1.21.0
dash-core-components=1.17.1
dash-html-components=1.1.4
dash-renderer=1.9.1
dash-table=4.12.0
dash_cytoscape=0.2.0
dask-core=2021.9.1
databricks-cli=0.12.1
dataclasses=0,8
dbus=1.13.18
debugpy=1.4.1
dekoratőr=5.1.0
dill=0.3.4
entrypoints=0.3
et_xmlfile=1.0.1001
expat=2.4.1
ffmpeg=4.3
fire=0.4.0
flask=2.0.1
flask-compress=1.10.1
fontconfig=2.13.1
freetype=2.10.4
fsspec=2021.8.1
future=0.18.2
g-ir-build-tools=1.68.0
g-ir-host-tools=1.68.0
gensim=3.8.3
geographiclib=1,52
geopy=2.1.0
gettext=0.19.8.1
gevent=21.8.0
gflags=2.2.2
gitdb=4.0.7
gitpython=3.1.23
glib=2.68.4
glib-tools=2.68.4
glog=0.5.0
gmp=6.2.1
gnutls=3.6.13
gobject-introspection=1.68.0
google-auth=1.35.0
google-auth-oauthlib=0.4.6
google-pasta=0.2.0
greenlet=1.1.1
grpc-cpp=1.37.1
gst-plugins-base=1.14.0
gstreamer=1.14.0
h5py=2.10.0
hdf5=1.10.6
html5lib=1.1
kolibri-ml=0.4.0
icu=58,2
idna=2,10
imagecodecs-lite=2019.12.3
imageio=2.9.0
importlib-metadata=4.8.1
interpret=0.2.4
interpret-core=0.2.4
ipykernel=6.4.1
ipython=7.23.1
ipython_genutils=0.2.0
isodate=0.6.0
itsdangerous=2.0.1
jdcal=1.4.1
jedi=0.18.0
jinja2=3.0.1
joblib=1.0.1
jpeg=9b
jupyter_client=7.0.3
jupyter_core=4.8.1
keras=2.4.3
keras-applications=1.0.8
keras-preprocessing=1.1.2
keras2onnx=1.6.5
kiwisolver=1.3.2
koalas=1.8.0
krb5=1.19.2
lame=3,100
ld_impl_linux-64=2.36.1
liac-arff=2.5.0
libblas=3.9.0
libbrotlicommon=1.0.9
libbrotlidec=1.0.9
libbrotlienc=1.0.9
libcblas=3.9.0
libcurl=7.79.1
libedit=3.1.20191231
libev=4,33
libevent=2.1.10
libffi=3.4.2
libgcc-ng=11.2.0
libgfortran-ng=11.2.0
libgfortran5=11.2.0
libgirepository=1.68.0
libglib=2.68.4
libiconv=1,16
liblapack=3.9.0
liblapacke=3.9.0
libllvm11=11.1.0
libnghttp2=1.43.0
libpng=1.6.37
libprotobuf=3.16.0
libsodium=1.0.18
libssh2=1.10.0
libstdcxx-ng=11.2.0
libthrift=0.14.1
libtiff=4.2.0
libutf8proc=2.6.1
libuuid=2.32.1
libuv=1.42.0
libwebp-base=1.2.1
libxcb=1,13
libxgboost=1.4.0
libxml2=2.9.9
lightgbm=3.2.1
lime=0.2.0.1
llvm-openmp=12.0.1
llvmlite=0.37.0
locket=0.2.0
lz4-c=1.9.3
markdown=3.3.4
markupsafe=2.0.1
matplotlib=3.4.2
matplotlib-base=3.4.2
matplotlib-inline=0.1.3
mkl=2021.3.0
mkl-devel=2021.3.0
mkl-include=2021.3.0
mleap=0.17.0
mlflow-skinny=1.18.0
msal=2021.09.01
msrest=2021.09.01
multidict=5.1.0
multiprocess=0.70.12.2
ncurses=6.2
nest-asyncio=1.5.1
csalán=3,6
networkx=2.5
ninja=1.10.2
nltk=3.6.2
numba=0.54.0
numpy=1.19.4
oauthlib=3.1.1
olefile=0,46
onnx=1.9.0
onnxconverter-common=1.7.0
onnxmltools=1.7.0
onnxruntime=1.7.2
openh264=2.1.1
openpyxl=3.0.7
openssl=1.1.1l
opt_einsum=3.3.0
orc=1.6.7
packaging=21.0
pandas=1.2.3
parquet-cpp=1.5.1
parso=0.8.2
partd=1.2.0
pathos=0.2.8
patsy=0.5.1
pcre=8,45
pexpect=4.8.0
pickleshare=0.7.5003
párna=7.1.2
pip=21.1.1
pixman=0.38.0
pkg-config=0.29.2
plotly=4.14.3
pmdarima=1.8.2
pooch=1.5.1
portalocker=1.7.1
pox=0.3.0
ppft=1.6.6.4
prompt-toolkit=3.0.20
protobuf=3.16.0
psutil=5.8.0
pthread-stubs=0,4
ptyprocess=0.7.0
py-xgboost=1.4.0
py4j=0.10.9
pyarrow=3.0.0
pyasn1=0.4.8
pyasn1-modules=0.2.7
pycairo=1.20.1
pycosat=0.6.3
pycparser=2,20
pydeprecate=0.3.1
pygments=2.10.0
pygobject=3.40.1
pyjwt=2.1.0
pyodbc=4.0.30
pyopenssl=20.0.1
pyparsing=2.4.7
pyqt=5.9.2
pysocks=1.7.1
pyspark=3.1.2
python=3.8.12
python-dateutil=2.8.2
python_abi=3,8
pytorch=1.8.1
pytorch-lightning=1.4.2
pytz=2021.1
pyu2f=0.1.5
pywavelets=1.1.1
pyyaml=5.4.1
pyzmq=22.3.0
qt=5.9.7
re2=2021.04.01
readline=8.1
regex=2021.8.28
requests=2.25.1
requests-oauthlib=1.3.0
újrapróbálkozás=1.3.3
rsa=4.7.2
ruamel_yaml=0.15.80
s2n=1.0.10
salib=1.4.5
scikit-image=0.18.1
scikit-learn=0.23.2
scipy=1.7.1
seaborn=0.11.1
seaborn-base=0.11.1
setuptools=49.6.0
shap=0.39.0
sip=4.19.13
skl2onnx=1.8.0.1
sklearn-pandas=2.2.0
szeletelő=0.0.7
smart_open=5.2.1
smmap=3.0.5
snappy=1.1.8
levessieve=2.0.1
sqlite=3.36.0
statsmodels=0.12.2
tabulátor=0.8.9
tbb=2021.3.0
tenacity=8.0.1
tensorboard=2.6.0
tensorboard-data-server=0.6.0
tensorboard-plugin-wit=1.8.0
tensorflow=2.4.1
tensorflow-base=2.4.1
termcolor=1.1.0
textblob=0.15.3
threadpoolctl=2.2.0
tifffile=2020.6.3
tk=8.6.11
toolz=0.11.1
torchaudio=0.8.1
torchmetrics=0.5.1
torchvision=0.9.1
tornado=6,1
tqdm=4.62.3
traitlets=5.1.0
unixodbc=2.3.9
urllib3=1.26.4
wcwidth=0.2.5
webencodings=0.5.1
werkzeug=2.0.1
wheel=0.37.0
wrapt=1.12.1
xgboost=1.4.0
xorg-kbproto=1.0.7
xorg-libice=1.0.10
xorg-libsm=1.2.3
xorg-libx11=1.7.2
xorg-libxau=1.0.9
xorg-libxdmcp=1.1.3
xorg-libxext=1.3.4
xorg-libxrender=0.9.10
xorg-renderproto=0.11.1
xorg-xextproto=7.3.0
xorg-xproto=7.0.31
xz=5.2.5
yaml=0.2.5
yarl=1.6.3
zeromq=4.3.4
zipp=3.5.0
zlib=1.2.11
zope.event=4.5.0
zope.interface=5.4.0
zstd=1.4.9
applicationinsights==0.11.10
argon2-cffi==21.1.0
azure-common==1.1.27
azure-core==1.18.0
azure-graphrbac==0.61.1
azure-identity==1.4.1
azure-mgmt-authorization==0.61.0
azure-mgmt-containerregistry==8.1.0
azure-mgmt-core==1.3.0
azure-mgmt-keyvault==9.1.0
azure-mgmt-resource==13.0.0
azure-mgmt-storage==11.2.0
azureml-core==1.34.0
azureml-dataprep==2.22.2
azureml-dataprep-native==38.0.0
azureml-dataprep-rslex==1.20.2
azureml-dataset-runtime==1.34.0
azureml-mlflow==1.34.0
azureml-opendatasets==1.34.0
azureml-telemetria==1.34.0
backports-tempfile==1.0
backports-weakref==1.0.post1
bleach==4.1.0
cloudpickle==1.6.0
contextlib2==21.6.0
defusedxml==0.7.1
diskcache==5.2.1
distro==1.6.0
docker==5.0.2
dotnetcore2==2.1.21
flatbuffers==1,12
fusepy==3.0.1
gast==0.3.3
grpcio==1.32.0
ipywidgets==7.6.5
jeepney==0.7.1
jmespath==0.10.0
jsonpickle==2.0.0
jsonschema==4.1.2
jupyterlab-pygments==0.1.2
jupyterlab-widgets==1.0.2
kqlmagiccustom==0.1.114.post8
lxml==4.7.1
mistune==0.8.4
msal-extensions==0.2.2
msrestazure==0.6.4
mypy==0,780
mypy-extensions==0.4.3
nbclient==0.5.4
nbconvert==6.2.0
nbformat==5.1.3
ndg-httpsclient==0.5.1
notebook==6.4.5
opencv-python==4.5.3.56
pandasql==0.7.3
pandocfilters==1.5.0
pathspec==0.9.0
petastorm==0.11.3
prettytable==3.0.0
prometheus-client==0.12.0
pyperclip==1.8.2
pyrsistent==0.18.0
ruamel-yaml==0.17.4
ruamel-yaml-clib==0.2.6
secretstorage==3.3.1
send2trash==1.8.0
six==1.15.0
sqlalchemy==1.4.25
tensorflow-estimator==2.4.0
tensorflow-gpu==2.4.1
terminado==0.12.1
testpath==0.5.0
typed-ast==1.4.3
typing-extensions==3.7.4.3
websocket-client==1.2.1
widgetsnbextension==3.5.2
R-kódtárak (előzetes verzió)
| Könyvtár | Verzió | Könyvtár | Verzió | Könyvtár | Verzió |
|---|---|---|---|---|---|
| askpass | 1,1 | highcharter | 0.9.4 | olvasó | 2.1.3 |
| assertthat | 0.2.1 | highr | 0,9 | readxl | 1.4.1 |
| Backports | 1.4.1 | Hms | 1.1.2 | receptek | 1.0.3 |
| base64enc | 0.1-3 | htmltoolok | 0.5.3 | Visszavágót | 1.0.1 |
| Kicsit | 4.0.5 | htmlwidgets | 1.5.4 | visszavágó2 | 2.1.2 |
| bit64 | 4.0.5 | httpcode | 0.3.0 | Távirányító | 2.4.2 |
| blob | 1.2.3 | httpuv | 1.6.6 | reprex | 2.0.2 |
| Sört | 1.0-8 | httr | 1.4.4 | újraformázás2 | 1.4.4 |
| Brio | 1.1.3 | Azonosítók | 1.0.1 | rjson | 0.2.21 |
| Seprű | 1.0.1 | igraph | 1.3.5 | rlang | 1.0.6 |
| bslib | 0.4.1 | Következtetni | 1.0.3 | rlist | 0.4.6.2 |
| gyorsítótár | 1.0.6 | Ini | 0.3.1 | rmarkdown | 2.18 |
| hívó | 3.7.3 | ipred | 0.9-13 | RODBC | 1.3-19 |
| Billentyűzettel | 6.0-93 | izoband | 0.2.6 | roxygen2 | 7.2.2 |
| cellranger | 1.1.0 | iterátorok | 1.0.14 | rprojroot | 2.0.3 |
| Cli | 3.4.1 | jquerylib | 0.1.4 | rsample | 1.1.0 |
| clipr | 0.8.0 | jsonlite | 1.8.3 | rstudioapi | 0,14 |
| Óra | 0.6.1 | knitr | 1.41 | rversions | 2.1.2 |
| színtér | 2.0-3 | Címkézés | 0.4.2 | rvest | 1.0.3 |
| commonmark | 1.8.1 | Később | 1.3.0 | Sass | 0.4.4 |
| config | 0.3.1 | Láva | 1.7.0 | Mérlegek | 1.2.1 |
| Ütközött | 1.1.0 | lazyeval | 0.2.2 | választó | 0.4-2 |
| coro | 1.0.3 | Lhs | 1.1.5 | sessioninfo | 1.2.2 |
| cpp11 | 0.4.3 | életciklus | 1.0.3 | Fényes | 1.7.3 |
| Zsírkréta | 1.5.2 | lightgbm | 3.3.3 | Csúszka | 0.3.0 |
| hitelesítő adatok | 1.3.2 | figyelő | 0.8.0 | sourcetools | 0.1.7 |
| Ellenvélemények | 1.2.0 | lobstr | 1.1.2 | sparklyr | 1.7.8 |
| crul | 1.3 | lubridate | 1.9.0 | NÉGYZET | 2021.1 |
| Curl | 4.3.3 | magrittr | 2.0.3 | stringi | 1.7.8 |
| data.table | 1.14.6 | Térképek | 3.4.1 | sztring | 1.4.1 |
| DBI | 1.1.3 | memoise | 2.0.1 | sys | 3.4.1 |
| dbplyr | 2.2.1 | Mime | 0,12 | systemfonts | 1.0.4 |
| Desc | 1.4.2 | miniUI | 0.1.1.1 | testthat | 3.1.5 |
| devtools | 2.4.5 | modeldata | 1.0.1 | szövegformázás | 0.3.6 |
| Tárcsázza | 1.1.0 | modelenv | 0.1.0 | tibble | 3.1.8 |
| DiceDesign | 1,9 | ModelMetrics | 1.2.2.2 | tidymodels | 1.0.0 |
| diffobj | 0.3.5 | modellező | 0.1.10 | tidyr | 1.2.1 |
| Digest | 0.6.30 | munsell | 0.5.0 | tidyselect | 1.2.0 |
| levilágított | 0.4.2 | numDeriv | 2016.8-1.1 | tidyverse | 1.3.2 |
| dplyr | 1.0.10 | Openssl | 2.0.4 | timechange | 0.1.1 |
| dtplyr | 1.2.2 | párhuzamosan | 1.32.1 | timeDate | 4021.106 |
| e1071 | 1.7-12 | elemzés | 1.0.3 | tinytex | 0.42 |
| három pont | 0.3.2 | Patchwork | 1.1.2 | Fáklya | 0.9.0 |
| evaluate | 0,18 | Pillér | 1.8.1 | triebeard | 0.3.0 |
| fani | 1.0.3 | pkgbuild | 1.4.0 | TTR | 0.24.3 |
| farver | 2.1.1 | pkgconfig | 2.0.3 | Dallam | 1.0.1 |
| gyorstérkép | 1.1.0 | pkgdown | 2.0.6 | tzdb | 0.3.0 |
| fontawesome | 0.4.0 | pkgload | 1.3.2 | urlchecker | 1.0.1 |
| forcats | 0.5.2 | ábrázolás | 4.10.1 | urltools | 1.7.3 |
| foreach | 1.5.2 | rétegelt | 1.8.8 | usethis | 2.1.6 |
| Forge | 0.2.0 | Dicséret | 1.0.0 | utf8 | 1.2.2 |
| Fs | 1.5.2 | prettyunits | 1.1.1 | uuid | 1.1-0 |
| furrr | 0.3.1 | Proc | 1.18.0 | vctrs | 0.5.1 |
| Jövőben | 1.29.0 | processx | 3.8.0 | viridisLite | 0.4.1 |
| future.apply | 1.10.0 | prodlim | 2019.11.13 | vroom | 1.6.0 |
| Gargarizál | 1.2.1 | profvis | 0.3.7 | Waldo | 0.4.0 |
| Generikus | 0.1.3 | Haladás | 1.2.2 | Warp | 0.2.0 |
| Gert | 1.9.1 | progressr | 0.11.0 | bajusz | 0,4 |
| ggplot2 | 3.4.0 | Ígér | 1.2.0.1 | withr | 2.5.0 |
| Gh | 1.3.1 | Proxy | 0.4-27 | Munkafolyamatok | 1.1.2 |
| gistr | 0.9.0 | pryr | 0.1.5 | munkafolyamat-halmazok | 1.0.0 |
| gitcreds | 0.1.2 | Ps | 1.7.2 | xfun | 0,35 |
| Globals | 0.16.2 | purrr | 0.3.5 | xgboost | 1.6.0.1 |
| Ragasztó | 1.6.2 | quantmod | 0.4.20 | XML | 3.99-0.12 |
| googledrive | 2.0.0 | r2d3 | 0.2.6 | xml2 | 1.3.3 |
| googlesheets4 | 1.0.1 | R6 | 2.5.1 | xopen | 1.0.0 |
| Gower | 1.0.0 | ragg | 1.2.4 | xtable | 1.8-4 |
| GPfit | 1.0-8 | rappdirs | 0.3.3 | xts | 0.12.2 |
| gtable | 0.3.1 | rbokeh | 0.5.2 | Yaml | 2.3.6 |
| hardhat | 1.2.0 | rcmdcheck | 1.4.0 | Szempont | 1.1.0 |
| Haven | 2.5.1 | RColorBrewer | 1.1-3 | Zip | 2.2.2 |
| hexbin | 1.28.2 | Rcpp | 1.0.9 | Állatkert | 1.8-11 |
Következő lépések
Migrálás az Apache Spark-verziók között – támogatás
A régebbi futtatókörnyezeti verziókról az Apache Spark 3.3-hoz vagy 3.4-hez készült Azure Synapse Runtime-ra való migrálással kapcsolatos útmutatásért tekintse meg az Apache Spark futtatókörnyezetének áttekintését.