Azure Cosmos DB OLTP Spark 3 connector
Azure Cosmos DB OLTP Spark 3 connector for Spark 3.2
Azure Cosmos DB OLTP Spark connector provides Apache Spark support for Azure Cosmos DB using the SQL API. Azure Cosmos DB is a globally-distributed database service which allows developers to work with data using a variety of standard APIs, such as SQL, MongoDB, Cassandra, Graph, and Table.
If you have any feedback or ideas on how to improve your experience please let us know here: https://github.com/Azure/azure-sdk-for-java/issues/new
Documentation
Version Compatibility
azure-cosmos-spark_3-2_2-12
Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
---|---|---|---|---|
4.11.2 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
4.11.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
4.11.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
4.10.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
4.10.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
4.9.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
4.8.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
4.7.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
4.6.2 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
4.6.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
4.6.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
azure-cosmos-spark_3-1_2-12
Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
---|---|---|---|---|
4.11.2 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.11.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.11.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.10.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.10.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.9.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.8.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.7.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.6.2 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.6.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.6.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.5.3 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.5.2 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.5.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.5.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.4.2 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.4.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.4.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.3.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.3.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
4.2.0 | 3.1.1 | 8 | 2.12 | 8.* |
4.1.0 | 3.1.1 | 8 | 2.12 | 8.* |
4.0.0 | 3.1.1 | 8 | 2.12 | 8.* |
4.0.0-beta.3 | 3.1.1 | 8 | 2.12 | 8.* |
4.0.0-beta.2 | 3.1.1 | 8 | 2.12 | 8.* |
4.0.0-beta.1 | 3.1.1 | 8 | 2.12 | 8.* |
Download
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven:
com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12:4.11.2
You can also integrate against Cosmos DB Spark Connector in your SBT project:
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-2_2-12" % "4.11.2"
Cosmos DB Spark Connector is available on Maven Central Repo.
General
If you encounter any bug, please file an issue here.
To suggest a new feature or changes that could be made, file an issue the same way you would for a bug.
License
This project is under MIT license and uses and repackages other third party libraries as an uber jar. See NOTICE.txt.
Contributing
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution.
When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.
Azure SDK for Java
피드백
https://aka.ms/ContentUserFeedback
출시 예정: 2024년 내내 콘텐츠에 대한 피드백 메커니즘으로 GitHub 문제를 단계적으로 폐지하고 이를 새로운 피드백 시스템으로 바꿀 예정입니다. 자세한 내용은 다음을 참조하세요.다음에 대한 사용자 의견 제출 및 보기