Azure Cosmos DB OLTP Spark 3 connector
Azure Cosmos DB OLTP Spark 3 connector for Spark 3.2
Azure Cosmos DB OLTP Spark connector provides Apache Spark support for Azure Cosmos DB using the SQL API. Azure Cosmos DB is a globally-distributed database service which allows developers to work with data using a variety of standard APIs, such as SQL, MongoDB, Cassandra, Graph, and Table.
If you have any feedback or ideas on how to improve your experience please let us know here: https://github.com/Azure/azure-sdk-for-java/issues/new
Documentation
Version Compatibility
azure-cosmos-spark_3-2_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|---|---|---|---|---|
| 4.11.2 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
| 4.11.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
| 4.11.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
| 4.10.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
| 4.10.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
| 4.9.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
| 4.8.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
| 4.7.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
| 4.6.2 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
| 4.6.1 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
| 4.6.0 | 3.2.0 - 3.2.1 | 8 | 2.12 | 10.* |
azure-cosmos-spark_3-1_2-12
| Connector | Supported Spark Versions | Minimum Java Version | Supported Scala Versions | Supported Databricks Runtimes |
|---|---|---|---|---|
| 4.11.2 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.11.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.11.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.10.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.10.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.9.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.8.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.7.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.6.2 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.6.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.6.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.5.3 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.5.2 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.5.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.5.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.4.2 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.4.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.4.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.3.1 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.3.0 | 3.1.1 - 3.1.2 | 8 | 2.12 | 8.*, 9.* |
| 4.2.0 | 3.1.1 | 8 | 2.12 | 8.* |
| 4.1.0 | 3.1.1 | 8 | 2.12 | 8.* |
| 4.0.0 | 3.1.1 | 8 | 2.12 | 8.* |
| 4.0.0-beta.3 | 3.1.1 | 8 | 2.12 | 8.* |
| 4.0.0-beta.2 | 3.1.1 | 8 | 2.12 | 8.* |
| 4.0.0-beta.1 | 3.1.1 | 8 | 2.12 | 8.* |
Download
You can use the maven coordinate of the jar to auto install the Spark Connector to your Databricks Runtime 8 from Maven:
com.azure.cosmos.spark:azure-cosmos-spark_3-2_2-12:4.11.2
You can also integrate against Cosmos DB Spark Connector in your SBT project:
libraryDependencies += "com.azure.cosmos.spark" % "azure-cosmos-spark_3-2_2-12" % "4.11.2"
Cosmos DB Spark Connector is available on Maven Central Repo.
General
If you encounter any bug, please file an issue here.
To suggest a new feature or changes that could be made, file an issue the same way you would for a bug.
License
This project is under MIT license and uses and repackages other third party libraries as an uber jar. See NOTICE.txt.
Contributing
This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution.
When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., label, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.
