SparkSection Class
Defines Spark settings to use for the PySpark framework in the environment.
This SparkSection class is used in the Environment class.
Class SparkSection constructor.
- Inheritance
-
azureml._base_sdk_common.abstract_run_config_element._AbstractRunConfigElementSparkSection
Constructor
SparkSection(**kwargs)
Variables
Name | Description |
---|---|
repositories
|
A list of Spark repositories. |
packages
|
The packages to use. |
precache_packages
|
Indicates Whether to precache the packages. |
Feedback
https://aka.ms/ContentUserFeedback.
Coming soon: Throughout 2024 we will be phasing out GitHub Issues as the feedback mechanism for content and replacing it with a new feedback system. For more information see:Submit and view feedback for