SparkSection Class
Defines Spark settings to use for the PySpark framework in the environment.
This SparkSection class is used in the Environment class.
Class SparkSection constructor.
- Inheritance
-
azureml._base_sdk_common.abstract_run_config_element._AbstractRunConfigElementSparkSection
Constructor
SparkSection(**kwargs)
Variables
- repositories
- list
A list of Spark repositories.
- packages
- list
The packages to use.
- precache_packages
- bool
Indicates Whether to precache the packages.
Feedback
https://aka.ms/ContentUserFeedback.
Coming soon: Throughout 2024 we will be phasing out GitHub Issues as the feedback mechanism for content and replacing it with a new feedback system. For more information see:Submit and view feedback for