Spark Engine Parameter Adjustment

This article describes how to adjust the parameters of the Spark engine.

Users can adjust Spark parameters on the management console according to their needs. Linkis management console == “parameter setting ==” select the corresponding application == “click the Spark engine to display the parameters that can be set by Spark.

If you want the engine to execute faster, you can adjust the number of executors. The more executor cores, the higher the execution efficiency.

If you need to pull large data and then process it with the Driver, you need to adjust the driver memory parameters.