Configuration - Spark 2.4.3 Documentation
2019-5-8 · Regex to decide which Spark configuration properties and environment variables in driver and executor environments contain sensitive information. When this regex matches a property key or value, the value is redacted from the environment UI and various logs like YARN and event logs. ... spark.task.cpus: 1: Number of cores to allocate for each task.