VDB
Sign up
CRITICAL9.9

PYSEC-2023-44

Quick fix

PYSEC-2023-44 — pyspark: upgrade to the fixed version with the command below.

pip install --upgrade 'pyspark>=3.4.0'

Details

In Apache Spark versions prior to 3.4.0, applications using spark-submit can specify a 'proxy-user' to run as, limiting privileges. The application can execute code with the privileges of the submitting user, however, by providing malicious configuration-related classes on the classpath. This affects architectures relying on proxy-user, for example those using Apache Livy to manage submitted applications. Update to Apache Spark 3.4.0 or later, and ensure that spark.submit.proxyUser.allowCustomClasspathInClusterMode is set to its default of "false", and is not overridden by submitted applications.

Are you affected?

Enter the version of the package you're using.

Affected packages

PyPI/pyspark
Introduced in: 0Fixed in: 3.4.0
Fixpip install --upgrade 'pyspark>=3.4.0'

References