To pip install Python packages so they are usable in Spark jobs, you need to do what

A. Install packages on the driver node only.
B. Install packages on all worker nodes.
C. Use the --spark-submit flag with pip.
D. Python packages are automatically available in Spark jobs without installation.

Q&A Platform for Education
Platform Explore for Education