User Tools

Site Tools


deptlab:spark

This is an old revision of the document!


Using Apache Spark in the CS Dept Lab

Spark 3.1.1 is installed in the CS Dept. Lab in the folder: /usr/lib/spark. You'll find the Spark binaries and scripts at /usr/lib/spark/bin. Spark is currently configured to use six worker nodes.

If you are a member of the 'spark_users' group, you will be able to access Spark to submit new jobs. Jobs MUST be submitted to the head node (spark.cs.ndsu.edu).

The Spark web interface is here Spark Master and available only from NDSU CS Department/Lab computers.

deptlab/spark.1636997487.txt.gz · Last modified: 2021/11/15 11:31 by localadmin