User Tools

Site Tools


deptlab:spark

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
deptlab:spark [2023/12/01 15:20] – [Using Apache Spark in the CS Dept Lab] localadmindeptlab:spark [2024/09/05 11:04] (current) – [Firewall info] localadmin
Line 8: Line 8:
 Spark documentation for 3.5.0 can be found here https://spark.apache.org/docs/3.5.0/  Spark documentation for 3.5.0 can be found here https://spark.apache.org/docs/3.5.0/ 
  
-The spark master status page can be found at http://spark.cs.ndsu.edu:8080/ 
  
 ===== Status pages ===== ===== Status pages =====
Line 18: Line 17:
 ===== Firewall info ===== ===== Firewall info =====
  
-The head node is firewalled such that Spark status links are ONLY accessible from ND state networks. The head node, Zoidberg, can be accessed via SSH from anywhere (**not being blocked from your home country or ISP**), so job submission is possible from outside of these networks, but it is currently not possible to view the status pages. +The head node is firewalled such that Spark status links are ONLY accessible from /* ND state */ CS Dept networks. The Spark head node can be accessed via SSH from anywhere (**not being blocked from your home country or ISP**), so job submission is possible from outside of these networks, but it is currently not possible to view the status pages for security purposes
  
 ===== Spark Components ===== ===== Spark Components =====
  
 The current version of Spark installed does NOT support HDSF The current version of Spark installed does NOT support HDSF
deptlab/spark.1701465601.txt.gz · Last modified: 2023/12/01 15:20 by localadmin