deptlab:spark
Differences
This shows you the differences between two versions of the page.
Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
deptlab:spark [2023/12/01 15:20] – [Using Apache Spark in the CS Dept Lab] localadmin | deptlab:spark [2024/09/05 11:04] (current) – [Firewall info] localadmin | ||
---|---|---|---|
Line 8: | Line 8: | ||
Spark documentation for 3.5.0 can be found here https:// | Spark documentation for 3.5.0 can be found here https:// | ||
- | The spark master status page can be found at http:// | ||
===== Status pages ===== | ===== Status pages ===== | ||
Line 18: | Line 17: | ||
===== Firewall info ===== | ===== Firewall info ===== | ||
- | The head node is firewalled such that Spark status links are ONLY accessible from ND state networks. The head node, Zoidberg, | + | The head node is firewalled such that Spark status links are ONLY accessible from /* ND state */ CS Dept networks. The Spark head node can be accessed via SSH from anywhere (**not being blocked from your home country or ISP**), so job submission is possible from outside of these networks, but it is currently not possible to view the status pages for security purposes. |
===== Spark Components ===== | ===== Spark Components ===== | ||
The current version of Spark installed does NOT support HDSF | The current version of Spark installed does NOT support HDSF |
deptlab/spark.1701465601.txt.gz · Last modified: 2023/12/01 15:20 by localadmin