deptlab:spark
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| deptlab:spark [2023/12/01 21:20] – [Using Apache Spark in the CS Dept Lab] localadmin | deptlab:spark [2024/09/05 16:04] (current) – [Firewall info] localadmin | ||
|---|---|---|---|
| Line 8: | Line 8: | ||
| Spark documentation for 3.5.0 can be found here https:// | Spark documentation for 3.5.0 can be found here https:// | ||
| - | The spark master status page can be found at http:// | ||
| ===== Status pages ===== | ===== Status pages ===== | ||
| Line 18: | Line 17: | ||
| ===== Firewall info ===== | ===== Firewall info ===== | ||
| - | The head node is firewalled such that Spark status links are ONLY accessible from ND state networks. The head node, Zoidberg, | + | The head node is firewalled such that Spark status links are ONLY accessible from /* ND state */ CS Dept networks. The Spark head node can be accessed via SSH from anywhere (**not being blocked from your home country or ISP**), so job submission is possible from outside of these networks, but it is currently not possible to view the status pages for security purposes. |
| ===== Spark Components ===== | ===== Spark Components ===== | ||
| The current version of Spark installed does NOT support HDSF | The current version of Spark installed does NOT support HDSF | ||
deptlab/spark.1701465601.txt.gz · Last modified: by localadmin
