NDSU CS Department Wiki

User Tools

Site Tools

Trace:
deptlab:usingthelab

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
deptlab:usingthelab [2024/11/04 21:52] – [GPU Computing] localadmindeptlab:usingthelab [2025/02/20 20:41] (current) – [Status] localadmin
Line 1: Line 1:
 ====== Using the 244 Lab ====== ====== Using the 244 Lab ======
  
-The Computer Science department Linux lab in IACC 244 is a 21 computer lab running Mint 21.1 x86_64 GNU/Linux with the [[http://mate-desktop.org/|MATE Desktop Environment]]. The lab is for learning Linux, running programs designed to be run in a Linux environment, and course projects. The lab can be accessed remotely using an SSH client ([[http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html|PuTTY]] for Windows or simply 'ssh' from Mac, Linux or BSD) or sitting down at the workstations in QBB 244. The lab is open 24/7 but does require key-card access via your NDSU ID card.+The Computer Science department Linux lab in IACC 244 is a 40 computer lab (lab00-lab39) running Ubuntu 24.04 x86_64 GNU/Linux with the [[http://mate-desktop.org/|MATE Desktop Environment]]. The lab is for learning Linux, running programs designed to be run in a Linux environment, and course projects. The lab can be accessed remotely using an SSH client ([[http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html|PuTTY]] for Windows or simply 'ssh' from Mac, Linux or BSD) or sitting down at the workstations in QBB 244. The lab is open 24/7 but does require key-card access via your NDSU ID card. Contact your instructor or advisor if you need access.
  
  
Line 7: Line 7:
  
 ===== Status ===== ===== Status =====
-  * Hadoop is up.+  * Hadoop is offline for security reasons.
   * Spark is up.   * Spark is up.
 +  * Lab13 is down.
 +  * Lan21 is down.
 ===== Accessing the Lab ===== ===== Accessing the Lab =====
  
Line 24: Line 26:
  
 /* Your username is your NDSU Unix ID, which can be found [[http://www.cs.ndsu.nodak.edu/tools/uid.php|here]]. */ /* Your username is your NDSU Unix ID, which can be found [[http://www.cs.ndsu.nodak.edu/tools/uid.php|here]]. */
-Your username and password is that of your **Bison Account** (formally your NDSU Account) and NOT that of your NDUS account. +Your username and password is that of your **Bison Account** (formally your NDSU Account) and NOT that of your NDUS account. It's format is first.last(.and maybe a number).
  
 If you have forgotten your password, you can reset [[https://apps.ndsu.edu/accounts/|it here]]. If ITS moves the link (they do rather often), ask at the help desk in QBB 150. I think the current rules are 14 chars, 1C, 1N, &, 1SC. /*  it <del>[[https://enroll.nodak.edu|here]]</del> <del>[[https://secure.ndus.nodak.edu/services/|or more probably here]]</del>. Lately it has been found <del>[[https://www.ndsu.edu/its/account_management/|here]]</del>. As of 2/1/2021 */ If you have forgotten your password, you can reset [[https://apps.ndsu.edu/accounts/|it here]]. If ITS moves the link (they do rather often), ask at the help desk in QBB 150. I think the current rules are 14 chars, 1C, 1N, &, 1SC. /*  it <del>[[https://enroll.nodak.edu|here]]</del> <del>[[https://secure.ndus.nodak.edu/services/|or more probably here]]</del>. Lately it has been found <del>[[https://www.ndsu.edu/its/account_management/|here]]</del>. As of 2/1/2021 */
Line 33: Line 35:
   * For Windows, you may want to use [[http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html|PuTTY]] as an [[cs101:sshfromwindows|SSH client]].   * For Windows, you may want to use [[http://www.chiark.greenend.org.uk/~sgtatham/putty/download.html|PuTTY]] as an [[cs101:sshfromwindows|SSH client]].
     * An even better Windows SSH client is [[https://mobaxterm.mobatek.net/|MobaXterm]], although the free version does have some annoyance features to encourage you to upgrade to the paid version.      * An even better Windows SSH client is [[https://mobaxterm.mobatek.net/|MobaXterm]], although the free version does have some annoyance features to encourage you to upgrade to the paid version. 
-    * Windows 10 (after the April 2018 update) now has a SSH Client, although it's not enabled by default.+    * Windows 10 (after the April 2018 update) now has a SSH Client, although it's not enabled by default on older releases. 
 +    * Windows Power Shell also supports SSH but its cut & paste functionality is not... optimal!
 ===== File Transfer (SCP) ===== ===== File Transfer (SCP) =====
  
 If you wish to upload/download files to your home directory (assignments, notes, etc.), you can do so using SCP. On Windows, [[http://winscp.net/eng/download.php|WinSCP]] works well. You simply connect, and drag your files over to copy them to the lab. If you wish to upload/download files to your home directory (assignments, notes, etc.), you can do so using SCP. On Windows, [[http://winscp.net/eng/download.php|WinSCP]] works well. You simply connect, and drag your files over to copy them to the lab.
-A command-line SCP application comes default with most Linux distributions.  [[cs101:scpfromlinux|Tutorial on using SCP from the Command Line.]]+A command-line SCP application comes default with most Linux distributions.  [[cs101:scpfromlinux|Tutorial on using SCP from the Command Line.]] Also FileZilla is quite common.
 ===== Programs/Services ===== ===== Programs/Services =====
  
Line 45: Line 48:
   * If using Python be sure to use Python Virtual Environments so you can install needed packages.  [[https://realpython.com/python-virtual-environments-a-primer/|Here's a tutorial]]. The system admin will NOT install packages for you.   * If using Python be sure to use Python Virtual Environments so you can install needed packages.  [[https://realpython.com/python-virtual-environments-a-primer/|Here's a tutorial]]. The system admin will NOT install packages for you.
  
- +==== Hadoop ==== 
-===== GPU Computing =====+The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. The Hadoop head node is zoidberg.cs.ndsu.nodak.edu 
 +==== Spark ==== 
 +Apache Spark™ is a multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters. The spark head node is spark.cs.ndsu.edu 
 +==== GPU Computing ====
 Labs 02-05 contain NVIDIA 24GB Tesla M40 GPU's (These are past current Tensorflow version support) and Labs 06-09 contain NVIDIA 16GB Tesla P100 GPU's. Labs 02-05 contain NVIDIA 24GB Tesla M40 GPU's (These are past current Tensorflow version support) and Labs 06-09 contain NVIDIA 16GB Tesla P100 GPU's.
  
Line 53: Line 59:
 Use responsibly.   Use responsibly.  
  
-===== MPI =====+==== MPI ====
 MPICH is installed in the lab. MPICH is a high-performance and widely portable implementation of the  MPI-3.1 standard from the Argonne National Laboratory. It supports different computation and communication platforms including commodity clusters, SMPs, massively parallel systems, and high-speed networks. MPICH is installed in the lab. MPICH is a high-performance and widely portable implementation of the  MPI-3.1 standard from the Argonne National Laboratory. It supports different computation and communication platforms including commodity clusters, SMPs, massively parallel systems, and high-speed networks.
  
Line 59: Line 65:
 ===== Storage ===== ===== Storage =====
  
-Your home directory (/home/<username>) is stored on a Network File Server, and is mounted on all 21 machines, so your files are available everywhere. Quotas are not enforced, just try to be responsible with space usage.+Your home directory (/home/<username>) is stored on a Network File Server (NFS), and is mounted on all 40 machines, so your files are available everywhere. Quotas are not enforced, just try to be responsible with space usage.
  
-If your program or research experiment requires high levels of file IO, we ask that you do not use the NFS server for this (you will destroy performance across the lab, plus it will be slow for your experiment).  If you require faster storage, contact [[support@cs.ndsu.edu]] and we can grant you access to local storage on each box.+If your program or research experiment requires high levels of file IO, we ask that you **do not use** the NFS server for this (you will destroy performance across the lab, plus it will be slow for your experiment).  If you require faster storage, contact [[support@cs.ndsu.edu]] and we can grant you access to local storage on each box.
  
 ===== Fair Use of the 244 Lab ===== ===== Fair Use of the 244 Lab =====
Line 68: Line 74:
   - Don't do anything illegal.  Just don't.   - Don't do anything illegal.  Just don't.
   - <color #ed1c24>**Log off when you're done**</color>. Don't just lock the screen unless you're returning shortly. Too many people doing that can waste a lot of resources and in-lab classes have priority access.   - <color #ed1c24>**Log off when you're done**</color>. Don't just lock the screen unless you're returning shortly. Too many people doing that can waste a lot of resources and in-lab classes have priority access.
-  - Don't power off the workstations. Other users may be logged into the machines or want remote access.+  - <color #ed1c24>**Don't power off the workstations.**</color> Other users may be logged into the machines or want remote access.
   - Don't unplug monitors, workstations, or other equipment. Students need the lab to function properly when you leave, so please leave the environment like you found it. Especially remember that students may be working on assignments remotely, so unplugging a machine will result in them losing their work.   - Don't unplug monitors, workstations, or other equipment. Students need the lab to function properly when you leave, so please leave the environment like you found it. Especially remember that students may be working on assignments remotely, so unplugging a machine will result in them losing their work.
   - Don't use up all the resources. Again, the lab is shared, so if you're running an experiment that uses up all the CPU/memory on the machines, you are making it difficult for students to complete their work. If this becomes a problem, the Administrator will lock your account. If you are a student and have large CPU/memory/disk requirements for your research, coordinate with your adviser and department Systems Administrator.   - Don't use up all the resources. Again, the lab is shared, so if you're running an experiment that uses up all the CPU/memory on the machines, you are making it difficult for students to complete their work. If this becomes a problem, the Administrator will lock your account. If you are a student and have large CPU/memory/disk requirements for your research, coordinate with your adviser and department Systems Administrator.
Line 76: Line 82:
 In the lab, you can put files in your public_html directory, they will be served out at http://students.cs.ndsu.nodak.edu/~yourusername/. In the lab, you can put files in your public_html directory, they will be served out at http://students.cs.ndsu.nodak.edu/~yourusername/.
  
-You will use this directory for certain courses.  You're also welcome to use it for small scale private hosting.+You will use this directory for certain courses.  You're also welcome to use it for small scale private hosting. Don't post Personal Identifiable Information (PII)!
  
  
Line 87: Line 93:
 To fix this you will need to log in via SSH and delete old x2go session information from your home directory. To fix this you will need to log in via SSH and delete old x2go session information from your home directory.
  
-Maximum session idle time is **three** days.+Maximum session idle time is **three** days, before sessions will be purged.
  
-**Note:** Some graphical applications do not like to work via x2go. GoogleEarth for example.+**Note:** Some graphical applications do not like to work via x2go. GoogleEarth for example. Also GPU compute applications often run faster via a SSH text connection.
  
 **Note:** X2go usually works. If it doesn't... **Note:** X2go usually works. If it doesn't...
Line 98: Line 104:
   * You can run x2go in debug mode to see a log file that may provide some clues as to what is wrong on your end. If you don't see debug mode, reinstall x2go.    * You can run x2go in debug mode to see a log file that may provide some clues as to what is wrong on your end. If you don't see debug mode, reinstall x2go. 
  
 +X2go install on a Mac is a bit different. It requires Xquartz to be installed. https://wiki.cs.ndsu.nodak.edu/doku.php?id=helpdocs:x2go:windows&s[]=x2go#x2go_on_mac It usually works but sometimes it doesn't and neither Google or I have been able to determine why.
 +
 +x2go is also available for Linux and can sometimes be made to work on a Chromebook.
 ===== Help! ===== ===== Help! =====
  
 If you need help using the 244 lab. **Contact your instructor or academic advisor**. If you need help using the 244 lab. **Contact your instructor or academic advisor**.
deptlab/usingthelab.1730757156.txt.gz · Last modified: by localadmin