> For the complete documentation index, see [llms.txt](https://compsci-hunter.gitbook.io/xie-research-group/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://compsci-hunter.gitbook.io/xie-research-group/hpc-environments/hpc-user-guide/workflow.md).

# Overall Workflow

The systems on the HPCs are all [Ubuntu](https://ubuntu.com/), which is a Linux operating system. The users should have the basic knowledge about using the Linux system. Information can be found on the [Linux Tutorial](https://compsci-hunter.gitbook.io/xie-research-group/useful-tutorials/linux-tutorial) page.

To have an overall understanding of how to run jobs on the HPCs, a workflow is shown below:

<table><thead><tr><th width="90.33333333333331">Step</th><th width="529">Work</th><th>Reference</th></tr></thead><tbody><tr><td>1</td><td>Connect to HPC</td><td><a href="https://compsci-hunter.gitbook.io/xie-research-group/hpc-environments/hpc-user-guide/connecting-to-hpcs">Page</a></td></tr><tr><td>2</td><td>Create a work directory of the job under <code>/raid/home/user_name</code> with needed codes and dataset</td><td><a href="https://compsci-hunter.gitbook.io/xie-research-group/hpc-environments/hpc-user-guide/user-directories">Page</a></td></tr><tr><td>3</td><td>Set up the computing environment (usually by using the Docker container image, Jupyter Notebook can also be used in Docker)</td><td><a href="https://compsci-hunter.gitbook.io/xie-research-group/useful-tutorials/docker-tutorial/use-docker-on-nvidia-gpu-cloud#use-ngc-service-on-hpcs">Page1</a>, <a href="https://compsci-hunter.gitbook.io/xie-research-group/useful-tutorials/jupyter-notebook-tutorial/run-jupyter-server-with-gpu-access-on-hpcs">Page2</a></td></tr><tr><td>4</td><td>Check the status of the HPC to decide the resources for running the job</td><td><a href="https://compsci-hunter.gitbook.io/xie-research-group/hpc-environments/hpc-user-guide/running-jobs#2-check-the-system-status">Page</a></td></tr><tr><td>5</td><td>Submit the job (usually with specified GPU or CPU)</td><td><a href="https://compsci-hunter.gitbook.io/xie-research-group/hpc-environments/hpc-user-guide/running-jobs#submit-a-job">Page</a></td></tr><tr><td>6</td><td>Monitor the job to avoid invalid runs</td><td><a href="https://compsci-hunter.gitbook.io/xie-research-group/hpc-environments/hpc-user-guide/running-jobs#monitor-a-job">Page</a></td></tr><tr><td>7</td><td>Backup your data if necessary</td><td><a href="https://compsci-hunter.gitbook.io/xie-research-group/hpc-environments/hpc-user-guide/data-backup">Page</a></td></tr></tbody></table>
