• eResearch
    • Collaborative Technologies
      • ARDC (Australian Research Data Commons)
      • ARDC Nectar Research Cloud
      • Australian Access Federation
      • QRIScloud
      • Video Collaboration
    • Data Management
      • Research Data Management Plans
    • Data Services
      • Australian and International Data Portals
      • CQUni Research Data Storage Options
      • CQUniversity Research Data Storage
      • GEOSCIENCE DATA PORTALS
    • eResearch and Security: MFA and CyberSafety
      • Encrypting Data on Portable Devices
      • Password best practices
    • High Performance Computing
      • The History of CQU’s HPC Facilities
        • Ada Lovelace Cluster (Current)
        • Marie Curie Cluster (Decommissioned)
        • Einstein Cluster (Decommissioned)
        • Isaac Newton HPC Facility (Decommissioned)
      • HPC User Guides and FAQs
        • Getting started on CQUniversity’s Ada Lovelace HPC System
        • Basics of working on the HPC
        • Connecting to HPC via CLI/SSH
        • Finding Installed Software
        • Graphical connection HPC via Open On Demand
        • HPC Collaboration
        • Simple Unix Commands
        • Slurm Commands
        • Software Module Information
        • Transferring Files to the HPC System (Ada)
        • Using Abaqus
        • Using ANSYS on the HPC System
        • Using HPC Scheduler on Ada Lovelace Cluster
        • Using MATLAB
        • Using R
        • Using Whisper to Transcribe audio on the HPC
        • Virtualisation and Containers
        • Creating a Conda Enviroment
        • LLM’s on Ada Cluster
        • Running Python on Ada
        • Machine and Deep Learning modules on Ada
        • PBS to Slurm Command tables (HPC Scheduler)
        • Compiling Programs (and using the optimization flags)
        • Frequently Asked Questions
        • HPC Trouble Shooting
      • HPC Community
      • HPC Related Links
      • HPC Sample Code Scripts
        • Multiple Job Submission – Slurm
        • Parameter sweep multiple job – Slurm
        • R Sample Scripts – Slurm
        • Sample Slurm CPU Submission Script
        • Sample Slurm GPU Submission Script
      • HPC Software
    • Research Software
    • Scholarly Communication
    • Survey Tools
    • Training
      • QCIF – Queensland Cyber Infrastructure Foundation
      • Teaching Lab Skills for Scientific Computing

eResearch

The HPC system is able to host project spaces with permissions linked to a Research Data Management plan for access. These spaces allow for easier collaboration and reduce the duplication of data across HPC users who are working together on the same data. This project space is created with a linked Research Data Storage share associated with the project.

It’s important to note that the data in these projects’ spaces on the HPC aren’t backed up, thus requiring to be saved elsewhere. Ideally data would be saved in the Research Storage Share associated with the Project space. The permissions for these project spaces are based on the Research Data Management Plan (RDMP) permissions for the allocated data storage share.  Thus, when giving access to data in the project space you are also giving access to data in your research storage.

By working in a shared HPC project directory rather than individual HPC home directories, multiple users can submit jobs, review results, and collaborate more effectively.

To get started on working in a project space on the HPC, reach out to the eResearch team with the research DMP number that you would use to be applied for the access /project directory permissions on the HPC system.  This process offers several advantages:

  • The project lead can add or remove user access to the HPC share via University Data storage permissions.
  • Each project already has an associated research share, so valuable data stored in the HPC project space can be copied to research storage for safe keeping and backups. (Note: HPC /project data will need to be manually copied/moved to the research share, but space is allocated for this purpose.)
  • Multiple shared HPC project spaces can be created, each with tailored access permissions.

If the above is useful for you, the next step is for you to confirm whether you’d like to:

  1. Use an existing research data management plan with defined user access permissions, or
  2. Create a new plan and set permissions accordingly.

The advantage and disadvantages of the two options have been outlined above.
Afterwards the Project Space will have the same name as the Research Data Share, and can be found under /project/*Share-name*

Support

eresearch@cqu.edu.au

tasac@cqu.edu.au OR 1300 666 620

Hacky Hour (3pm – 4pm every Tuesday)

High Performance Computing Teams site