CQUni Research Data Storage Options
Did you know that there are Federal Government Obligations, especially federal funding grants such as ARC and NHMRC, as well as CQ University Policy that requires research data to be managed and preserved at least 5 years? In some cases, particularly health and medical data, research data may need to be stored for 25 years or even longer!
Within CQUniversity, there are now a number of options to assist researchers with managing and preserving research data. In regards to research data management, it is suggested that you check out the ‘Research Data Management’ section of this website. A Research Data Management Plan is required to access CQUniversity’s Dedicated Local Research Data storage infrastructure.
Depending on the user case, research requirements and needs, there are a number of research data storage options that are available. The following table provides help to determine with solution is best for you.
| REQUIREMENTS | DEDICATED LOCAL RESEARCH DATA STORAGE SERVICE |
HIGH PERFORMANCE COMPUTING STORAGE (NOT SUITABLE FOR PERMANENT RESEARCH DATA STORAGE) |
QCIF QRISCLOUD | OneDrive |
| *DO YOU REQUIRE DATA STORAGE FOR ARCHIVING PURPOSES? | Y | N | Y | N |
| **ARE YOU WORKING WITH VERY LARGE DATASETS? | Y | Y | Y | N |
| ***ARE YOU USING ACTIVE DATA? | Y | Y | Y | Y |
| ARE YOU USING SENSITIVE DATA (EG, IDENTIFIABLE DATA, COMMERCIAL IN CONFIDENCE, ETC) |
Y |
Not Recommended | Not Recommended | Not Recommended |
| ARE YOU SHARING YOUR DATA WITH RESEARCHERS AT CQUNIVERSITY? | Y | Y | Y | Y |
| ARE YOU SHARING YOUR DATA WITH RESEARCHERS NOT AT CQUNIVERSITY? | Y | N | Y | Y |
| DO YOU REQUIRE REMOTE ACCESS? | Y (VPN required) |
Y |
Y | Y |
| DO YOU REQUIRE STORAGE THAT IS PHYSICALLY CLOSE TO COMPUTING FACILITIES FOR PROCESSING PURPOSES? | N | Y | Y | N |
Note
*Archiving purposes is data that requires permanent storage and will be stored and remain unchanged
**Large Data Set are considered to be more than 100GB’s of data
***Active data is the term given to a data set that is currently being used and produced as part of ongoing research – for example, data that is frequently accessed, modified and/or being added to.
| ABOUT | BENEFITS | LIMITATIONS | |
|---|---|---|---|
| DEDICATED LOCAL RESEARCH DATA STORAGE SERVICE | In early 2014, CQUni installed and commissioned our first dedicated research storage infrastructure providing significant storage capacity (over 100TB)Designed to store data which is actively being developed, as well as completed managed data collections (in particular, datasets that are confidential / non publishable)To gain access to this facility, you will need to fill out a Research Data Management Plan. | Data is stored at our local Campus, thus there are no data sovereignty issuesProvides access to significant amounts of storage capacity (e.g. 10 TB)Facilities are located behind our corporate firewalls, thus providing an extra layer of securityOnly CQUni staff have access to the servers (unlike what occurs with external cloud providers) | Extremely difficult to provide access to data for external collaborators |
| HIGH PERFORMANCE COMPUTING STORAGE | The HPC System is not designed to permanently store files and data, but rather to provide access to significant capacity near computing resources, thus allowing heavy processing, simulation and data analysis of any data stored on the system | Provides significant storage near computing high performance computing facilities | Not designed for permanent storage, nor for any other user case, other than to be used in conjunction with the HPC system |
| QCIF QRISCLOUD AND RDS STORAGE | QRISCloud and RDS Storage is designed to store large national “open” data collections considered to be of “national significance”QRISCloud is a data storage and cloud computing service run by the Queensland Cyber Infrastructure Foundation (QCIF). To apply for QRIScloud storage for your research data collection, contact TaSACMerit based allocation designed to store large national “open” data collections considered to be of “national significance”QRISCloud (Queensland Research and Innovation Services Cloud –http://www.qcif.edu.au/services/qriscloud) provides ‘RDSI’ data storage to the Queensland research community | QRISCloud also provides significate compute capability near this substantial storage capacityprovides the infrastructure to tackle research opportunities that ‘institutional’ facilities simply could not handleProvides data access to research communities, both nationally and internationallyAll data is kept ‘On-shore’ and stored on data centres throughout Australia, thus there are no data sovereignty issues | QCIF staff (system administrators) have access to the system, thus this external cloud provider can access your dataNot recommended for the storage for highly sensitive or confidential research data |
Research data is precious, therefore here are a few tips to ensure the safety and security of any research data:
- Researchers should always try to keep three copies of their research data
- At least two different copies should be stored in two separate geographical locations
- Storing data on services such as ‘Dropbox’ and other U.S. services, enables the U.S. Government access to the data due to the ‘patriot act’. Even if the data is hosted on a data centre outside of the United States
- Some ‘free’ services have been known to block accounts, in which major issues have arisen with retrieving the data hosted on these services.