Archiving digital content

Source: https://www.library.sydney.edu.au/support/publishing/archiving-digital-content Parent: https://www.library.sydney.edu.au/support/publishing/lodging-your-thesis-at-the-library

Archiving options for research data

The following table provides University of Sydney managed options for long-term preservation of research data.

The University also keeps a list of research data platforms that can be used for storing your data for active projects.

Archiving eNotebooks

For guidance on how to archive data from an eNotebook, see Archiving completed eNotebooks.

Organise your files

Give your files meaningful names and organise your content in a logical file structure. This is useful for active files that you are currently working with, and it is essential before publishing or archiving your content.

A well-organised folder structure can save you time and help other users to discover, understand and use your digital content.

Key considerations

• Keep any raw data in a separate folder from working data.
• Store any consent forms separately for ethics and privacy reasons.
• Nest your folders in the direction that best suits how you plan to use them, e.g. Location > Method > Date or Method > Date > Location.Don’t create too many empty folders ahead of time.
• Don’t manually change or delete file extensions (e.g. .docx, .pdf, .csv).
• Avoid using special characters  (e.g. \ / : * ? " < > |), apart from hyphens and underscores, in file names.
• Don’t make file names too long.

Helpful guidelines

• Guidance on organising digital content, UK Data Service
• Project TIER protocol for guidance on developing a folder structure

File naming

Select an appropriate naming convention for your files as early as possible and follow it consistently throughout your research or work.

Make sure your naming convention is documented in a README file before archiving or publishing your content.

Helpful guidelines

• TILS file naming convention, Queensland University of Technology
• Naming conventions, University of Edinburgh

File formats

Save your work in an appropriate file format to ensure long-term accessibility. The file formats you use when working with your data may not be appropriate for archiving or publishing purposes.

You should think about capturing data or converting files into formats that are:

• widely used within your discipline
• publicly documented, i.e. the complete file specification is publicly available
• open and non-proprietary
• endorsed by standards agencies such as the International Organisation for Standardization (ISO)
• self-documenting, i.e. the file itself can include useful metadata
• unencrypted
• uncompressed or that use lossless compression.

Recommended long-term formats

The following table provides general suggestions for file formats that enable long-term preservation of digital content.

For more specific recommendations, please contact the Library Digital Collections team. We can provide advice on:

• which file formats to use for long-term preservation, access, and sharing with collaborators
• when and how to convert to these formats.

Helpful guidelines

• Preferred forms for depositing data with Australian Data Archive
• National Archives of Australia’s preservation file formats
• Mendeley Data: File Formats
• UK Data Archive’s file formats table
• Library of Congress Recommended Formats Statement 2018-2019
• National Archives of America Tables of File Formats
• Sydney Conservatorium of Music Research Data Management Provisions 2015 (see “Schedule 4: Preferred file formats for audio visual and other data”)

Metadata

Metadata provides vital contextual information that will help others find, understand and reuse your content. Metadata may include:

• title
• creator(s)
• date produced/collected
• location
• abstract
• subject
• method
• process
• quality
• format
• rights
• ownership.

Consider using a metadata standard (also called a metadata schema), which is a defined set of fields that can either be general or discipline specific. Using a metadata standard will not only provide a rich description of your content, but also increase the likelihood of people finding it.

Helpful guidelines

• Australian National Data Standard (ANDS) metadata page
• Australian Research Data Commons (ARDC) metadata guide

Creating documentation

Once you’ve decided what metadata you need to collect and keep, you should record this information and store it with the digital content.

Some storage systems, like the University’s eNotebook, provide mechanisms for you to do this when you save your content.

In other storage systems, like the Research Data Store, you may have to record your metadata manually in a README document or using a version control table (.docx template).

Helpful guidelines

• Cornell University guide to writing “readme” metadata

Retention periods

Some digital content will have a legally mandated retention period. This is the minimum amount of time that you need to keep the content after its creation or the completion of a project.

Retention periods vary depending on the content and the context in which it was created, and you must keep your data forat leastas long as the legal retention requirement.

• Related information

How to submit to Sydney eScholarship Research data management Research Data Store Data retention periods

• Contact

For help with publishing data, contact Sydney eScholarship support. For help with digital preservation, contact the Digital Collections team.

Contact Sydney eScholarship support Contact Digital Collections team