The Australian Digital Observatory offers a diverse catalogue of tools, datasets, documentation, and services from all partner institutions and infrastructures to support the research communities. The goal of these resources is to assist researchers through the time-consuming tasks of exploring, collecting, tidying and modelling, storing and organising, analysing, and publishing data that might require specific technical skills.
The Australian Twittersphere is a longitudinal, curated collection of tweets from approximately 838,000 Twitter accounts identified as ‘Australian’. The Digital Observatory has maintained reliable, ongoing data collection since early 2018, with approximately 22 million tweets being collected per month. There is also an archive of approximately 2 billion tweets from 2006 to 2016. The Digital Observatory currently collects approximately 41 million tweets per month.
As human lives are becoming more digitised now than ever, we see new forms of data, especially social media data and streaming data, increasingly incorporated in research endeavours. While there are standard practices regarding dealing with traditional research data, no such standards exist for these human-related dynamic digital data. This calls for a new data governance framework to guide researchers or anyone working with digital data.
youte is a command-line tool that collects and tidies YouTube video metadata and comments from YouTube Data API v.3. At the moment, the tool supports collecting public data that does not require OAuth 2.0.
