Effective Data Visualisations with Kibana Dashboards for CRAMS

Data mining or extraction of patterns and useful information from data has been around the Software space for a long time, especially in the financial and retail sectors. Analysis of data for mining is an iterative process where different views are built and refined.

In the e-Research space, infrastructure can provide raw information on usage which can be visualized with tools. However, linking this information with meta-data related to users, research domains, funding, publications etc., requires integration with meta-data management systems. Monash eResearch has developed CRAMS ( Cloud Resource Allocation Management System) which provides an effective self service mechanism for researchers and research facilities to request cloud resources, monitor usage and manage own allocations.

As part of CRAMs, a dashboard was built for the Monash Research Data storage team to visualize usage information at individual project level and at faculty level. While this is useful, a lot more can be done by integrating raw data captured by CRAMS with infrastructure and other available data sources. Software developers manage models of data and write tools to specific requirements, it would be a waste of resources to rely on them to do data analysis.

In this presentation we discuss how we intend to leverage ElasticSearch/Kibana together with data extracted from CRAMS to generate effective data visualisations that’ll provide management insights centered around research data.

https://conference.eresearch.edu.au/2020/09/effective-data-visualisations-with-kibana-dashboards-for-crams/