You are here

Data-Intensive Architecture for Scientific Knowledge Discovery

TitleData-Intensive Architecture for Scientific Knowledge Discovery
Publication TypeJournal Article
Year of Publication2012
AuthorsAtkinson, MP, Liew, CS, Galea, M, Martin, P, Krause, A, Mouat, A, Corcho, O, Snelling, D
Journal TitleDistributed and Parallel Databases
KeywordsKnowledge discovery, workflow management system

This paper presents a data-intensive architecture that demonstrates the ability to support applications from a wide range of application domains, and support the different types of users involved in defining, designing and executing data-intensive processing tasks. The prototype architecture is introduced, and the pivotal role of DISPEL as a canonical language is explained. The architecture promotes the exploration and exploitation of distributed and heterogeneous data and spans the complete knowledge discovery process, from data preparation, to analysis, to evaluation and reiteration. The architecture evaluation included large-scale applications from astronomy, cosmology, hydrology, functional genetics, imaging processing and seismology.