You are here

Regaining Control: Multi-Level Scheduling, Pilot-Jobs and a Fresh Perspective on Application Optimisation.

Pilot-jobs are an effective and widely-used concept to realise multi-level scheduling and user-space resource management in heterogeneous distributed environments. In the first part of our talk, we will give an overview of multi-level scheduling and pilot-jobs and discuss examples of how and under which circumstances different types of distributed applications can benefit from these. In the second part of our talk, we will introduce our ongoing research ideas by presenting a fresh perspective on transparent and automated application optimization on workload level. We will explore ideas how these concepts could be integrated into a multi-level scheduling framework as a way to allow distributed applications to execute more efficiently as well as a way to provide a practical experimental platform to explore optimization techniques in complex resource environments.

PDF icon PilotJobs.pdf7.26 MB
13 Apr 2012