Abstract: As the number of services and the size of data involved in workflows increases, centralised orchestration techniques are reaching the limits of scalability. When coordinating Web services a standard orchestration model needs to pass all data through a centralised engine, which results in unnecessary data transfer and the engine to become a bottleneck to the execution of a workflow.
This talk introduces a lightweight Web services proxy architecture that maintains the robustness and simplicity of centralised orchestration, but allows services to exchange data directly with one another. Performance analysis concludes that our architecture's optimised model of data transport speeds up the execution time of workflows, consistently outperforms standard orchestration and scales with data and node size. Our architecture has direct application to workflows that move large quantities of data between services, such scenarios are commonly found in the biomedical sciences.
Slides: [here]