International Conference on Computer and Knowledge Engineering

Home / 14th International Conference on Computer and Knowledge Engineering

A Cloud Broker with Gap Analysis Perspective for Scheduling Multi-Workflows Across On-Demand and Reserved Resources

Authors :

Negin Shafinezhad¹ Hamidreza Abrishami² Saeid Abrishami³

1- Department of Computer Engineering Ferdowsi University of Mashhad Mashhad, Iran 2- Department of Computer Engineering Ferdowsi University of Mashhad Mashhad, Iran 3- Department of Computer Engineering Ferdowsi University of Mashhad Mashhad, Iran

Keywords :

Multi-workflow hybrid scheduling،workflow as a service broker،gap analysis،reserved resources،deadline constraint

Abstract :

The rapid growth in cloud services has led to the accessibility of Workflow-as-a-Service (WaaS) as the compatible platform for executing multiple workflows. Users desire to execute independent workflows with separate defined constraints in a shorter time and in a cost-efficient manner, while cloud service providers want to increase resource utilization during scheduling phases. Controlling gap spaces can help to achieve these aims, as gaps occur as idle time slots between prior scheduled tasks and the current task on paid resources, creating opportunities for executing more tasks. In this paper, we propose a WaaS broker with a gap analysis viewpoint as a third-party entity to mediate between users and service providers. This broker utilizes a hybrid scheduling method with static planning and dynamic scheduling for task assignments on reserved and on-demand resources under specified deadlines. It aims to reduce the execution cost by maximizing the utilization of reserved instances, which have lower costs. The static planner creates a cost-efficient primary scheduled map with minimum gap spaces, using a defined gap threshold parameter to control task assignment and estimate the number of on-demand resources required. The dynamic scheduler then uses the static scheduled map and considers uncertainties in task execution to perform real-time resource allocation and acquire new on-demand instances as needed. To evaluate the performance, we simulate numerous scenarios of scientific multi-workflows with different deadline constraints and workflow structures. The results show that the proposed broker can execute the maximum number of multi-workflows at minimum cost compared to state-of-the-art approaches, while maintaining high resource utilization.

Papers List

List of archived papers

LightFedSelect: A Lightweight Framework for Byzantine-Robust Federated Learning

Seyed Saeed Razavi - Seyed Arsalan Vasegh Rahim Parvar - Soroosh Dadashi Pakdeh - Mohammad Matin Rezaeifard - Morteza Mollaie Chafi - Reza Ebrahimi Atani

Object Detection on Detecting Skin Lesion using Dab-DETR

Sheida Shadman - Amirreza Rouhbakhshmeghrazi - Shayan Nalbandian - Bo Li - Shaghayegh Shadman - Malik Muhammad Owais Siddique

Novel Insights in Deep Learning for Predicting Climate Phenomena

Mohammad Naisipour - Saghar Ganji - Iraj Saeedpanah - Behnam Mehrakizadeh - Ahmad Reza Labibzadeh

A scalable blockchain-based educational network for data storage and assessment

Maryam Fattahi Vanani - Hamidreza Shayegh Borujeni - Ali Nourollah

Predicting the Recovery Rate of COVID-19 Using a Novel Hybrid Method

Fatemeh Ahouz - Ebrahim Sayahi

A Comprehensive Approach to SMS Spam Filtering Integrating Embedded and Statistical Features

Shaghayegh Hosseinpour - Mohammad Reza Keyvanpour

PeQa: a Massive Persian Quenstion-Answering and Chatbot Dataset

Fatemeh Zahra Arshia - Mohammad Ali Keyvanrad - Saeedeh Sadat Sadidpour - Sayyid Mohammad Reza Mohammadi

A Survey on Semi-Automated and Automated Approaches for Video Annotation

Samin Zare - Mehran Yazdi

Financial Market Prediction Using Deep Neural Networks with Hardware Acceleration

Dara Rahmati - Mohammad Hadi Foroughi - Ali Bagherzadeh - Mehdi Foroughi - Saeid Gorgin

AgeNet-AT: An End-to-End Model for Robust Joint Speaker Age Estimation and Gender Recognition Based on Attention Mechanism and Titanet

Mahsa Zamani Tarashandeh - Amirhossein Torkanloo - Mohammad Hossein Moattar