International Conference on Computer and Knowledge Engineering

Home / 14th International Conference on Computer and Knowledge Engineering

A Cloud Broker with Gap Analysis Perspective for Scheduling Multi-Workflows Across On-Demand and Reserved Resources

Authors :

Negin Shafinezhad¹ Hamidreza Abrishami² Saeid Abrishami³

1- Department of Computer Engineering Ferdowsi University of Mashhad Mashhad, Iran 2- Department of Computer Engineering Ferdowsi University of Mashhad Mashhad, Iran 3- Department of Computer Engineering Ferdowsi University of Mashhad Mashhad, Iran

Keywords :

Multi-workflow hybrid scheduling،workflow as a service broker،gap analysis،reserved resources،deadline constraint

Abstract :

The rapid growth in cloud services has led to the accessibility of Workflow-as-a-Service (WaaS) as the compatible platform for executing multiple workflows. Users desire to execute independent workflows with separate defined constraints in a shorter time and in a cost-efficient manner, while cloud service providers want to increase resource utilization during scheduling phases. Controlling gap spaces can help to achieve these aims, as gaps occur as idle time slots between prior scheduled tasks and the current task on paid resources, creating opportunities for executing more tasks. In this paper, we propose a WaaS broker with a gap analysis viewpoint as a third-party entity to mediate between users and service providers. This broker utilizes a hybrid scheduling method with static planning and dynamic scheduling for task assignments on reserved and on-demand resources under specified deadlines. It aims to reduce the execution cost by maximizing the utilization of reserved instances, which have lower costs. The static planner creates a cost-efficient primary scheduled map with minimum gap spaces, using a defined gap threshold parameter to control task assignment and estimate the number of on-demand resources required. The dynamic scheduler then uses the static scheduled map and considers uncertainties in task execution to perform real-time resource allocation and acquire new on-demand instances as needed. To evaluate the performance, we simulate numerous scenarios of scientific multi-workflows with different deadline constraints and workflow structures. The results show that the proposed broker can execute the maximum number of multi-workflows at minimum cost compared to state-of-the-art approaches, while maintaining high resource utilization.

Papers List

List of archived papers

Adaptive Active Queue Management for Time Slot Channel Hopping in Industrial Internet of Things

Mehdi Zirak - Yasser Sedaghat - Mohammad Hossein Yaghmaee Moghaddam

To Transfer or Not To Transfer (TNT): Action Recognition in Still Image Using Transfer Learning

Ali Soltani Nezhad - Hojat Asgarian Dehkordi - Seyed Sajad Ashrafi - Shahriar Baradaran Shokouhi

Using Deep Learning for Classification of Lung Cancer on CT Images in Ardabil Province

Mohammad Ali Javadzadeh Barzaki - Jafar Abdollahi - Mohammad Negaresh - Maryam Salimi - Hadi Zolfeghari - Mohsen Mohammadi - Asma Salmani - Rona Jannati - Firouz Amani

Swin-RSCBNet: A Transformer-Based Network for Skin Cancer Segmentation with Multi-Scale and Attention Modules

Benyamin Mirab Golkhatmi - Mostafa Heydari - Mahboobeh Houshmand - Seyyed Abed Hosseini

Reliability Evaluation of 4:2 Compressors Based on Hammock Networks

Farshad Safaei - Mohammad mahdi Emadi Kouchak - Sara Talebpour

GAP: Fault tolerance Improvement of Convolutional Neural Networks through GAN-aided Pruning

Pouya Hosseinzadeh - Yasser Sedaghat - Ahad Harati

Compressing Deep Neural Networks Using Explainable AI

Kimia Soroush - Mohsen Raji - Behnam Ghavami

Semi-automatic Detection of Persian Stopwords using FastText Library

Mohammad Dehghani - Mohammad Manthouri

Developing Convolutional Neural Networks using a Novel Lamarckian Co-Evolutionary Algorithm

Zaniar Sharifi - Khabat Soltanian - Ali Amiri

Adaptive Pattern Reconstruction Using Linear Regression for Improved TPS Anomaly Detection

Ali Azarsina - Alireza Safarzadeh - MohammadReza Jamali - Abdolhossein Vahabie