In the business Grid environment, the user should ask the broker to execute the workflow for him ... more In the business Grid environment, the user should ask the broker to execute the workflow for him and then pays the broker for the workflow execution service. As the sub-jobs of the workflow must be distributed over many Grid resource providers to ensure the QoS, the broker knows about all aspects of all service providers while it is difficult for user to have this information. Thus, there is an asymmetric information situation. The asymmetric information may bring a negative effect to the broker. This paper will analyze the asymmetric information issues and propose possible solutions to solve the problem.
International Journal of Parallel, Emergent and Distributed Systems, 2009
Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing.... more Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing. Among many system components for supporting SLA-aware Grid-based worko w, the SLA mapping mechanism receives a prominent position. It is responsible for assigning sub-jobs of the worko w to Grid resources in a way that meets the user's deadline and minimizes costs. Assuming many dieren
International Journal of Web and Grid Services, 2008
Supporting SLAs (Service Level Agreements) for Grid-based workflows requires providing mechanisms... more Supporting SLAs (Service Level Agreements) for Grid-based workflows requires providing mechanisms for handling errors (i.e., the failures of subjobs). In the context of this paper, we propose an error recovery mechanism which can handle one failed subjob of a workflow. The error recovery mechanism has a maximum of three phases, depending on the impact of the error. In each phase, we use a dedicated algorithm to remap the subjobs of the workflow to the resources. The main contributions of the paper are the error recovery mechanism for SLA-based workflows and the mapping algorithm G-map, which is used in the first phase of the recovery mechanism. The G-map remaps the groups of subjobs, which are directly affected by an error. The efficiency of the proposed algorithm is validated through simulation results.
2006 Fifth International Conference on Grid and Cooperative Computing (GCC'06), 2006
Service level agreements (SLAs) are currently one of the major research topics in grid computing.... more Service level agreements (SLAs) are currently one of the major research topics in grid computing. Among many system components for supporting of SLA-aware grid jobs, the SLA mapping mechanism receives important positions. It is responsible for assigning sub-jobs of the workflow to grid resource in a way that meet the user's deadline and as cheap as possible. With the distinguished workload and resource characteristics, mapping a heavy communication workflow within SLA context defines an unfamiliar problem and need a specific method to be solved. This paper presents the mapping algorithm, which can cope with the problem. Performance measurements deliver evaluation results on the quality and efficiency of the method
Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing.... more Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing. Among those system compo- nents that support SLA-aware Grid jobs, the SLA mapping mechanism has an important position. It is responsible for assigning sub-jobs of the worko w to Grid resources in a way that meets the user's dead- line and minimizes costs. Assuming many
This work addresses the problem of high energy consumption and carbon emissions by data centers w... more This work addresses the problem of high energy consumption and carbon emissions by data centers which support the traditional computing style. In order to overcome this problem we consider two allocation scenarios: single allocation and global optimization of available resources and propose the optimization algorithms. The main idea of these algorithms is to find a server in the data center with the lowest energy consumption and/or carbon emission based on current status of data center and service level agreement requirements, and move the workload there. The optimization algorithms are devised based on Power Usage Effectiveness (PUE) and Carbon Usage Effectiveness (CUE). The simulation results demonstrate that the proposed algorithms enable the saving in energy consumption from 10% to 31% and in carbon emission from 10% to 87%.
Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, 2010
The data Grids appear mostly in the scientific community but it is also necessary to have the dat... more The data Grids appear mostly in the scientific community but it is also necessary to have the data Grid in the industry sector. Applying the way of scientific data Grid to the industry brings many disadvantages such as expensive investment, not efficient usage and unfair sharing. This paper presents an alternative approach, an economic aware data Grid. The incentives of having an economic aware data Grid, the business model and the working mechanism are analyzed in depth.
In the business Grid environment, the business relationship between a customer and a service prov... more In the business Grid environment, the business relationship between a customer and a service provider should be clearly defined. The responsibility of each partner can be stated in the so-called Service Level Agreement (SLA). In the context of SLA-based workflows, the business model is an important factor to determine its job-resource-mapping policy. However, this aspect has not been described fully in the literature. This paper presents the business model of a system handling SLA-based workflow within the business Grid computing environment. From this business model, the mapping policy of the broker is derived. The experiment results show the impact of business models on the efficiency of mapping policies.
With the popularity of Grid-based workflow, ensuring the Quality of Service (QoS) for workflow by... more With the popularity of Grid-based workflow, ensuring the Quality of Service (QoS) for workflow by Service Level Agreements (SLAs) is an emerging trend in the business Grid. Among many system components for supporting SLAaware Grid-based workflow, the SLA mapping mechanism is allotted an important position as it is responsible for assigning sub-jobs of the workflow to Grid resources in a way that meets the user's deadline and minimizes costs. With many different kinds of sub-jobs and resources, the process of mapping a Grid-based workflow within an SLA context defines an unfamiliar and difficult problem. To solve this problem, this chapter describes related concepts and mapping algorithms.
2008 IEEE International Symposium on Parallel and Distributed Processing with Applications, 2008
Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing.... more Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing. Among many system components for supporting of SLA-aware Grid-based workflows, the SLA mapping module receives an important position. Mapping light communication workflows is one main part of the mapping module. With the previously proposed mapping algorithm, the mapping module may become the bottleneck of the system when many requests come in a short period of time. This paper presents a parallel mapping algorithm for light communication SLA-based workflows, which can cope with the problem. Performance measurements deliver evaluation results on the quality of the method.
2009 International Conference on Complex, Intelligent and Software Intensive Systems, 2009
Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing.... more Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing. Among many system components for supporting of SLA-aware Grid jobs, the SLA mapping module holds an important position. To find a mapping solution, the mapping algorithms have to search over a large search space. This situation leads to a compromise between the runtime of the algorithms and the quality of the mapping solutions. This paper presents a way of using parallelized mapping algorithms based on the proposed algorithms to improve the quality of the mapping solutions while maintaining the runtime of the mapping module. Performance measurements thereby deliver evaluation results showing the quality of the method.
Service Level Agreements (SLAs) is currently one of the major research topics in Grid Computing. ... more Service Level Agreements (SLAs) is currently one of the major research topics in Grid Computing. Among many system components for the supporting of SLA-aware Gridbased workflow, the SLA mapping module receives important positions. Optimizing execution time is an important task of the mapping module as it helps in finding out a feasible solution when the Grid is busy or by eliminating the negative effects of the error. With the previously proposed algorithm for optimizing the execution time of the workflow, the mapping module may, when many requests come in a short period of time, become the bottleneck of the system. This paper presents a parallel mapping algorithm for optimizing the execution time of the workflow, which can cope with the problem. Performance measurements deliver evaluation results on the quality of the method.
22nd International Conference on Advanced Information Networking and Applications - Workshops (aina workshops 2008), 2008
In the business Grid, the owner of a workflow is assumed to ask an SLA Workflow broker to execute... more In the business Grid, the owner of a workflow is assumed to ask an SLA Workflow broker to execute the workflow for him. The price for executing a workflow on the Grid is negotiated between the user and the broker. Determining a price that satisfies both, the user and the SLA workflow broker, is a difficult task. This paper proposes a method using bilateral bargaining game model based on fuzzy logic to determine the price that the user and the broker could accept after the first negotiation round. We also analyze many parameters affecting the price determination process. The validation results show that the approach is suitable with business rules.
In the Grid Computing environment, many users need the results of their calculations within a spe... more In the Grid Computing environment, many users need the results of their calculations within a specific period of time. Those users are willing to pay for getting their work completed on time. However, this requirement must be agreed on in a Service Level Agreement (SLA) by both, the user and the Grid provider, before the application is executed. In order to finish the workflow on time, sub-jobs of the workflow must be distributed to Grid resources. To free users from assigning sub-jobs of the workflow, it is necessary to have a SLA workflow broker. We introduce a set of business models that are based on incentive structure for users to consume the HPCC services, and for brokers to perform efficiently. The business model also leads to several economic issues. In particular, there is asymmetric information regarding the execution environment. The asymmetric information may have negative effect on the business relation between the broker and the user. We will analyze this effect. We also propose some possible solutions for the asymmetric information issue. They include the pricing/fining policy of the broker and the negotiation strategy between users and brokers.
2009 International Conference on Computational Science and Engineering, 2009
Mapping and running jobs on suitable resources are the core tasks in Grid Computing. In the algor... more Mapping and running jobs on suitable resources are the core tasks in Grid Computing. In the algorithm to map light communication Grid-based workflow within the SLA context, there is an operation of resolving the conflict period which is exact a 0/1 knapsack problem. When the size of the workflow is large such as in the case of mapping a group of workflows, the time to solve this problem is long and thus, makes the whole mapping process long. In this paper, we describe a way to solve this problem by exploiting the parallel computing power of Graphic Processing Unit (GPU) with Compute Unified Device Architecture (CUDA). The experiment shows that the approach is very efficient with huge problem.
21st International Conference on Advanced Networking and Applications (AINA '07), 2007
The error recovery mechanism receives an important position in the system supporting Service Leve... more The error recovery mechanism receives an important position in the system supporting Service Level Agreements (SLAs) for the Grid-based workflow. If one sub-job of the workflow is late, a group of directly affected sub-jobs should be re-mapped in a way that does not affect the start time of other sub-jobs in the workflow and is as inexpensive as possible. With the distinguished workload and resource characteristics as well as the goal of the problem, this problem needs new method to be solved. This paper presents a mapping algorithm, which can cope with the problem. Performance measurements deliver good evaluation results on the quality and efficiency of the method.
Handbook of Research on Scalable Computing Technologies
ABSTRACT This chapter describes the error recovery mechanisms in the system handling the Grid-bas... more ABSTRACT This chapter describes the error recovery mechanisms in the system handling the Grid-based workflow within the Service Level Agreement (SLA) context. It classifies the errors into two main categories. The first is the large-scale errors when one or several Grid sites are detached from the Grid system at a time. The second is the small-scale errors which may happen inside an RMS. For each type of error, the chapter introduces a recovery mechanism with the SLA context imposing the goal to the mechanisms. The authors believe that it is very useful to have an error recovery framework to avoid or eliminate the negative effects of the errors.
Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing.... more Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing. SLA negotiation protocols define a business relationship between consumer and provider and are thus a necessary part of any commercial Grid application. In the Grid environment, an SLA negotiation protocol for a workflow becomes complicated because of its structure which includes many dependent sub-jobs. The complex workflow model leads to several constraints compared with the case of single jobs and requires advanced solutions. As a continuous effort in building a full system supporting SLA for Grid workflows, this paper presents a SLA negotiation protocol for workflows and the initial system implementation.
The mapping of workflows on Grid resources differs from mapping a single job, as dependencies bet... more The mapping of workflows on Grid resources differs from mapping a single job, as dependencies between the subjobs has to be considered and resolved. This is a major task, if underlying Service Level Agreements (SLAs) have to be satisfied, which define the deadline for the entire workflow but also allow flexibility while assigning the subjobs to resources. Therefore, new requirements
In the business Grid environment, the user should ask the broker to execute the workflow for him ... more In the business Grid environment, the user should ask the broker to execute the workflow for him and then pays the broker for the workflow execution service. As the sub-jobs of the workflow must be distributed over many Grid resource providers to ensure the QoS, the broker knows about all aspects of all service providers while it is difficult for user to have this information. Thus, there is an asymmetric information situation. The asymmetric information may bring a negative effect to the broker. This paper will analyze the asymmetric information issues and propose possible solutions to solve the problem.
International Journal of Parallel, Emergent and Distributed Systems, 2009
Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing.... more Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing. Among many system components for supporting SLA-aware Grid-based worko w, the SLA mapping mechanism receives a prominent position. It is responsible for assigning sub-jobs of the worko w to Grid resources in a way that meets the user's deadline and minimizes costs. Assuming many dieren
International Journal of Web and Grid Services, 2008
Supporting SLAs (Service Level Agreements) for Grid-based workflows requires providing mechanisms... more Supporting SLAs (Service Level Agreements) for Grid-based workflows requires providing mechanisms for handling errors (i.e., the failures of subjobs). In the context of this paper, we propose an error recovery mechanism which can handle one failed subjob of a workflow. The error recovery mechanism has a maximum of three phases, depending on the impact of the error. In each phase, we use a dedicated algorithm to remap the subjobs of the workflow to the resources. The main contributions of the paper are the error recovery mechanism for SLA-based workflows and the mapping algorithm G-map, which is used in the first phase of the recovery mechanism. The G-map remaps the groups of subjobs, which are directly affected by an error. The efficiency of the proposed algorithm is validated through simulation results.
2006 Fifth International Conference on Grid and Cooperative Computing (GCC'06), 2006
Service level agreements (SLAs) are currently one of the major research topics in grid computing.... more Service level agreements (SLAs) are currently one of the major research topics in grid computing. Among many system components for supporting of SLA-aware grid jobs, the SLA mapping mechanism receives important positions. It is responsible for assigning sub-jobs of the workflow to grid resource in a way that meet the user's deadline and as cheap as possible. With the distinguished workload and resource characteristics, mapping a heavy communication workflow within SLA context defines an unfamiliar problem and need a specific method to be solved. This paper presents the mapping algorithm, which can cope with the problem. Performance measurements deliver evaluation results on the quality and efficiency of the method
Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing.... more Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing. Among those system compo- nents that support SLA-aware Grid jobs, the SLA mapping mechanism has an important position. It is responsible for assigning sub-jobs of the worko w to Grid resources in a way that meets the user's dead- line and minimizes costs. Assuming many
This work addresses the problem of high energy consumption and carbon emissions by data centers w... more This work addresses the problem of high energy consumption and carbon emissions by data centers which support the traditional computing style. In order to overcome this problem we consider two allocation scenarios: single allocation and global optimization of available resources and propose the optimization algorithms. The main idea of these algorithms is to find a server in the data center with the lowest energy consumption and/or carbon emission based on current status of data center and service level agreement requirements, and move the workload there. The optimization algorithms are devised based on Power Usage Effectiveness (PUE) and Carbon Usage Effectiveness (CUE). The simulation results demonstrate that the proposed algorithms enable the saving in energy consumption from 10% to 31% and in carbon emission from 10% to 87%.
Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, 2010
The data Grids appear mostly in the scientific community but it is also necessary to have the dat... more The data Grids appear mostly in the scientific community but it is also necessary to have the data Grid in the industry sector. Applying the way of scientific data Grid to the industry brings many disadvantages such as expensive investment, not efficient usage and unfair sharing. This paper presents an alternative approach, an economic aware data Grid. The incentives of having an economic aware data Grid, the business model and the working mechanism are analyzed in depth.
In the business Grid environment, the business relationship between a customer and a service prov... more In the business Grid environment, the business relationship between a customer and a service provider should be clearly defined. The responsibility of each partner can be stated in the so-called Service Level Agreement (SLA). In the context of SLA-based workflows, the business model is an important factor to determine its job-resource-mapping policy. However, this aspect has not been described fully in the literature. This paper presents the business model of a system handling SLA-based workflow within the business Grid computing environment. From this business model, the mapping policy of the broker is derived. The experiment results show the impact of business models on the efficiency of mapping policies.
With the popularity of Grid-based workflow, ensuring the Quality of Service (QoS) for workflow by... more With the popularity of Grid-based workflow, ensuring the Quality of Service (QoS) for workflow by Service Level Agreements (SLAs) is an emerging trend in the business Grid. Among many system components for supporting SLAaware Grid-based workflow, the SLA mapping mechanism is allotted an important position as it is responsible for assigning sub-jobs of the workflow to Grid resources in a way that meets the user's deadline and minimizes costs. With many different kinds of sub-jobs and resources, the process of mapping a Grid-based workflow within an SLA context defines an unfamiliar and difficult problem. To solve this problem, this chapter describes related concepts and mapping algorithms.
2008 IEEE International Symposium on Parallel and Distributed Processing with Applications, 2008
Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing.... more Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing. Among many system components for supporting of SLA-aware Grid-based workflows, the SLA mapping module receives an important position. Mapping light communication workflows is one main part of the mapping module. With the previously proposed mapping algorithm, the mapping module may become the bottleneck of the system when many requests come in a short period of time. This paper presents a parallel mapping algorithm for light communication SLA-based workflows, which can cope with the problem. Performance measurements deliver evaluation results on the quality of the method.
2009 International Conference on Complex, Intelligent and Software Intensive Systems, 2009
Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing.... more Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing. Among many system components for supporting of SLA-aware Grid jobs, the SLA mapping module holds an important position. To find a mapping solution, the mapping algorithms have to search over a large search space. This situation leads to a compromise between the runtime of the algorithms and the quality of the mapping solutions. This paper presents a way of using parallelized mapping algorithms based on the proposed algorithms to improve the quality of the mapping solutions while maintaining the runtime of the mapping module. Performance measurements thereby deliver evaluation results showing the quality of the method.
Service Level Agreements (SLAs) is currently one of the major research topics in Grid Computing. ... more Service Level Agreements (SLAs) is currently one of the major research topics in Grid Computing. Among many system components for the supporting of SLA-aware Gridbased workflow, the SLA mapping module receives important positions. Optimizing execution time is an important task of the mapping module as it helps in finding out a feasible solution when the Grid is busy or by eliminating the negative effects of the error. With the previously proposed algorithm for optimizing the execution time of the workflow, the mapping module may, when many requests come in a short period of time, become the bottleneck of the system. This paper presents a parallel mapping algorithm for optimizing the execution time of the workflow, which can cope with the problem. Performance measurements deliver evaluation results on the quality of the method.
22nd International Conference on Advanced Information Networking and Applications - Workshops (aina workshops 2008), 2008
In the business Grid, the owner of a workflow is assumed to ask an SLA Workflow broker to execute... more In the business Grid, the owner of a workflow is assumed to ask an SLA Workflow broker to execute the workflow for him. The price for executing a workflow on the Grid is negotiated between the user and the broker. Determining a price that satisfies both, the user and the SLA workflow broker, is a difficult task. This paper proposes a method using bilateral bargaining game model based on fuzzy logic to determine the price that the user and the broker could accept after the first negotiation round. We also analyze many parameters affecting the price determination process. The validation results show that the approach is suitable with business rules.
In the Grid Computing environment, many users need the results of their calculations within a spe... more In the Grid Computing environment, many users need the results of their calculations within a specific period of time. Those users are willing to pay for getting their work completed on time. However, this requirement must be agreed on in a Service Level Agreement (SLA) by both, the user and the Grid provider, before the application is executed. In order to finish the workflow on time, sub-jobs of the workflow must be distributed to Grid resources. To free users from assigning sub-jobs of the workflow, it is necessary to have a SLA workflow broker. We introduce a set of business models that are based on incentive structure for users to consume the HPCC services, and for brokers to perform efficiently. The business model also leads to several economic issues. In particular, there is asymmetric information regarding the execution environment. The asymmetric information may have negative effect on the business relation between the broker and the user. We will analyze this effect. We also propose some possible solutions for the asymmetric information issue. They include the pricing/fining policy of the broker and the negotiation strategy between users and brokers.
2009 International Conference on Computational Science and Engineering, 2009
Mapping and running jobs on suitable resources are the core tasks in Grid Computing. In the algor... more Mapping and running jobs on suitable resources are the core tasks in Grid Computing. In the algorithm to map light communication Grid-based workflow within the SLA context, there is an operation of resolving the conflict period which is exact a 0/1 knapsack problem. When the size of the workflow is large such as in the case of mapping a group of workflows, the time to solve this problem is long and thus, makes the whole mapping process long. In this paper, we describe a way to solve this problem by exploiting the parallel computing power of Graphic Processing Unit (GPU) with Compute Unified Device Architecture (CUDA). The experiment shows that the approach is very efficient with huge problem.
21st International Conference on Advanced Networking and Applications (AINA '07), 2007
The error recovery mechanism receives an important position in the system supporting Service Leve... more The error recovery mechanism receives an important position in the system supporting Service Level Agreements (SLAs) for the Grid-based workflow. If one sub-job of the workflow is late, a group of directly affected sub-jobs should be re-mapped in a way that does not affect the start time of other sub-jobs in the workflow and is as inexpensive as possible. With the distinguished workload and resource characteristics as well as the goal of the problem, this problem needs new method to be solved. This paper presents a mapping algorithm, which can cope with the problem. Performance measurements deliver good evaluation results on the quality and efficiency of the method.
Handbook of Research on Scalable Computing Technologies
ABSTRACT This chapter describes the error recovery mechanisms in the system handling the Grid-bas... more ABSTRACT This chapter describes the error recovery mechanisms in the system handling the Grid-based workflow within the Service Level Agreement (SLA) context. It classifies the errors into two main categories. The first is the large-scale errors when one or several Grid sites are detached from the Grid system at a time. The second is the small-scale errors which may happen inside an RMS. For each type of error, the chapter introduces a recovery mechanism with the SLA context imposing the goal to the mechanisms. The authors believe that it is very useful to have an error recovery framework to avoid or eliminate the negative effects of the errors.
Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing.... more Service Level Agreements (SLAs) are currently one of the major research topics in Grid Computing. SLA negotiation protocols define a business relationship between consumer and provider and are thus a necessary part of any commercial Grid application. In the Grid environment, an SLA negotiation protocol for a workflow becomes complicated because of its structure which includes many dependent sub-jobs. The complex workflow model leads to several constraints compared with the case of single jobs and requires advanced solutions. As a continuous effort in building a full system supporting SLA for Grid workflows, this paper presents a SLA negotiation protocol for workflows and the initial system implementation.
The mapping of workflows on Grid resources differs from mapping a single job, as dependencies bet... more The mapping of workflows on Grid resources differs from mapping a single job, as dependencies between the subjobs has to be considered and resolved. This is a major task, if underlying Service Level Agreements (SLAs) have to be satisfied, which define the deadline for the entire workflow but also allow flexibility while assigning the subjobs to resources. Therefore, new requirements
Uploads
Papers by Dang Ba Quan