Jobcast-parallel and distributed processing framework: data processing on a cloud style KVS database (インターネットアーキテクチャ)

概要

論文の詳細を見る
In this paper, we propose a new architecture for parallel and distributed processing framework, "Jobcast", which enables data processing on a cloud style KVS database. Nowadays, lots of KVS (as known as Key Value Store) systems exist which achieve high scalability for data spaces among a huge number of computers. Some of KVS implementations use "consistent hash" algorithm to identify the backend data node to store a pair of key and value. Jobcast also uses consistent hash algorithm for a distribution strategy and has a capability to store key and value pairs into huge number of computers as a KVS system. Furthermore, Jobcast also distributes "jobs" into data nodes for parallel and distributed processing. In this paper, we introduce a basic architecture of Jobcast and evaluate a data processing performance for a typical example.
社団法人電子情報通信学会の論文
2011-02-21