BitDew : Data management and distribution service

Asia/Shanghai
202 (Computing Center, Institute of High Energy Physics)

202

Computing Center, Institute of High Energy Physics

19B Yuquan Road, Shijingshan District, Beijing 100049 北京市石景山区玉泉路19号乙院
Fabio Hernandez (IHEP & IN2P3) , Gang Chen (IHEP)
Description
By José Francisco SARAY The BitDew framework is a programmable environment for management and distribution of data for Grid, Desktop Grid and Cloud Systems. BitDew is a subsystem which can be easily integrated into large scale computational systems (XtremWeb, BOINC, Hadoop, Condor, gLite, Unicore etc..). Our approach is to break the "data wall" by providing in single package the key P2P technologies (DHT, BitTorrent) and high level programming interfaces. We first target Desktop Grid with peta-scale data system: up to 1K files/nodes, with size up to 1GB and distributed to 10K to 100K nodes. BitDew是一个用于网格及云计算系统数据分发与管理的可编程框架环境。BitDew采用DHT及BitTorrent等P2P技术和高级编程接口方便地与大规模计算系统(如XtremWeb, BOINC, Hadoop, Condor, gLite, Unicore等)进行整合。BitDew可实现管理多达十万个节点组成的大型桌面网格系统,并可向每个节点分发一千个1GB的文件。
Slides
The agenda of this meeting is empty