A Parallel Communication Structure and Dynamic Message-Aware Communication Scheduler for Ceph Storage System
Ceph 스토리지 시스템의 성능 향상을 위한 구조 병렬화 및 동적 메시지 기반의 스케줄러
- 주제(키워드) Distributed Object Storage System , Ceph , Async Messenger , Message-Aware , Load Balancing , Parallel Communication Structure , Thread Scheduling
- 발행기관 서강대학교 일반대학원
- 지도교수 박성용
- 발행년도 2017
- 학위수여년월 2017. 2
- 학위명 석사
- 학과 및 전공 일반대학원 컴퓨터공학과
- 실제URI http://www.dcollection.net/handler/sogang/000000061323
- 본문언어 한국어
- 저작권 서강대학교 논문은 저작권보호를 받습니다.
초록/요약
With the proliferation of cloud computing technologies, the Ceph, a distributed objected-based storage system has been an attractive alternative to building a storage backend due to its excellent performance, reliability, and scalability. As the storage system processes huge amount data and the network traffic generated from the cloud increases rapidly, designing a high-performance messenger in the storage system has created a lot of challenging issues. One of Ceph's messengers, async messenger, is known for its efficient and flexible communication structure. However, to solve Ceph's network bottleneck, performance improvement of async messenger is essential. The async messenger's worker threads typically handle multiple connections at the same time, so there is a limit to handling multiple connections serially. It also schedules communication threads using a simple round-robin technique without considering the various workloads generated from multiple connections. This causes a load imbalance between the communication threads, degrading the performance of the Ceph storage system. This paper parallelizes the message reception process to use the messenger 's worker thread efficiently. Also, to solve the problem of load imbalance, this paper proposes a scheduling method using genetic algorithm. Finally, this paper improved the performance of the async messenger by combining the load balancing scheduling method and the parallel structure. As the result, async-read2-GA have 8∼20% higher performance than the existing async messenger.
more