Oregon State University

Calendar

Calendars

Event Details

MS Final Examination – Alex Wiggins


Monday, May 21, 2012 9:00 AM - 11:00 AM

Enhancing the Scalability of Memcached
Memcached is an open-source, multi-threaded, distributed, Key-Value caching solution commonly used for delivering software-as-a-service, reducing service latency and traffic to database and computational servers.  We introduce optimizations that overcome thread-scaling limitations of memcached, enabling effective utilization of high core-count servers. The approach employs parallel data structures and a modified cache replacement strategy to improve scalability. Parallel data structures enable concurrent lockless item retrieval and provide striped lock capability for hash table updates. The replacement strategy imposes a relaxed ordering of items based on relative timestamps. Rules for item insert, delete, and cache maintenance guarantee thread safety. A configurable cleaner thread operates autonomously, reducing lock requirements. The optimized application exhibits linear scalability, overcoming the limitations of the open-source version. In testing 16-core servers, throughput improved by 6X and performance/watt by more than 3X, while maintaining service-level agreements. Based on core scaling results, memcached will scale-up on subsequent many-core processors.

Major Advisor: Mike Bailey
Committee: Ron Metoyer
Committee: Mark Abbott


Kelley Engineering Center (campus map)
2114
Shannon Thompson
1 541 737 7234
shannon.thompson at oregonstate.edu
Sch Elect Engr/Comp Sci
This event appears on the following calendars: