μManycore: A Cloud-Native CPU for Tail at Scale
Jovan Stojkovic, C.Richard Liu, Muhammad Shahbaz, Josep Torrellas
Abstract
Microservices are emerging as a popular cloud-computing paradigm. Microservice environments execute typically-short service requests that interact with one another via remote procedure calls (often across machines), and are subject to stringent tail-latency constraints. In contrast, current processors are designed for traditional monolithic applications. They support global hardware cache coherence, provide large caches, incorporate microarchitecture for long-running, predictable applications (such as advanced prefetching), and are optimized to minimize average latency rather than tail latency.
Topics & Concepts
Computer scienceMicroservicesLatency (audio)Cloud computingCacheCache coherenceMicroarchitectureParallel computingInstruction setDistributed computingOperating systemCPU cacheEmbedded systemCache algorithmsTelecommunicationsCloud Computing and Resource ManagementSoftware System Performance and ReliabilityParallel Computing and Optimization Techniques