Nightcore: efficient and scalable serverless computing for latency-sensitive, interactive microservices
Zhipeng Jia, Emmett Witchel
Abstract
The microservice architecture is a popular software engineering approach for building flexible, large-scale online services. Serverless functions, or function as a service (FaaS), provide a simple programming model of stateless functions which are a natural substrate for implementing the stateless RPC handlers of microservices, as an alternative to containerized RPC servers. However, current serverless platforms have millisecond-scale runtime overheads, making them unable to meet the strict sub-millisecond latency targets required by existing interactive microservices.
Topics & Concepts
MicroservicesComputer scienceStateless protocolScalabilityServerLatency (audio)Distributed computingOperating systemComputer networkCloud computingTelecommunicationsNetwork packetCloud Computing and Resource ManagementSoftware System Performance and ReliabilityIoT and Edge/Fog Computing