Profiling Hyperscale Big Data Processing
Abraham Gonzalez, Aasheesh Kolli, Samira Khan, Sihang Liu, Vidushi Dadu, Sagar Karandikar, Jichuan Chang, Krste Asanović, Parthasarathy Ranganathan
Abstract
Computing demand continues to grow exponentially, largely driven by "big data" processing on hyperscale data stores. At the same time, the slowdown in Moore's law is leading the industry to embrace custom computing in large-scale systems. Taken together, these trends motivate the need to characterize live production traffic on these large data processing platforms and understand the opportunity of acceleration at scale.
Topics & Concepts
Big dataComputer scienceProfiling (computer programming)Data processingData scienceDatabaseData miningOperating systemCloud Computing and Resource ManagementAdvanced Data Storage TechnologiesParallel Computing and Optimization Techniques