Energy-aware scheduling for spark job based on deep reinforcement learning in cloud
Hongjian Li, Liang Lu, Wenhu Shi, Gangfan Tan, Hao Luo
Topics & Concepts
Computer scienceReinforcement learningExecutorDistributed computingBig dataScheduling (production processes)Energy consumptionCloud computingSPARK (programming language)Service-level agreementEfficient energy useReal-time computingArtificial intelligenceOperating systemEngineeringLawOperations managementProgramming languageElectrical engineeringPolitical scienceCloud Computing and Resource ManagementIoT and Edge/Fog ComputingBlockchain Technology Applications and Security