A Reinforcement Learning-Based Incentive Mechanism for Task Allocation Under Spatiotemporal Crowdsensing
Kaige Jiang, Yingjie Wang, Haipeng Wang, Zhaowei Liu, Qilong Han, Ao Zhou, Chaocan Xiang, Zhipeng Cai
Abstract
With the development of the Industrial Internet of Things (IoT), the work of large-scale data collection makes spatiotemporal crowdsensing (SC) play an important role. Mobile devices equipped with sensors could act as workers to collect and process data for uploading. In the task allocation process, a fully static allocation fails to meet the needs of realistic conditions, while a completely dynamic allocation fails to achieve the desired results. Therefore, we assume a task-scheduled execution scenario that combines the above two conditions. In the pre-allocation process, an original time location constraints (ORTA) allocation algorithm is first proposed. Then it is optimized (OPTA) to fully utilize the remaining time of the workers and increase the matched number. In addition, the design of the incentive mechanism is an effective means to improve the task completion rate of the platform. To efficiently utilize the limited platform budget in the long run, a Q-learning-based algorithm is proposed to identify target inspire tasks and subsequently increase their reward to attract workers’ participation. Finally, comparison experiments are conducted on real datasets to verify the effectiveness of our algorithm. Furthermore, the experiments on a Raspberry Pi local terminal are conducted under a satellite-based environment.