Multiagent Actor-Critic Network-Based Incentive Mechanism for Mobile Crowdsensing in Industrial Systems

Bo Gu, Xinxin Yang, Ziqi Lin, Weiwei Hu, Mamoun Alazab, Rupak Kharel

Research output: Contribution to journalArticlepeer-review

39 Citations (Scopus)


Mobile crowdsensing (MCS) is an appealing sensing paradigm that leverages the sensing capabilities of smart devices and the inherent mobility of device owners to accomplish sensing tasks with the aim of constructing powerful industrial systems. Incentivizing mobile users (MUs) to participate in sensing activities and contribute high-quality data is of paramount importance to the success of MCS services. In this article, we formulate the competitive interactions between a sensing platform (SP) and MUs as a multistage Stackelberg game with the SP as the leader player and the MUs as the followers. Given the unit prices announced by MUs, the SP calculates the quantity of sensing time to purchase from each MU by solving a convex optimization problem. Then, each follower observes the trading records and iteratively adjusts their pricing strategy in a trial-and-error manner based on a multiagent deep reinforcement learning algorithm. Simulation results demonstrate the efficiency of the proposed method.

Original languageEnglish
Article number9201550
Pages (from-to)6182-6191
Number of pages10
JournalIEEE Transactions on Industrial Informatics
Issue number9
Early online date21 Sep 2020
Publication statusPublished - 1 Sep 2021
Externally publishedYes

Cite this