Agent-Based Simulation of Enterprise Entrepreneurship and Innovation Based on DQN
LI Rui1, WANG Zheng1,2
1.Key Laboratory of Geographical Information Science, Ministry of State Education of China, East China Normal University, Shanghai 200241, China; 2.Institute of Policy and Management Science, Chinese Academy of Sciences, Beijing 100080, China
Abstract：Based on ACE (Agent-based Computational Economics), this paper uses an agent-based model to build an economic system model based on enterprise behavior, and tries to solve the dynamic problem and policy problem of combining enterprise innovation with entrepreneurship. In the economic system of enterprise entrepreneurship and innovation constructed in this paper, the agent behavior algorithm, which acts as the enterprise agent, adopts the artificial intelligence DQN algorithm for self-adaptive simulation. The simulation results show that compared with the enterprise agent without self-adaptive behavior, the enterprise agent with self-adaptive behavior is able to make correct business decisions by evaluating the environment and its own state.
李睿, 王铮. 基于DQN的企业创业创新自主体模拟[J]. 复杂系统与复杂性科学, 2019, 16(1): 43-53.
LI Rui, WANG Zheng. Agent-Based Simulation of Enterprise Entrepreneurship and Innovation Based on DQN. Complex Systems and Complexity Science, 2019, 16(1): 43-53.
Bargigli,Leonardo,Tedeschi, et al. Major trends in agent-based economics[J]. Journal of Economic Interaction & Coordination, 2013, 8(2): 211217.
[2]
Tesfatsion L. Guest editorial agent-based modeling of evolutionary economic systems[J]. Ieee Transactions on Evolutionary Computation, 2001, 5(5): 437441.
[3]
Wang Z,Liu T,Dai X. Effect of policy and entrepreneurship on innovation and growth: an agent-based simulation approach[J]. Proceedings of Japan Society of Regional Science, 2010, 40(1): 1926.
Bures V,Tucnik P. Complex agent-based models: application of a constructivism in the economic research[J]. E+ M Ekonomie a Management, 2014, 17(3): 152168.
[6]
Monett D,Navarro-barrientos JE. Simulating the fractional reserve banking using agent-based modelling with Netlogo[C]∥Procedings of the 2016 Federated Comference on Computer Science and Information Systems (Fed CSIS). Gdańsk, Poland: IEEE, 2016: 14671470.
[7]
Kouwenberg R,Zwinkels RC. Endogenous price bubbles in a multi-agent system of the housing market[J]. Plos One, 2015, 10(6): e0129070.
[8]
Chen S. An Evolutionary game study of an ecological industry chain based on multi-agent simulation: a case study of the poyang lake eco-economic zone[J]. Sustainability, 2017, 9(7): 1165.
[9]
Tang L,Wu J,Yu L, et al. Carbon emissions trading scheme exploration in China: a multi-agent-based model[J]. Energy Policy, 2015, 81: 152169.
[10]
Zhang J. Growing silicon valley on a landscape: an agent-based approach to high-tech industrial clusters[J]. Journal of Evolutionary Economics, 2003, 13(5): 529548.
[11]
戴霄晔,刘涛,王铮. 面向产业创业创新政策模拟的ABS系统开发[J]. 复杂系统与复杂性科学, 2007, 4(2): 6270.Dai Xiaoye, Liu Tao, Wang Zheng. Start-ups technology strategy oriented agent-based simulation system development[J]. Complex Systems and Complexity Science, 2007, 4(2): 6270.
[12]
Cjch W,Dayan P. Q-learning[J]. Machine Learning, 1992, 8(3): 279292.
[13]
Mnih V,Kavukcuoglu K,Silver D, et al. Playing atari with deep reinforcement learning[DB/OL].[2018-08-03] .http:∥arxiv.org/abs/1312.5602VI.
[14]
Mnih V,Kavukcuoglu K,Silver D, et al. Human-level control through deep reinforcement learning.[J]. Nature, 2015, 518(7540): 529.
[15]
Van Hasselt H,Guez A,Silver D. Deep Reinforcement Learning with Double Q-learning[DB/OL].[2018-08-03] .http:∥arxiv.org/abs/1509.06461.
[16]
Schaul T,Quan J,Antonoglou I, et al. Prioritized experience replay[DB/OL].[2018-08-03] .http:∥arxiv.org/abs/1511.05952.
[17]
Wang Z,Schaul T,Hessel M, et al. Dueling network architectures for deep reinforcement learning[DB/OL].[2018-08-03] .http:∥arxiv.org/abs/1511.06581.
[18]
Thrun S,Schwartz A. Issues in using function approximation for reinforcement learning[J]. Proceedings of the Fourth Connectionist Models Summer School.Hillsdale, NJ, USA: Lawrence Erlbaum Publiher,1993.
