Research on reinforcement learning negotiation strategy and its optimization

Abstract

Abstract: Reinforcement learning can help negotiation agent to select its best actions and reach its final goal. Agent of traditional reinforcement learning negotiation strategy significantly compromises at the beginning of negotiation, which is irrational, loses touch with reality, and greatly reduces expectation of Agent. Expectation restoration rate is used to restore the true expectations of agent to optimize the negotiation strategy；the impact of value of expectation restoration rate on negotiation process is discussed; experimental results show that optimized negotiation strategy improves the quality of the negotiation result, while ensuring negotiation efficiency.

Key words: negotiation strategy, reinforcement learning, expectation restoration rate

摘要： 增强学习在电子商务中可以帮助Agent选择最优行动，并达成目标。在传统增强学习协商策略中，Agent一开始便进行大幅度的妥协，这是不合理的，与现实不符，降低了Agent的期望。通过期望还原率来还原Agent的真实期望，对协商策略进行优化；讨论了期望还原率的取值对协商过程的影响；通过实验验证了优化的协商策略在保证协商效率的同时，提高了协商解的质量。

关键词: 协商策略, 增强学习, 期望还原率

SUN Tianhao, DENG Junkun, CHEN Fei, ZHU Qingsheng. Research on reinforcement learning negotiation strategy and its optimization[J]. Computer Engineering and Applications, 2012, 48(23): 44-46.

孙天昊，邓俊昆，陈飞，朱庆生. 基于增强学习协商策略的研究及优化[J]. 计算机工程与应用, 2012, 48(23): 44-46.

[1]	WANG Xiao, TANG Lun, HE Xiaoyu, CHEN Qianbin. Multi-dimensional Resource Optimization of Service Function Chain Based on Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(4): 68-76.
[2]	LAI Jun, WEI Jingyi, CHEN Xiliang. Overview of Hierarchical Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(3): 72-79.
[3]	MA Zhihao, ZHU Xiangbin. Research on Quasi-hyperbolic Momentum Gradient for Adversarial Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(24): 90-99.
[4]	LI Baoshuai, YE Chunming. Job Shop Scheduling Problem Based on Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(23): 248-254.
[5]	WANG Jun, CAO Lei, CHEN Xiliang, LAI Jun, ZHANG Legui. Overview on Reinforcement Learning of Multi-agent Game [J]. Computer Engineering and Applications, 2021, 57(21): 1-13.
[6]	CHENG Yi, HAO Mimi. Path Planning for Indoor Mobile Robot with Improved Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(21): 256-262.
[7]	KUANG Liqun, LI Siyuan, FENG Li, HAN Xie, XU Qingyu. Application of Deep Reinforcement Learning Algorithm on Intelligent Military Decision System [J]. Computer Engineering and Applications, 2021, 57(20): 271-278.
[8]	KONG Songtao, LIU Chichi, SHI Yong, XIE Yi, WANG Kun. Review of Application Prospect of Deep Reinforcement Learning in Intelligent Manufacturing [J]. Computer Engineering and Applications, 2021, 57(2): 49-59.
[9]	LI Hao, NING Haoyu, KANG Yan, LIANG Wentao, HUO Wen. SMRFGAN Model for Text Emotion Transfer [J]. Computer Engineering and Applications, 2021, 57(2): 170-176.
[10]	ZHANG Rongxia, WU Changxu, SUN Tongchao, ZHAO Zengshun. Progress on Deep Reinforcement Learning in Path Planning [J]. Computer Engineering and Applications, 2021, 57(19): 44-56.
[11]	YANG Xueyu, CHEN Jianping, FU Qiming, LU You, WU Hongjie. Deep Deterministic Policy Gradient Algorithm Based on Stochastic Variance Reduction Method [J]. Computer Engineering and Applications, 2021, 57(19): 104-111.
[12]	SONG Haonan, ZHAO Gang, WANG Xingfen. Knowledge Reasoning Method Combining Knowledge Representation with Deep Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(19): 189-197.
[13]	WANG Keyin, SHI Zhen, YANG Zhengcai, YANG Yahui, WANG Sishan. Path Planning for Mobile Robot Using Improved Reinforcement Learning Algorithm [J]. Computer Engineering and Applications, 2021, 57(18): 270-274.
[14]	ZHANG Jun, ZHU Qingwei, YAN Junjie, WEN Bo. UAV Indoor 3D Track Planning Based on Improved Reinforcement Learning Algorithm [J]. Computer Engineering and Applications, 2021, 57(16): 175-181.
[15]	CHE Xiangbei, KANG Wenqian, OUYANG Yuhong, YANG Kehan, LI Jian. SDN Routing Optimization Algorithm Based on Reinforcement Learning [J]. Computer Engineering and Applications, 2021, 57(12): 93-98.

Research on reinforcement learning negotiation strategy and its optimization

基于增强学习协商策略的研究及优化

PDF

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics