Research on Fuzzy Fusion Control Method for Brain-Controlled Vehicles

doi:10.3778/j.issn.1002-8331.2101-0325

Abstract

Abstract: A brain-controlled vehicle（BCV） is a vehicle that uses the brain-computer interface（BCI） to analyze the driver’s electroencephalogram（EEG） to obtain human control commands. Its performance is greatly affected by the capability of BCI. At present, the recognition accuracy of BCI and the number of instructions that can be recognized are limited. At the same time, the recognition time of instructions is relatively long. Therefore, the performance of BCV controlled only by EEG signals is usually unsatisfactory. Aiming at the problem of improving the performance of BCV under the condition of limited BCI performance, a fusion brain control strategy based on fuzzy logic is proposed. Firstly, based on fuzzy discrete event system（FDES） supervision theory, instructions of the driver are supervised and evaluated. At the same time, based on fuzzy logic, an automatic controller which gives an automatic decision through fuzzy reasoning according to the current state of the vehicle is designed. Then according to the automatic decision and the correct degree of the driver’s instructions, a second fuzzy reasoning is made to obtain the final decision, making the final decision more in line with human intentions. To verify the effectiveness of the proposed method, a new type of steady-state visual evoked potential（SSVEP） BCI device is adopted. And based on this platform, the follow-up experiments are designed to verify that the proposed method can improve the performance of BCV under the condition of limited BCI performance.

Key words: brain-computer interface, brain-controlled vehicle, electroencephalogram（EEG） signal, fuzzy logic

摘要： 脑控车辆（brain-controlled vehicle，BCV）是指利用脑机接口（brain-computer interface，BCI）解析驾驶员的脑电信号（electroencephalogram，EEG）从而获得控制命令的车辆，其性能受BCI本身性能影响很大。目前，BCI的识别准确率、可识别分类的指令数都受限，并且其指令识别时间较长，因此仅靠脑电信号控制的车辆，其控制性能并不理想。针对在BCI性能受限的情况下提高脑控车辆的控制性能这一问题，基于模糊逻辑，提出了一种模糊脑控融合控制的方法：基于模糊离散事件系统（fuzzy discrete event system，FDES）监督理论对于驾驶员给出的脑控指令的正确程度进行监督评估；同时基于模糊逻辑设计一个自动控制器根据车辆当前状况进行模糊推理得到自动决策；根据评估后驾驶员指令的正确程度与自动决策进行二次模糊推理，对自动决策作出更符合人意图的调整，得到最终决策。为证明所提方法的有效性，采用一种新型的SSVEP（steady-state visual evoked potential）型脑机接口设备。并基于此平台，设计了后续实验，验证了所提出的方法能够在BCI性能受限的情况下提高脑控车辆的控制性能。

关键词: 脑机接口, 脑控车辆, 脑电信号, 模糊逻辑

DONG Na, ZHANG Wenqi, WU Zhiqiang. Research on Fuzzy Fusion Control Method for Brain-Controlled Vehicles[J]. Computer Engineering and Applications, 2022, 58(17): 298-305.

董娜, 张文锜, 吴志强. 面向脑控车辆的模糊融合控制方法研究[J]. 计算机工程与应用, 2022, 58(17): 298-305.

References

[1] CHAE Y，JEONG J，JO S.Toward brain-actuated humanoid robots：asynchronous direct control using an EEG-based BCI[J].IEEE Transactions on Robotics，2012，28（5）：1131-1144.
[2] KIM K T，SUK H I，LEE S W.Commanding a brain-controlled wheelchair using steady-state somatosensory evoked potentials[J].IEEE Transactions on Neural Systems and Rehabilitation Engineering，2018，26（3）：654-665.
[3] LI W Y，FENG D，SHENG S L，et al.A human-vehicle collaborative simulated driving system based on hybrid brain-computer interfaces and computer vision[J].IEEE Transactions on Cognitive and Developmental Systems，2018，10（3）：810-822.
[4] YU Y，ZHOU Z T，YIN E，et al.Toward brain-actuated car applications：self-paced control with a motor imagery-based brain-computer interface[J].Computers in Biology and Medicine，2016，77：148-155.
[5] TENG T，BI L Z，FAN X A.Using EEG to recognize emergency situations for brain-controlled vehicles[C]//26th IEEE Intelligent Vehicles Symposium，Seoul，Korea，2015：1305-1309.
[6] WANG M，LI R J，ZHANG R F，et al.A wearable SSVEP-based BCI system for quadcopter control using head-mounted device[J].IEEE Access，2018，6：26789-26798.
[7] 张林.脑控机器人系统的共享控制方法研究[D].大连：大连理工大学，2014.
ZHANG L.Research on shared control method of brain-controlled robot system[D].Dalian：Dalian University of Technology，2014.
[8] DASGUPTA S，FANTON M，PHAM J，et al.Brain controlled robotic platform using steady state visual evoked potentials acquired by EEG[C]//44th Asilomar Conference on Signals，Systems，and Computers，2010：1371-1374.
[9] BI L Z，WANG M T，LU Y，et al.Model predictive-based shared control for brain-controlled driving[J].IEEE Transactions on Intelligent Transportation Systems，2020，21（2）：630-640.
[10] LU Y，BI L Z.Combined lateral and longitudinal control of EEG signals-based brain-controlled vehicles[J].IEEE Transactions on Neural Systems and Rehabilitation Engineering，2019，27（9）：1732-1742.
[11] BI L Z，FAN X A，LUO N N，et al.A head-up display-based P300 brain-computer interface for destination selection[J].IEEE Transactions on Intelligent Transportation Systems，2013，14（4）：1996-2001.
[12] FAN X A，BI L Z，TENG T，et al.A brain-computer interface-based vehicle destination selection system using P300 and SSVEP signals[J].IEEE Transactions on Intelligent Transportation Systems，2015，16（1）：274-283.
[13] GHRING D，LATOTZKY D，WANG M，et al.Semi-autonomous car control using brain computer interfaces[M]//Intelligent autonomous systems 12.Berlin，Germany：Springer，2013：393-408.
[14] BI L Z，FAN X A，KE J，et al.Using a head-up display-based steady-state visually evoked potential brain-computer interface to control a simulated vehicle[J].IEEE Transactions on Intelligent Transportation Systems，2014，15（3）：959-966.
[15] LU Y，BI L Z.EEG signals-based longitudinal control system for a brain-controlled vehicle[J].IEEE Transactions on Neural Systems and Rehabilitation Engineering，2019，27（2）：323-332.
[16] BORGUL A，BAZYLEV D.Brain controlled multiagent aerial vehicles system[C]//18th International Conference on Methods and Models in Automation and Robotics，Miedzyzdroje，Poland，2013：736-741.
[17] YIN G，GONG L.Direction control and speed control combined model of motor-imagery based brain-actuated vehicle[C]//36th Chinese Control Conference，2017：2210-2214.
[18] GAO Z K，GUO W，CAI Q，et al.Characterization of SSMVEP-based EEG signals using multiplex limited penetrable horizontal visibility graph[J].Chaos，2019，29（7）：073119.