Most Download articles

    Published in last 1 year | In last 2 years| In last 3 years| All| Most Downloaded in Recent Month | Most Downloaded in Recent Year|

    Most Downloaded in Recent Year
    Please wait a minute...
    For Selected: Toggle Thumbnails
    Review of Fault Diagnosis Techniques for UAV Flight Control Systems
    AN Xue, LI Shaobo, ZHANG Yizong, ZHANG Ansi
    Computer Engineering and Applications    2023, 59 (24): 1-15.   DOI: 10.3778/j.issn.1002-8331.2305-0137
    Abstract389)      PDF(pc) (917KB)(1467)       Save
    In recent years, unmanned aerial vehicles(UAVs) have been widely used in various complex fields of military and civilian applications due to their unique advantages such as low operating costs and high mobility. At the same time, the complex and diverse missions have put forward higher requirements for the reliability and safety of UAV systems. The UAV fault diagnosis technology can provide timely and accurate diagnosis results, which helps the maintenance, repair and servicing of UAVs, and is of great significance in enhancing the combat effectiveness of UAVs. Therefore, this paper firstly analyses UAV flight control systems, and classifies the faults. Secondly, the research methods and status quo of UAV fault diagnosis technology are analysed and summarised. Finally, the main challenges faced by UAV fault diagnosis technology are discussed and the future development direction is pointed out; the aim is to provide some reference for researchers in the field of UAV fault diagnosis technology and to promote the improvement of UAV fault diagnosis technology level in China.
    Reference | Related Articles | Metrics
    Survey of Multimodal Data Fusion
    REN Zeyu, WANG Zhenchao, KE Zunwang, LI Zhe, Wushour·Silamu
    Computer Engineering and Applications    2021, 57 (18): 49-64.   DOI: 10.3778/j.issn.1002-8331.2104-0237
    Abstract2364)      PDF(pc) (1214KB)(2151)       Save

    With the rapid development of information technology, information exists in various forms and sources. Different forms of existence or information sources can be referred to as one modal, and data composed of two or more modalities is called multi-modal data. Multi-modal data fusion is responsible for effectively integrating the information of multiple modalities, absorbing the advantages of different modalities, and completing the integration of information. Natural phenomena have very rich characteristics, and it is difficult for a single mode to provide complete information about a certain phenomenon. Faced with the fusion requirements of maintaining the diversity and completeness of the modal information after fusion, maximizing the advantages of each modal, and reducing the information loss caused by the fusion process, how to integrate the information of each modal has become a new challenge that exists in many fields. This paper briefly describes common multimodal fusion methods and fusion architectures, summarizes three common fusion models, and briefly analyzes the advantages and disadvantages of the three architectures of collaboration, joint, and codec, as well as specific fusion methods such as multi-core learning and image models. In the application of multi-modality, it analyzes and summarizes multi-modal video clip retrieval, comprehensive multi-modal information generation content summary, multi-modal sentiment analysis, and multi-modal man-machine dialogue system. The paper also proposes the current problems of multi-modal fusion and the future research directions.

    Related Articles | Metrics
    Research Progress on Vision System and Manipulator of Fruit Picking Robot
    GOU Yuanmin, YAN Jianwei, ZHANG Fugui, SUN Chengyu, XU Yong
    Computer Engineering and Applications    2023, 59 (9): 13-26.   DOI: 10.3778/j.issn.1002-8331.2209-0183
    Abstract1523)      PDF(pc) (787KB)(1117)       Save
    Fruit picking robot is of great significance to the realization of automatic intelligence of fruit equipment. In this paper, the research work on the key technologies of fruit-picking robot at home and abroad in recent years is summarized, firstly, the key technologies of fruit-picking robot vision system, such as traditional image segmentation methods based on fruit features, such as threshold method, edge detection method, clustering algorithm based on color features and region-based image segmentation algorithm, are discussed, the object recognition algorithm based on depth learning and the target fruit location are analyzed and compared, and the state-of-the-art of fruit picking robot manipulator and end-effector is summarized, finally, the development trend and direction of fruit-picking robot in the future are prospected, which can provide reference for the related research of fruit-picking robot.
    Reference | Related Articles | Metrics
    Review of Development and Application of Artificial Neural Network Models
    ZHANG Chi, GUO Yuan, LI Ming
    Computer Engineering and Applications    2021, 57 (11): 57-69.   DOI: 10.3778/j.issn.1002-8331.2102-0256
    Abstract2824)      PDF(pc) (781KB)(2238)       Save

    Artificial neural networks are increasingly closely related to other subject areas. People solve problems in various fields by exploring and improving the layer structure of artificial neural networks. Based on the analysis of artificial neural networks related literature, this paper summarizes the history of artificial neural network growth and presents relevant principles of artificial neural networks based on the development of neural networks, including multilayer perceptron, back-propagation algorithm, convolutional neural network and recurrent neural network, explains the classic convolutional neural network model in the development of the convolutional neural network and the widely used variant network structure in the recurrent neural network, reviews the application of each artificial neural network algorithm in related fields, summarizes the possible direction of development of the artificial neural network.

    Related Articles | Metrics
    Review of Text Sentiment Analysis Methods
    WANG Ting, YANG Wenzhong
    Computer Engineering and Applications    2021, 57 (12): 11-24.   DOI: 10.3778/j.issn.1002-8331.2101-0022
    Abstract2089)      PDF(pc) (906KB)(1753)       Save

    Text sentiment analysis is an important branch of natural language processing, which is widely used in public opinion analysis and content recommendation. It is also a hot topic in recent years. According to different methods used, it is divided into sentiment analysis based on emotional dictionary, sentiment analysis based on traditional machine learning, and sentiment analysis based on deep learning. Through comparing these three methods, the research results are analyzed, and the paper summarizes the advantages and disadvantages of different methods, introduces the related data sets and evaluation index, and application scenario, analysis of emotional subtasks is simple summarized. The future research trend and application field of sentiment analysis problem are found. Certain help and guidance are provided for the researchers in the related areas.

    Related Articles | Metrics
    Review on Integration Analysis and Application of Multi-omics Data
    ZHONG Yating, LIN Yanmei, CHEN Dingjia, PENG Yuzhong, ZENG Yuanpeng
    Computer Engineering and Applications    2021, 57 (23): 1-17.   DOI: 10.3778/j.issn.1002-8331.2106-0341
    Abstract1521)      PDF(pc) (806KB)(1775)       Save

    With the continuous emergence and popularization of new omics sequencing technology, a large number of omics data have been produced, which is of great significance for people to further study and reveal the mysteries of life. Using multi-omics data to integrate and analyze life science problems can obtain more abundant and more comprehensive information related to life system, which has become a new direction for scientists to explore the mechanism of life. This paper introduces the research background and significance of multi-omics data integration analysis, summarizes the methods of data integration analysis of multiomics in recent years and the applied research in related fields, and finally discusses the current existing problems and future prospects of multi-omics data integration analysis methods.

    Reference | Related Articles | Metrics
    Study on Optimization of Cooperative Distribution Path Between UAVs and Vehicles Under Rural E-Commerce Logistics
    XU Ling, YANG Linchao, ZHU Wenxing, ZHONG Shaojun
    Computer Engineering and Applications    2024, 60 (1): 310-318.   DOI: 10.3778/j.issn.1002-8331.2306-0115
    Abstract845)      PDF(pc) (666KB)(706)       Save
    Drone delivery has emerged as a significant solution to address the challenges of last-mile logistics. The collaborative delivery model between drones and vehicles overcomes the limitations of insufficient drone delivery capacity and enhances safety, making it a vital approach for drone involvement in the delivery process. To tackle the difficulties and high costs associated with “last-mile” delivery in rural e-commerce logistics, this study constructs a mixed-integer programming model. The objective is to minimize delivery costs while considering constraints such as the collaborative drone-vehicle mode and multi drone multi-parcel delivery. A two-stage algorithm is proposed to optimize the paths for drone-vehicle collaborative delivery. In the first stage, a constrained adaptive K-means algorithm is utilized to determine the range of vehicle docking points. In the second stage, an improved genetic algorithm that incorporates hill climbing and splitting operators is employed to identify the optimal delivery paths for drones and vehicles. Subsequently, a case study experiment is conducted to validate the feasibility and effectiveness of the model and algorithm. The research findings are expected to offer novel insights and valuable references for cost reduction and efficiency improvement in last-mile delivery for rural e-commerce logistics.
    Reference | Related Articles | Metrics
    Review on Research and Application of Deep Learning-Based Target Detection Algorithms
    ZHANG Yangting, HUANG Deqi, WANG Dongwei, HE Jiajia
    Computer Engineering and Applications    2023, 59 (18): 1-13.   DOI: 10.3778/j.issn.1002-8331.2305-0310
    Abstract1093)      PDF(pc) (662KB)(678)       Save
    With the continuous development of deep learning, deep convolutional neural networks are increasingly used in the field of target detection and are now applied in many fields such as agriculture, transportation, and medicine. Compared with traditional feature-based manual methods, deep learning-based target detection methods can learn both low-level and high-level image features with better detection accuracy and generalization ability. To outline and summarize the latest advances and technologies in the field of target detection, the status of deep learning-based target detection algorithms and applications is reviewed by analyzing the deep learning-based target detection technologies in recent years. Firstly, the development, advantages and disadvantages of two kinds of target detection network architectures, two phases and single phase, are summarized; secondly, the backbone network, data set and evaluation metrics are described, the detection accuracy of classical algorithms are compared, and the improvement strategies of classical target detection algorithms are summarized; finally, the current stage of target detection applications are discussed, and future research priorities in the field of target detection are proposed.
    Reference | Related Articles | Metrics
    Research Progress of YOLO Series Target Detection Algorithms
    WANG Linyi, BAI Jing, LI Wenjing, JIANG Jinzhe
    Computer Engineering and Applications    2023, 59 (14): 15-29.   DOI: 10.3778/j.issn.1002-8331.2301-0081
    Abstract1392)      PDF(pc) (1009KB)(807)       Save
    The YOLO-based algorithm is one of the hot research directions in target detection. In recent years, with the continuous proposition of YOLO series algorithms and their improved models, the YOLO-based algorithm has achieved excellent results in the field of target detection and has been widely used in various fields in reality. This article first introduces the typical datasets and evaluation index for target detection and reviews the overall YOLO framework and the development of the target detection algorithm of YOLOv1~YOLOv7. Then, models and their performance are summarized across eight improvement directions, such as data augmentation, lightweight network construction, and IOU loss optimization, at the three stages of input, feature extraction, and prediction. Afterwards, the application fields of YOLO algorithm are introduced. Finally, combined with the actual problems of target detection, it summarizes and prospects the development direction of the YOLO-based algorithm.
    Reference | Related Articles | Metrics
    Review of SLAM Based on Lidar
    LIU Mingzhe, XU Guanghui, TANG Tang, QIAN Xiaojian, GENG Ming
    Computer Engineering and Applications    2024, 60 (1): 1-14.   DOI: 10.3778/j.issn.1002-8331.2308-0455
    Abstract868)      PDF(pc) (854KB)(575)       Save
    Simultaneous localization and mapping (SLAM) is a crucial technology for autonomous mobile robots and autonomous driving systems, with a laser scanner (also known as lidar) playing a vital role as a supporting sensor for SLAM algorithms. This article provides a comprehensive review of lidar-based SLAM algorithms. Firstly, it introduces the overall framework of lidar-based SLAM, providing detailed explanations of the functions of the front-end odometry, back-end optimization, loop closure detection, and map building modules, along with a summary of the algorithms used. Secondly, it presents descriptions and summaries of representative open-source algorithms in a sequential order of 2D to 3D and single-sensor to multi-sensor fusion. Additionally, it discusses commonly used open-source datasets, precision evaluation metrics, and evaluation tools. Lastly, it offers an outlook on the development trends of lidar-based SLAM technology from four dimensions: deep learning, multi-sensor fusion, multi-robot collaboration, and robustness research.
    Reference | Related Articles | Metrics
    Review of Research on Road Traffic Flow Data Prediciton Methods
    MENG Chuang, WANG Hui, LIN Hao, LI Kecen, WANG Xinpeng
    Computer Engineering and Applications    2023, 59 (14): 51-61.   DOI: 10.3778/j.issn.1002-8331.2209-0458
    Abstract1295)      PDF(pc) (605KB)(627)       Save
    As an important branch of intelligent transportation system, road traffic flow prediction plays an important role in congestion prediction, path planning. The spatio-temporal polymorphism and complex correlation of road traffic flow data force the transformation and upgrading of road traffic flow prediction methods in the era of big data. In order to mine the time-space characteristics of traffic flow, scholars have proposed various methods, including model fusion, model algorithm improvement, data definition conversion, etc, in order to improve the prediction accuracy of the model. In order to reasonably summarize all kinds of traffic flow prediction methods, they are divided into three categories according to the types of methods used:statistics based methods, machine learning based methods, and depth learning based methods. This paper summarizes and analyzes the new models and algorithms in recent years by summarizing various traffic flow prediction methods, aiming to provide research ideas for relevant researchers. Finally, the methods of traffic flow prediction are summarized and prospected, and the exploration direction of the future traffic flow prediction field is given.
    Reference | Related Articles | Metrics
    Overview on Reinforcement Learning of Multi-agent Game
    WANG Jun, CAO Lei, CHEN Xiliang, LAI Jun, ZHANG Legui
    Computer Engineering and Applications    2021, 57 (21): 1-13.   DOI: 10.3778/j.issn.1002-8331.2104-0432
    Abstract1324)      PDF(pc) (779KB)(1377)       Save

    The use of deep reinforcement learning to solve single-agent tasks has made breakthrough progress. Since the complexity of multi-agent systems, common algorithms cannot solve the main difficulties. At the same time, due to the increase in the number of agents, taking the expected value of maximizing the cumulative return of a single agent as the learning goal often fails to converge and some special convergence points do not satisfy the rationality of the strategy. For practical problems that there is no optimal solution, the reinforcement learning algorithm is even more helpless. The introduction of game theory into reinforcement learning can solve the interrelationship of agents very well and explain the rationality of the strategy corresponding to the convergence point. More importantly, it can use the equilibrium solution to replace the optimal solution in order to obtain a relatively effective strategy. Therefore, this article investigates the reinforcement learning algorithms that have emerged in recent years from the perspective of game theory, summarizes the important and difficult points of current game reinforcement learning algorithms and gives several breakthrough directions that may solve the above-mentioned difficulties.

    Reference | Related Articles | Metrics
    Progress on Deep Reinforcement Learning in Path Planning
    ZHANG Rongxia, WU Changxu, SUN Tongchao, ZHAO Zengshun
    Computer Engineering and Applications    2021, 57 (19): 44-56.   DOI: 10.3778/j.issn.1002-8331.2104-0369
    Abstract2994)      PDF(pc) (1134KB)(1243)       Save

    The purpose of path planning is to allow the robot to avoid obstacles and quickly plan the shortest path during the movement. Having analyzed the advantages and disadvantages of the reinforcement learning based path planning algorithm, the paper derives a typical deep reinforcement learning, Deep Q-learning Network(DQN) algorithm that can perform excellent path planning in a complex dynamic environment. Firstly, the basic principles and limitations of the DQN algorithm are analyzed in depth, and the advantages and disadvantages of various DQN variant algorithms are compared from four aspects:the training algorithm, the neural network structure, the learning mechanism and AC(Actor-Critic) framework. The paper puts forward the current challenges and problems to be solved in the path planning method based on deep reinforcement learning. The future development directions are proposed, which can provide reference for the development of intelligent path planning and autonomous driving.

    Reference | Related Articles | Metrics
    Survey of Transformer-Based Object Detection Algorithms
    LI Jian, DU Jianqiang, ZHU Yanchen, GUO Yongkun
    Computer Engineering and Applications    2023, 59 (10): 48-64.   DOI: 10.3778/j.issn.1002-8331.2211-0133
    Abstract1164)      PDF(pc) (875KB)(701)       Save
    Transformer is a kind of deep learning framework with strong modeling and parallel computing capabilities. At present, object detection algorithm based on Transformer has become a hotspot. In order to further explore new ideas and directions, this paper summarizes the existing object detection algorithm based on Transformer as well as a variety of object detection data sets and their application scenarios. This paper describes the correlation algorithms for Transformer based object detection from four aspects, i.e. feature extraction, object estimation, label matching policy and application of algorithm, compares the Transformer algorithm with the object detection algorithm based on convolutional neural network, analyzes the advantages and disadvantages of Transformer in object detection task, and proposes a general framework for Transformer based object detection model. Finally, the prospect of development trend of Transformer in the field of object detection is put forward.
    Reference | Related Articles | Metrics
    Survey of Network Traffic Forecast Based on Deep Learning
    KANG Mengxuan, SONG Junping, FAN Pengfei, GAO Bowen, ZHOU Xu, LI Zhuo
    Computer Engineering and Applications    2021, 57 (10): 1-9.   DOI: 10.3778/j.issn.1002-8331.2101-0402
    Abstract2064)      PDF(pc) (711KB)(1793)       Save

    Precisely predicting the trend of network traffic changes can help operators accurately predict network usage, correctly allocate and efficiently use network resources to meet the growing and diverse user needs. Taking the progress of deep learning algorithms in the field of network traffic prediction as a clue, this paper firstly elaborates the evaluation indicators of network traffic prediction and the current public network traffic data sets. Secondly, this paper specifically analyzes four deep learning methods commonly used in network traffic prediction:deep belief networks, convolutional neural network, recurrent neural network, and long short term memory network, and focuses on the integrated neural network models used in recent years for different problems. The characteristics and application scenarios of each model are summarized. Finally, the future development of network traffic forecast is prospected.

    Related Articles | Metrics
    Overview of Image Quality Assessment Method Based on Deep Learning
    CAO Yudong, LIU Haiyan, JIA Xu, LI Xiaohui
    Computer Engineering and Applications    2021, 57 (23): 27-36.   DOI: 10.3778/j.issn.1002-8331.2106-0228
    Abstract980)      PDF(pc) (646KB)(991)       Save

    Image quality evaluation is a measurement of the visual quality of an image or video. The researches on image quality evaluation algorithms in the past 10 years are reviewed. First, the measurement indicators of image quality evaluation algorithm and image quality evaluation datasets are introduced. Then, the different classification of image quality evaluation methods are analyzed, and image quality evaluation algorithms with deep learning technology are focused on, basic model of which is deep convolutional network, deep generative adversarial network and transformer. The performance of algorithms with deep learning is often higher than that of traditional image quality assessment algorithms. Subsequently, the principle of image quality assessment with deep learning is described in detail. A specific no-reference image quality evaluation algorithm based on deep generative adversarial network is introduced, which improves the reliability of simulated reference images through enhanced confrontation learning. Deep learning technology requires massive data support. Data enhancement methods are elaborated to improve the performance of the model. Finally, the future research trend of digital image quality evaluation is summarized.

    Reference | Related Articles | Metrics
    Research on Urban Logistics Distribution Mode of Bus-Assisted Drones
    PENG Yong, REN Zhi
    Computer Engineering and Applications    2024, 60 (7): 335-343.   DOI: 10.3778/j.issn.1002-8331.2212-0252
    Abstract649)      PDF(pc) (755KB)(537)       Save
    The rapid development of e-commerce forces the continuous transformation and upgrading of the logistics industry. In view of the fact that local governments encourage the development of public transport and advocate green and low-carbon logistics distribution mode, a distribution mode of bus-assisted drone is studied. After explaining the problem, a mathematical model with the lowest distribution cost is constructed, and a heuristic algorithm of smart general variable neighborhood search metaheuristic is designed to solve the problem. At the same time, in order to improve the efficiency of the algorithm, K-means clustering and greedy algorithm are introduced to generate the initial solution. Firstly, aiming at different scale examples, a variety of local search strategies and a variety of algorithms are compared to verify the effectiveness of the algorithm. Secondly, by selecting the standard CVRP as example, the single truck distribution mode and truck-drone collaborative distribution mode are compared with the distribution mode of bus-assisted drone to prove its cost and time advantages. Finally, Beijing Bus Rapid Transit Line 2 and its surrounding customer points are selected, and sensitivity analysis is made by changing the bus stop spacing and departure interval, result shows that the impact of increasing the stop spacing is greater than the change of departure interval.
    Reference | Related Articles | Metrics
    Survey of Transformer Research in Computer Vision
    LI Xiang, ZHANG Tao, ZHANG Zhe, WEI Hongyang, QIAN Yurong
    Computer Engineering and Applications    2023, 59 (1): 1-14.   DOI: 10.3778/j.issn.1002-8331.2204-0207
    Abstract1168)      PDF(pc) (1285KB)(760)       Save
    Transformer is a deep neural network based on self-attention mechanism. In recent years, Transformer-based models have become a hot research direction in the field of computer vision, and their structures are constantly being improved and expanded, such as local attention mechanisms, pyramid structures, and so on. Through the improved vision model based on Transformer structure, the performance optimization and structure improvement are reviewed and summarized respectively. In addition,the advantages and disadvantages of the respective structures of the Transformer and convolutional neural network(CNN) are compared and analyzed,and a new hybrid structure of CNN+Transformer is introduced. Finally,the development of Transformer in computer vision is summarized and prospected.
    Reference | Related Articles | Metrics
    Survey of Research on Deep Multimodal Representation Learning
    PAN Mengzhu, LI Qianmu, QIU Tian
    Computer Engineering and Applications    2023, 59 (2): 48-64.   DOI: 10.3778/j.issn.1002-8331.2206-0145
    Abstract869)      PDF(pc) (6521KB)(613)       Save
    Although deep learning has been widely used in many fields because of its powerful nonlinear representation capabilities, the structural and semantic gap between multi-source heterogeneous modal data seriously hinders the application of subsequent deep learning models. Many scholars have proposed a large number of representation learning methods to explore the correlation and complementarity between different modalities, and improve the performance of deep learning prediction and generalization. However, the research on multimodal representation learning is still in its infancy, and there are still many scientific problems to be solved. So far, multimodal representation learning still lacks a unified cognition, and the architecture and evaluation metrics of multimodal representation learning research are not fully clear. According to the feature structure, semantic information and representation ability of different modalities, this paper studies and analyzes the progress of deep multimodal representation learning from the perspectives of representation fusion and representation alignment. And the existing research work is systematically summarized and scientifically classified. At the same time, this paper analyzes the basic structure, application scenarios and key issues of representative frameworks and models, analyzes the theoretical basis and latest development of deep multimodal representation learning, and points out the current challenges and future development of multimodal representation learning research, to further promote the development and application of deep multimodal representation learning.
    Reference | Related Articles | Metrics
    Survey on Research Status of Blind-Guiding Robots
    WU Zhaohan, RONG Xuewen, FAN Yong
    Computer Engineering and Applications    2020, 56 (14): 1-13.   DOI: 10.3778/j.issn.1002-8331.2001-0298
    Abstract1386)      PDF(pc) (1778KB)(1516)       Save

    Blind people are the vulnerable groups in human society, and the number of them is increasing year by year. Providing safe, reliable, intelligent and efficient travel guarantees for the blind is an important sign of social progress. The research results of white-cane-based, wearable, handheld, intelligent-terminal-based and mobile blind-guiding robots are introduced. The research status of the common key technology of environment detection, positioning and navigation, and human-computer interaction of blind-guiding robots is summarized. Finally, the future development trend of blind-guiding robots is forecasted based on the latest technologies such as cloud platform and mobile communication.

    Related Articles | Metrics
    Overview of Multi-Agent Deep Reinforcement Learning
    SUN Yu, CAO Lei, CHEN Xiliang, XU Zhixiong, LAI Jun
    Computer Engineering and Applications    2020, 56 (5): 13-24.   DOI: 10.3778/j.issn.1002-8331.1912-0100
    Abstract1715)      PDF(pc) (763KB)(1661)       Save

    Multi-agent deep reinforcement learning is an emerging research hotspot and application direction in the field of machine learning and artificial intelligence. It covers many algorithms, rules, and frameworks, and is widely used in autonomous driving, energy allocation, formation control, trajectory planning,routing planning and social dilemma, it has extremely high research value and significance. The paper first briefly introduces the basic theory and development history of multi-agent deep reinforcement learning, then elaborates the existing classic algorithms according to four classification:non-association type, communication rule based type, mutual cooperation type and modeling learning type, then summarizes the practical application of multi-agent deep reinforcement learning and briefly lists the existing test platforms. The paper finally summarizes the challenges and future directions in theory, algorithms and applications of multi-agent deep reinforcement learning.

    Related Articles | Metrics
    Survey of Sentiment Analysis Algorithms Based on Multimodal Fusion
    GUO Xu, Mairidan Wushouer, Gulanbaier Tuerhong
    Computer Engineering and Applications    2024, 60 (2): 1-18.   DOI: 10.3778/j.issn.1002-8331.2305-0439
    Abstract626)      PDF(pc) (954KB)(455)       Save
    Sentiment analysis is an emerging technology that aims to explore people’s attitudes toward entities and can be applied to various domains and scenarios, such as product evaluation analysis, public opinion analysis, mental health analysis and risk assessment. Traditional sentiment analysis models focus on text content, yet some special forms of expression, such as sarcasm and hyperbole, are difficult to detect through text. As technology continues to advance, people can now express their opinions and feelings through multiple channels such as audio, images and videos, so sentiment analysis is shifting to multimodality, which brings new opportunities for sentiment analysis. Multimodal sentiment analysis contains rich visual and auditory information in addition to textual information, and the implied sentiment polarity (positive, neutral, negative) can be inferred more accurately using fusion analysis. The main challenge of multimodal sentiment analysis is the integration of cross-modal sentiment information; therefore, this paper focuses on the framework and characteristics of different fusion methods and describes the popular fusion algorithms in recent years, and discusses the current multimodal sentiment analysis in small sample scenarios, in addition to the current development status, common datasets, feature extraction algorithms, application areas and challenges. It is expected that this review will help researchers understand the current state of research in the field of multimodal sentiment analysis and be inspired to develop more effective models.
    Reference | Related Articles | Metrics
    Image Inpainting Algorithm Based on Deep Neural Networks
    LYU Jianfeng, SHAO Lizhen, LEI Xuemei
    Computer Engineering and Applications    2023, 59 (20): 1-12.   DOI: 10.3778/j.issn.1002-8331.2303-0111
    Abstract443)      PDF(pc) (720KB)(450)       Save
    With the rapid development of deep learning, computer vision technology is applied more and more widely. At the same time, the image inpainting technology based on the known information of the damaged image using deep neural network has also become a hot topic. The image inpainting methods based on depth neural network in recent years are reviewed and analyzed. Firstly, the image inpainting methods are classified and summarized according to the view of model optimization. Then the common datasets and performance evaluation indicators are introduced, and the performance evaluation and analysis of various deep neural network-based image inpainting algorithms are carried out on the relevant data sets. Finally, the challenges faced by the existing image inpainting methods are analyzed, and the future research works are prospected.
    Reference | Related Articles | Metrics
    Improved YOLOv8s Model for Small Object Detection from Perspective of Drones
    PAN Wei, WEI Chao, QIAN Chunyu, YANG Zhe
    Computer Engineering and Applications    2024, 60 (9): 142-150.   DOI: 10.3778/j.issn.1002-8331.2312-0043
    Abstract314)      PDF(pc) (5858KB)(440)       Save
    Facing with the problems of small and densely distributed image targets, uneven class distribution, and model size limitation of hardware conditions, object detection from the perspective of drones has less precise results. A new improved model based on YOLOv8s with multiple attention mechanisms is proposed. To solve the problem of shared attention weight parameters in receptive field features and enhance feature extraction ability, receptive field attention convolution and CBAM (concentration based attention module) attention mechanism are introduced into the backbone, adding attention weight in channel and spatial dimensions. By introducing large separable kernel attention into feature pyramid pooling layers, information fusion between different levels of features is increased. The feature layers with rich semantic information of small targets are added to improve the neck structure. The inner-IoU loss function is used to improve the MPDIoU (minimum point distance based IoU) function and the inner-MPDIoU instead of the original loss function is used to enhance the learning ability for difficult samples. The experimental results show that the improved YOLOv8s model has improved mAP, P, and R by 16.1%, 9.3%, and 14.9% respectively on the VisDrone dataset, surpassing YOLOv8m in performance and can be effectively applied to unmanned aerial vehicle visual detection tasks.
    Reference | Related Articles | Metrics
    Survey of Application of Deep Learning in Image Recognition
    ZHENG Yuanpan1,2, LI Guangyang1, LI Ye1
    Computer Engineering and Applications    2019, 55 (12): 20-36.   DOI: 10.3778/j.issn.1002-8331.1903-0031
    Abstract2351)      PDF(pc) (1086KB)(1925)       Save
    As an important technical means in the field of image recognition, deep learning has broad application prospects. Carrying out image recognition technology research has important theoretical and practical significance for promoting the development of computer vision and artificial intelligence. The application of deep learning in image recognition gives a review. The origin of deep learning is introduced. Deep learning models such as deep belief network, convolutional neural network, cyclic neural network, generated confrontation network and capsule network are analyzed. The improved models of each deep learning model are compared and analyzed one by one. In this paper, the research results of deep learning in image recognition applications such as face recognition, medical image recognition and remote sensing image classification  are summarized. The existing researches are worth discussing. The development trend of deep learning in the field of image recognition is carried out. The discussion points out that the effective use of migration learning technology to identify small sample data, the use of unsupervised learning and semi-supervised learning to identify images, how to effectively identify video images and the theoretical significance of the model are further directions in this field.
    Related Articles | Metrics
    Review of Attention Mechanism in Convolutional Neural Networks
    ZHANG Chenjia, ZHU Lei, YU Lu
    Computer Engineering and Applications    2021, 57 (20): 64-72.   DOI: 10.3778/j.issn.1002-8331.2105-0135
    Abstract2031)      PDF(pc) (973KB)(1301)       Save

    Attention mechanism is widely used in deep learning tasks because of its excellent effect and plug and play convenience. This paper mainly focuses on convolution neural network, introduces various mainstream methods in the development process of convolution network attention mechanism, extracts and summarizes its core idea and implementation process, realizes each attention mechanism method, and makes comparative experiments and results analysis on the measured data of the same type of emitter equipment. According to the main ideas and experimental results, the research status and future development direction of attention mechanism in convolutional networks are summarized.

    Reference | Related Articles | Metrics
    Overview of Image Edge Detection
    XIAO Yang, ZHOU Jun
    Computer Engineering and Applications    2023, 59 (5): 40-54.   DOI: 10.3778/j.issn.1002-8331.2209-0122
    Abstract1021)      PDF(pc) (921KB)(540)       Save
    The task of edge detection is to identify pixels with significant brightness changes as target edges, which is a low-level problem in computer vision, and edge detection has important applications in object recognition and detection, object proposal generation, and image segmentation. Nowadays, edge detection has produced several types of methods, such as traditional gradient-based detection methods and deep learning-based edge detection algorithms and detection methods combined with emerging technologies. A finer classification of these methods provides researchers with a clearer understanding of the trends in edge detection. Firstly, the theoretical basis and implementation methods of traditional edge detection are introduced; then the main edge detection methods in recent years are summarized and classified according to the methods used, and the core techniques used in them are introduced, such as branching structure, feature fusion and loss function. The evaluation indicators used to assess the algorithm’s performance are single-image optimal threshold(ODS) and frame per second(FPS), which are contrasted using the fundamental data set(BSDS500). Finally, the current state of edge detection research is examined and summarized, and the possible future research directions of edge detection are prospected.
    Reference | Related Articles | Metrics
    Review of Explainable Artificial Intelligence
    ZHAO Yanyu, ZHAO Xiaoyong, WANG Lei, WANG Ningning
    Computer Engineering and Applications    2023, 59 (14): 1-14.   DOI: 10.3778/j.issn.1002-8331.2208-0322
    Abstract925)      PDF(pc) (683KB)(579)       Save
    With the development of machine learning and deep learning, artificial intelligence technology has been gradually applied in various fields. However, one of the biggest drawbacks of adopting AI is its inability to explain the basis for predictions. The black-box nature of the models makes it impossible for humans to truly trust them yet in mission-critical application scenarios such as healthcare, finance, and autonomous driving, thus limiting the grounded application of AI in these areas. Driving the development of explainable artificial intelligence(XAI) has become an important issue for achieving mission-critical applications on the ground. At present, there is still a lack of research reviews on XAI in related fields at home and abroad, as well as a lack of studies focusing on causal explanation methods and the evaluation of explainable methods. Therefore, this study firstly starts from the characteristics of explanatory methods and divides the main explainable methods into three categories:model-independent methods, model-dependent methods, and causal explanation methods from the perspective of explanation types, and summarizes and analyzes them respectively, then summarizes the evaluation of explanation methods, lists the applications of explainable AI, and finally discusses the current problems of explainability and provides an outlook.
    Reference | Related Articles | Metrics
    Overview of Image Denoising Methods Based on Deep Learning
    LIU Di, JIA Jinlu, ZHAO Yuqing, QIAN Yurong
    Computer Engineering and Applications    2021, 57 (7): 1-13.   DOI: 10.3778/j.issn.1002-8331.2011-0341
    Abstract1468)      PDF(pc) (1139KB)(1450)       Save

    Image denoising is a kind of technology that uses the context information of image sequence to remove noise and restore clear image. It is one of the important research contents in the field of computer vision. With the development of machine learning, deep learning has been widely used in the field of image denoising, and has become an effective solution for image denoising. Firstly, the deep learning image denoising method is analyzed. Secondly, the idea of image denoising method is analyzed in detail according to the network structure, and the advantages and disadvantages are summarized. Then, through the experimental results on DND, PolyU and other data sets, the performance of deep learning based image denoising methods is compared and analyzed. Finally, the key issues of image denoising research are summarized, and the future development trend of the research of this field is discussed.

    Related Articles | Metrics
    Survey of Image Compression Algorithm Based on Deep Learning
    YU Heng, MEI Hongyan, XU Xiaoming, JIA Huiping
    Computer Engineering and Applications    2020, 56 (15): 15-23.   DOI: 10.3778/j.issn.1002-8331.2003-0294
    Abstract1418)      PDF(pc) (923KB)(1713)       Save

    With the continuous development of deep learning and the explosive growth of image data, how to use deep learning to obtain higher compression ratio and higher quality images has gradually become one of the hot research issues. Through the analysis of the related literatures in recent years, the image compression method based on the deep learning is summarized and analyzed according to the Convolutional Neural Network(CNN), Recurrent Neural Network(RNN), Generative Adversarial Network(GAN). This paper enumerates the typical examples, and the image compression algorithm based on depth study of the training data set, commonly used evaluation indexes are introduced, according to the deep learning advantages in the field of image compression for its future development trend are summarized and discussed.

    Related Articles | Metrics
    Analysis on Application of Machine Learning in Stock Forecasting
    XU Haoran, XU Bo, XU Kewen
    Computer Engineering and Applications    2020, 56 (12): 19-24.   DOI: 10.3778/j.issn.1002-8331.2001-0353
    Abstract1140)      PDF(pc) (892KB)(1664)       Save

    It has always been regarded as the emphasis of research to reveal the operation law of stock market. In recent years, machine learning method has made good progress in stock forecasting, and it has shown unique advantages over traditional methods such as fundamental analysis and technical analysis. This paper focuses on collecting the key references in the field of stock prediction that uses machine learning methods in recent years, and analyzing as well as summarizing feature engineering, the application of machine learning algorithms and the main problems in stock prediction research. The characteristics and shortcomings of each algorithm in application are reviewed, and future development direction of this field is made a thorough analysis and forecasted from the aspects of transfer learning, feature engineering and deep learning model fusion.

    Related Articles | Metrics
    Review on Human Action Recognition Methods Based on Multimodal Data
    WANG Cailing, YAN Jingjing, ZHANG Zhidong
    Computer Engineering and Applications    2024, 60 (9): 1-18.   DOI: 10.3778/j.issn.1002-8331.2310-0090
    Abstract246)      PDF(pc) (8541KB)(380)       Save
    Human action recognition (HAR) is widely applied in the fields of intelligent security, autonomous driving and human-computer interaction. With advances in capture equipment and sensor technology, the data that can be acquired for HAR is no longer limited to RGB data, but also multimodal data such as depth, skeleton, and infrared data. Feature extraction methods in HAR based on RGB and skeleton data modalities are introduced in detail, including handcrafted-based and deep learning-based methods. For RGB data modalities, feature extraction algorithms based on two-stream convolutional neural network (2s-CNN), 3D convolutional neural network (3DCNN) and hybrid network are analyzed. For skeleton data modalities, some popular pose estimation algorithms for single and multi-person are firstly introduced. The classification algorithms based on convolutional neural network (CNN), recurrent neural network (RNN), and graph convolutional neural network (GCN) are analyzed stressfully. A further comprehensive demonstration of the common datasets for both data modalities is presented. In addition, the current challenges are explored based on the corresponding data structure features of RGB and skeleton. Finally, future research directions for deep learning-based HAR methods are discussed.
    Reference | Related Articles | Metrics
    Survey of Data Fusion Based on Deep Learning
    ZHANG Hong, CHENG Chuanqi, XU Zhigang, LI Jianhua
    Computer Engineering and Applications    2020, 56 (24): 1-11.   DOI: 10.3778/j.issn.1002-8331.2007-0475
    Abstract1764)      PDF(pc) (683KB)(1890)       Save

    As data fusion is the key to maximize the value of big data, while deep learning is a technical tool for mining deep characteristic information of data, data fusion based on deep learning can fully tap the potential value of big data, thus expanding the exploration and understanding of the world to a new depth and breadth. And this paper learns the advantages of deep learning in data fusion by reviewing the literature related to data fusion based on deep learning in recent years. The common data-fusion methods are classified, the advantages and disadvantages of which are pointed out. Analysis is conducted on data fusion method based on deep learning from three perspectives, namely the data fusion method extracted based on features of deep learning, data fusion method based on deep learning fusion and data fusion method based on the whole process of deep learning, and corresponding comparisons and summaries are conducted as well. This paper summarizes the whole document, discusses the difficulties in the application of deep learning in data fusion and the problems which require further research in the future.

    Related Articles | Metrics
    Review of Path Planning Algorithms for Mobile Robots
    LIN Hanxi, XIANG Dan, OUYANG Jian, LAN Xiaodong
    Computer Engineering and Applications    2021, 57 (18): 38-48.   DOI: 10.3778/j.issn.1002-8331.2103-0519
    Abstract1148)      PDF(pc) (865KB)(627)       Save

    Path planning is one of the hot research topics of mobile robot, and it is the key technology to realize autonomous navigation of robot. In this paper, the path planning algorithms of mobile robots are studied to understand the development and application of path planning algorithms under different environments, and the research status and development of path planning are systematically summarized. According to the characteristics of mobile robot path planning, it is divided into intelligent search algorithm, artificial intelligence-based algorithm, geometric model based algorithm and local obstacle avoidance algorithm. Based on the above classification, this paper introduces the representative research results in recent years, analyzes the advantages and disadvantages of various planning algorithms, and forecasts the future development trend of mobile robot path planning, which provides some ideas for the research of robot path planning.

    Related Articles | Metrics
    Survey on Credit Card Transaction Fraud Detection Based on Machine Learning
    JIANG Hongxun, JIANG Junyi, LIANG Xun
    Computer Engineering and Applications    2023, 59 (21): 1-25.   DOI: 10.3778/j.issn.1002-8331.2302-0129
    Abstract603)      PDF(pc) (674KB)(373)       Save
    Machine learning has its distinctiveness in credit card transaction detection and faces a more complex environment. Since the intervention of human intelligence, machine learning encounters harder challenges in fraud detection than the ones of face recognition and driverlessness, which leads to failures if only applying the processes of engineering disciplines. This paper depicts the 2000-since research history of credit card anti-fraud; identifies the definition, scope, technical streams, applications, and other key concepts, and their interconnections in the field of detection oriented machine learning; analyzes the general architecture of fraud detection and summarizes the state-of-the-art of transaction fraud detection research in terms of feature engineering, models/algorithms, and evaluation metrics; discusses various detection algorithms of credit card transaction fraud and enumerates their original intention, core ideas, solution methods, advantages or disadvantages, and relevant extensions; highlights unsupervised, supervised, and semi-supervised learning models of fraud recognition, as well as various ensembles such as models cascading and aggregation; addresses three major challenges, i.e., massive data, sample skew, and concept drift, and compiles the latest progresses to alleviate these problems. This paper concludes with the limitations, controversies, and challenges of machine learning on credit card fraud recognition, and provides the trend analysis and suggestions for future research directions.
    Reference | Related Articles | Metrics
    Overview of Multi-Agent Path Finding
    LIU Zhifei, CAO Lei, LAI Jun, CHEN Xiliang, CHEN Ying
    Computer Engineering and Applications    2022, 58 (20): 43-64.   DOI: 10.3778/j.issn.1002-8331.2203-0467
    Abstract1462)      PDF(pc) (1013KB)(679)       Save
    The multi-agent path finding(MAPF) problem is the fundamental problem of planning paths for multiple agents, where the key constraint is that the agents will be able to follow these paths concurrently without colliding with each other. MAPF is widely used in logistics, military, security and other fields. MAPF algorithm can be divided into the centralized planning algorithm and the distributed execution algorithm when the main research results of MAPF at home and abroad are systematically sorted and classified according to different planning methods. The centralized programming algorithm is not only the most classical but also the most commonly used MAPF algorithm. It is mainly divided into four algorithms based on [A*] search, conflict search, cost growth tree and protocol. The other part of MAPF which is the distributed execution algorithm is based on reinforcement learning. According to different improved techniques, the distributed execution algorithm can be divided into three types:the expert demonstration, the improved communication and the task decomposition. The challenges of existing algorithms are pointed out and the future work is forecasted based on the above classification by comparing the characteristics and applicability of MAPF algorithms and analyzing the advantages and disadvantages of existing algorithms.
    Reference | Related Articles | Metrics
    Design and implementation of general battlefield visualization system
    ZHANG Hao
    Computer Engineering and Applications    2018, 54 (17): 258-265.   DOI: 10.3778/j.issn.1002-8331.1705-0318
    Abstract796)      PDF(pc) (904KB)(2088)       Save
    In order to reduce the development and using complexity of current battlefield situation information visualization system, a general battle situation visualization system is designed and implemented, especially in display element, frame and interface. The system which uses two-platform architecture including digital earth and scene simulation is able to display vast majority of battlefield elements and represents the global situation and local high-detail scene. Besides, system internal development is required no more and further application can be finished rapidly. According to the feature of generalization, the key technique about twin-engine integrates platform, multi kinds of interface for same kind rendering elements and automatic camera control is implemented. Several experimental parameters verification and tactical exercise projects working with the simulation platform are finished in the application engineering at present.
    Related Articles | Metrics
    Multi-Modal Meteorological Forecasting Based on Transformer
    XIANG Deping, ZHANG Pu, XIANG Shiming, PAN Chunhong
    Computer Engineering and Applications    2023, 59 (10): 94-103.   DOI: 10.3778/j.issn.1002-8331.2208-0486
    Abstract726)      PDF(pc) (977KB)(485)       Save
    Thanks to the rapid development of meteorological observation technology, the meteorological industry has accumulated massive meteorological data, which provides an opportunity to build new data-driven meteorological forecasting methods. Due to the long-term dependence and large-scale spatial correlation hidden in meteorological data, and due to the complex coupling relationship between different modalities, meteorological forecasting with deep learning is still a challenging research topic. This paper presents a deep learning model for meteorological forecasting based on multi-modal fusion, using sequential multi-modal data in same atmospheric pressure levels composed of four classical meteorological elements:temperature, relative humidity, U-component of wind and V-component of wind. Specifically, convolutional network is used to learn features from every modality, and with those features, the gating mechanism is introduced to multi-modal weighted fusion. Secondly, the attention mechanism is introduced, which replaces the traditional attention mechanism with parallel spatial-temporal axial attention, in order to effectively learn long-term dependencies and large-scale spatial associations. Architecturally, the Transformer encoder-decoder structure is employed as the overall framework. Extensive comparative experiments have been conducted on the regional ERA5 reanalysis dataset, demonstrating that the proposed method is effective and superior in the prediction of temperature, relative humidity and wind.
    Reference | Related Articles | Metrics
    Survey on Image Semantic Segmentation in Dilemma of Few-Shot
    WEI Ting, LI Xinlei, LIU Hui
    Computer Engineering and Applications    2023, 59 (2): 1-11.   DOI: 10.3778/j.issn.1002-8331.2205-0496
    Abstract893)      PDF(pc) (4301KB)(676)       Save
    In recent years, image semantic segmentation has developed rapidly due to the emergence of large-scale datasets. However, in practical applications, it is not easy to obtain large-scale, high-quality images, and image annotation also consumes a lot of manpower and time costs. In order to get rid of the dependence on the number of samples, few-shot semantic segmentation has gradually become a research hotspot. The current few-shot semantic segmentation methods mainly use the idea of meta-learning, which can be divided into three categories:based on the siamese neural network, based on the prototype network and based on the attention mechanism according to different model structures. Based on the current research, this paper introduces the development, advantages and disadvantages of various methods for few-shot semantic segmentation, as well as common datasets and experimental designs. On this basis, the application scenarios and future development directions are summarized.
    Reference | Related Articles | Metrics
    Small Object Detection Algorithm Based on Improved YOLOv5 in UAV Image
    XIE Chunhui, WU Jinming, XU Huaiyu
    Computer Engineering and Applications    2023, 59 (9): 198-206.   DOI: 10.3778/j.issn.1002-8331.2212-0336
    Abstract798)      PDF(pc) (808KB)(510)       Save
    UAV aerial images have many characteristics, such as large-scale changes and complex backgrounds, so it is difficult for the existing detectors to detect small objects in aerial images. Aiming at the problem of mistake detection and omission, a small object detection algorithm model Drone-YOLO is proposed. A new detection branch is added to improve the detection capability at multiple scales, meanwhile the model contains a novel feature pyramid network with multi-level information aggregation, which realizes the fusion of cross-layers information. Then a feature fusion module based on multi-scale channel attention mechanism is designed to improve the focus on small objects. The classification task of the prediction head is decoupled from the regression task, and the loss function is optimized using Alpha-IoU to improve the accuracy of detection. The experimental results of VisDrone dataset show that the Drone-YOLO has improved the AP50 by 4.91?percentage points compared with the YOLOv5, and the inference time is only 16.78?ms. Compared with other mainstream models, it has a better detection effect for small targets, and can effectively complete the task of small target detection in UAV aerial images.
    Reference | Related Articles | Metrics