A Multihead Attention Self-Supervised Representation Model for Industrial Sensors Anomaly Detection - Université de technologie de Troyes Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Industrial Informatics Année : 2024

A Multihead Attention Self-Supervised Representation Model for Industrial Sensors Anomaly Detection

Yiqun Qiao
Jinhu Lü
Tian Wang
Kexin Liu
Baochang Zhang

Résumé

Industrial sensors capture critical information for intelligent manufacturing maintenance. To promote equipment upgrading and manufacturing processes, intelligent decisions, and information learning play an important role. Although deep learning methods historically obtain excellent results, there is always a trade-off between fine-tuning existing networks or designing models from scratch for sensor data processing. In this paper, we propose the multi-head attention self-supervised (MAS) representation model, which is a self-supervised learning-based sensor feature extraction network. To the best of our knowledge, this is the first time a self-supervised contrastive learning method using positive samples that represent multi-dimensional industry sensor data is being used for anomaly detection. We review alternative data augmentation methods proposed for better-representing sensor sequence data. We use this insight to design a new structure that adapts to the temporal characteristics of the application. We apply our method to a real-world water circulation system that uses a variety of industrial sensors. The effectiveness of the proposed MAS methods is demonstrated.
Fichier non déposé

Dates et versions

hal-04429273 , version 1 (31-01-2024)

Identifiants

Citer

Yiqun Qiao, Jinhu Lü, Tian Wang, Kexin Liu, Baochang Zhang, et al.. A Multihead Attention Self-Supervised Representation Model for Industrial Sensors Anomaly Detection. IEEE Transactions on Industrial Informatics, 2024, 20 (2), pp.2190-2199. ⟨10.1109/TII.2023.3280337⟩. ⟨hal-04429273⟩
9 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More