A Malleable Boundary Network for temporal action detection - Université de technologie de Troyes Accéder directement au contenu
Article Dans Une Revue Computers and Electrical Engineering Année : 2022

A Malleable Boundary Network for temporal action detection

Résumé

Temporal action detection in untrimmed videos is a challenging task aiming to predict the boundary and category of action instances. It can be useful in transportation. In this study, we propose a two-stage framework Malleable Boundary Network (MB-Net) to adaptively regress proposals based on finer scores. In particular, MB-Net consists of a Potential Boundary Generator in the first stage and an Adaptive Proposal Detector in the second stage. First, the Potential Boundary Generator fuses multiple sets of flexible score sequences to obtain tentative proposals through a frame-level feature in an anchor-free way. Then, the Adaptive Proposal Detector employs parallel modules to filter, classify and regress proposals adaptively. Besides, we propose an easy-to-realize feature augmented method Structured Temporal Segment Pooling, which makes full use of the information throughout the whole proposal. Experiments show that MB-Net achieves state-of-the-art performance on popular benchmarks THUMOS-14 and Activity-1.3 with an improvement of 1.9% and 1.2%.
Fichier non déposé

Dates et versions

hal-04447402 , version 1 (08-02-2024)

Identifiants

Citer

Tian Wang, Boyao Hou, Zexian Li, Zhe Li, Lei Huang, et al.. A Malleable Boundary Network for temporal action detection. Computers and Electrical Engineering, 2022, 103 (1), pp.108250. ⟨10.1016/j.compeleceng.2022.108250⟩. ⟨hal-04447402⟩
16 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More