Accurate Single-Stream Action Detection in Real-Time - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Accurate Single-Stream Action Detection in Real-Time

Yu Liu
  • Fonction : Auteur
  • PersonId : 1061036
Fan Yang
Dominique Ginhac


Analyzing videos of human actions involves understanding the spatial and temporal context of the scenes. State-of-the-art action detection approaches have demonstrated impressive results using Convolutional Neural Networks (CNNs) within a two-stream framework. However, most of them operate in a non-real-time, offline fashion, thus are not well-equipped in many emerging real-world scenarios such as autonomous driving and public surveillance. In addition, they are computationally demanding to be deployed on devices with limited power resources (e.g., embedded systems). To address the above challenges, we propose an efficient single-stream action detection framework by exploiting temporal coherence between successive video frames. This allows CNN appearance features to be cheaply propagated by motions rather than being extracted from every frame. Furthermore, we utilize an implicit motion representation to amplify appearance features. Our method based on motion-guided and motion-aware appearance features is evaluated on the UCF-101-24 dataset. Experiments indicate that the proposed method can achieve real-time action detection up to 32 fps with a comparable accuracy as the two-stream approach.
Fichier principal
Vignette du fichier
camera-ready-liu2019 (1).pdf (1.01 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02412443 , version 1 (15-12-2019)



Yu Liu, Fan Yang, Dominique Ginhac. Accurate Single-Stream Action Detection in Real-Time. 13th International Conference on Distributed Smart Cameras (ICDSC 2019), Sep 2019, Trento, Italy. pp.1-6, ⟨10.1145/3349801.3349821⟩. ⟨hal-02412443⟩
70 Consultations
222 Téléchargements



Gmail Facebook Twitter LinkedIn More