Understanding the Gap between 2D and 3D Skeleton-Based Action
Recognition

D 2019

Understanding the Gap between 2D and 3D Skeleton-Based Action Recognition

ELIÁŠ, Petr, Jan SEDMIDUBSKÝ a Pavel ZEZULA

Základní údaje

Originální název

Understanding the Gap between 2D and 3D Skeleton-Based Action Recognition

Autoři

ELIÁŠ, Petr (203 Česká republika, domácí), Jan SEDMIDUBSKÝ (203 Česká republika, domácí) a Pavel ZEZULA (203 Česká republika, domácí)

Vydání

Neuveden, 21st IEEE International Symposium on Multimedia (ISM), od s. 192-195, 4 s. 2019

Nakladatel

IEEE Computer Society

Další údaje

Jazyk

angličtina

Typ výsledku

Stať ve sborníku

Obor

10200 1.2 Computer and information sciences

Utajení

není předmětem státního či obchodního tajemství

Forma vydání

elektronická verze "online"

Kód RIV

RIV/00216224:14330/19:00107709

Organizační jednotka

Fakulta informatiky

ISBN

978-1-72815-606-4

DOI

http://dx.doi.org/10.1109/ISM46123.2019.00041

UT WoS

000528909200030

Klíčová slova anglicky

2D skeleton data;3D skeleton data;action recognition;LSTM;motion data understanding

Štítky

DISA, firank_B

Příznaky

Mezinárodní význam, Recenzováno

Změněno: 28. 4. 2020 00:07, RNDr. Pavel Šmerk, Ph.D.

Anotace

V originále

Large volumes of RGB video data are recorded and processed every day. One of the embedded data modality within these videos is the information about human motions. Up to now, this information has been almost unfeasible to extract, and thus human-motion understanding research has been mainly limited to 3D skeleton data captured by dedicated hardware only. However, with recent advances in computer vision, it is possible to estimate 2D skeleton sequences from ordinary videos quite accurately. Such 2D skeleton data possess an excellent potential for future motion understanding applications. In this paper, we adopt a state-of-the-art bidirectional LSTM network to analyze the accuracy gap in the expressive power of 2D and 3D skeleton data recorded simultaneously on a high number of 20k human actions. We further examine how the missing depth information and fluctuations in 2D skeleton sizes influence the recognition rate. We also demonstrate the suitability of 2D skeleton data for general daily activity recognition by reporting baselines on the PKU-MMD dataset.

Návaznosti

GA19-02033S, projekt VaV

Název: Vyhledávání, analytika a anotace datových toků lidských pohybů

Investor: Grantová agentura ČR, Searching, Mining, and Annotating Human Motion Streams

Citovat

ELIÁŠ, Petr, Jan SEDMIDUBSKÝ a Pavel ZEZULA. Understanding the Gap between 2D and 3D Skeleton-Based Action Recognition. Online. In 21st IEEE International Symposium on Multimedia (ISM). Neuveden: IEEE Computer Society, 2019, s. 192-195. ISBN 978-1-72815-606-4. Dostupné z: https://dx.doi.org/10.1109/ISM46123.2019.00041.

@inproceedings{1566959,
   author = {Eliáš, Petr and Sedmidubský, Jan and Zezula, Pavel},
   address = {Neuveden},
   booktitle = {21st IEEE International Symposium on Multimedia (ISM)},
   doi = {http://dx.doi.org/10.1109/ISM46123.2019.00041},
   keywords = {2D skeleton data;3D skeleton data;action recognition;LSTM;motion data understanding},
   howpublished = {elektronická verze "online"},
   language = {eng},
   location = {Neuveden},
   isbn = {978-1-72815-606-4},
   pages = {192-195},
   publisher = {IEEE Computer Society},
   title = {Understanding the Gap between 2D and 3D Skeleton-Based Action Recognition},
   year = {2019}
}

TY  - JOUR
ID  - 1566959
AU  - Eliáš, Petr - Sedmidubský, Jan - Zezula, Pavel
PY  - 2019
TI  - Understanding the Gap between 2D and 3D Skeleton-Based Action Recognition
PB  - IEEE Computer Society
CY  - Neuveden
SN  - 9781728156064
KW  - 2D skeleton data;3D skeleton data;action recognition;LSTM;motion data understanding
N2  - Large volumes of RGB video data are recorded and processed every day. One of the embedded data modality within these videos is the information about human motions. Up to now, this information has been almost unfeasible to extract, and thus human-motion understanding research has been mainly limited to 3D skeleton data captured by dedicated hardware only. However, with recent advances in computer vision, it is possible to estimate 2D skeleton sequences from ordinary videos quite accurately. Such 2D skeleton data possess an excellent potential for future motion understanding applications. In this paper, we adopt a state-of-the-art bidirectional LSTM network to analyze the accuracy gap in the expressive power of 2D and 3D skeleton data recorded simultaneously on a high number of 20k human actions. We further examine how the missing depth information and fluctuations in 2D skeleton sizes influence the recognition rate. We also demonstrate the suitability of 2D skeleton data for general daily activity recognition by reporting baselines on the PKU-MMD dataset.
ER  -

ELIÁŠ, Petr, Jan SEDMIDUBSKÝ a Pavel ZEZULA. Understanding the Gap between 2D and 3D Skeleton-Based Action Recognition. Online. In \textit{21st IEEE International Symposium on Multimedia (ISM)}. Neuveden: IEEE Computer Society, 2019, s.~192-195. ISBN~978-1-72815-606-4. Dostupné z: https://dx.doi.org/10.1109/ISM46123.2019.00041.

Podrobný výpis o publikaci