Multi-camera Tracklet association and fusion using ensemble of visual and geometric cues - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue IEEE Transactions on Circuits and Systems for Video Technology Année : 2017

Multi-camera Tracklet association and fusion using ensemble of visual and geometric cues

Résumé

Data association and fusion is pivot for object tracking in multi-camera network. We present a novel framework for solving online multi-object tracking in partially overlapping multi-camera network by modelling tracklet association as combinatorial optimization problem hypothesized on ensemble of cues such as appearance, motion and geometry information. Our method learns discriminant weight as a measure of consistency and discriminancy of feature patterns to make ensemble feature selection and combination between local and global tracking information. Our approach contributes uniquely in the way tracklet selection, association and fusion is done. Once multi-view correspondences are established using planar homography, Dynamic Time Warping algorithm is used to make tracklet selection for which similarity has to be calculated i.e overlapping tracklets and subtracklets. Then trajectory similarities are computed for these selective tracklets and subtracklets using ensemble of appearance and motion cues weighted by online learnt discriminative function. Later on, we tackle the association problem by building a k-partite graph and association rules to match all the pair-wise trackets. Finally, from outcome of hungarian algorithm, the associated trajectories are later fused. Fusion is done based on calculated individual tracklet reliability criteria. Experimental results demonstrate our system achieve performance that significantly improve the state of the art on PETS 2009.
Fichier principal
Vignette du fichier
V4.1.2.pdf (580.5 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01849546 , version 1 (27-07-2018)

Identifiants

Citer

Kanishka Nithin, François Bremond. Multi-camera Tracklet association and fusion using ensemble of visual and geometric cues. IEEE Transactions on Circuits and Systems for Video Technology, 2017, 27 (3), pp.431 - 440. ⟨10.1109/TCSVT.2016.2615538⟩. ⟨hal-01849546⟩
185 Consultations
1173 Téléchargements

Altmetric

Partager

More