Multiple Object Tracking with attention to Appearance, Structure, Motion and Size [on] [MASS]

Submitted on 17 Apr. 2019 04:37 by
Handuo Zhang (Nanyang Technological University)

Running time:0.01s

Method Description:
Objective of multiple object tracking (MOT) is to
assign a unique track identity for all the
objects of interest in a video, across the whole
sequence. Tracking-by-detection is the most
common approach used in addressing MOT problem.
In this work, we propose a method to address MOT
by defining a dissimilarity measure based on
object motion, appearance, structure, and size.
We calculate the appearance and structure-based
dissimilarity measure by matching histograms
following a grid architecture. Motion and size
for each track are predicted using the
information from track’s history. These
dissimilarity values are then used in the
Hungarian algorithm, in the data association step
for track identity assignment. In addition, we
introduce a method to address any false detection
in stable tracks. The proposed method runs in
real time following an online approach. We
evaluate our method in both MOT17 benchmark data-
set for pedestrian tracking and KITTI benchmark
data-set for vehicle tracking using the same
system parameters to verify the robustness of the
proposed method. The method can achieve state-of-
the-art results in both benchmarks.
Latex Bibtex:
title={Multiple Object Tracking with attention to
Appearance, Structure, Motion and Size},
author={Karunasekera, Hasith and Wang, Han and
Zhang, Handuo},
journal={IEEE Access},

Detailed Results

From all 29 test sequences, our benchmark computes the HOTA tracking metrics (HOTA, DetA, AssA, DetRe, DetPr, AssRe, AssPr, LocA) [1] as well as the CLEARMOT, MT/PT/ML, identity switches, and fragmentation [2,3] metrics. The tables below show all of these metrics.

Benchmark HOTA DetA AssA DetRe DetPr AssRe AssPr LocA
CAR 68.25 % 72.92 % 64.46 % 76.83 % 85.14 % 72.12 % 81.46 % 86.80 %

Benchmark TP FP FN
CAR 30247 4145 786

CAR 84.64 % 85.36 % 85.66 % 353 71.76 %

Benchmark MT rate PT rate ML rate FRAG
CAR 74.00 % 23.08 % 2.92 % 516

Benchmark # Dets # Tracks
CAR 31033 808

This table as LaTeX

This figure as: png pdf

[1] J. Luiten, A. Os̆ep, P. Dendorfer, P. Torr, A. Geiger, L. Leal-Taixé, B. Leibe: HOTA: A Higher Order Metric for Evaluating Multi-object Tracking. IJCV 2020.
[2] K. Bernardin, R. Stiefelhagen: Evaluating Multiple Object Tracking Performance: The CLEAR MOT Metrics. JIVP 2008.
[3] Y. Li, C. Huang, R. Nevatia: Learning to associate: HybridBoosted multi-target tracker for crowded scene. CVPR 2009.

eXTReMe Tracker