Surveillance systems such as object tracking and detection systems typically rely on a single modality of color video for their input. These systems work well in controlled conditions but often fail when low lighting, shadowing, smoke, dust or unstable backgrounds are present, or when the objects of