Dense, time-varying range data acquisition from stereo pairs of thermal and intensity images

We propose a new method for acquiring time-sequential range images that provide dense range data. In our approach, stereo pairs of thermal and intensity images are synchronously acquired and are mutually registered. The thermal images are segmented into isotemperature regions. Contour-based matching is done for the isotemperature regions in the thermal images independently at each time instant, and by temporal correspondence, possible matching pairs of contours are generated. By evaluating the similarities of the pairs, consistent and likely pairs are chosen. To get dense range data, intensity profiles within the isotemperature regions are matched by dynamic programming. Experiments on real scenes, including a sequence showing a moving human being, show promising results.