A large number of surveillance applications require fast action, and since many surveillance applications, motive objects contain most critical information. Fast detection algorithm system becomes a necessity. A problem in computer vision is the determination of weights for multiple objective function optimizations. In this paper we propose techniques for automatically determining the weights, and discuss their properties. The Min-Max Principle, which avoids the problems of extremely low or high weights, is introduced. Expressions are derived relating the optimal weights, objective function values, and total cost. Simulation results show, compared to the conventional work, it can achieve around 40% time saving and higher detection accuracy for both outdoor and indoor surveillance videos.