This paper presents a new optimal window design method with a general window design specification for the passband and stopband. The design problem is formulated as a semi-infinite linear programming problem. With suitable discretizations, an exchange algorithm is employed. The convergence of the proposed algorithm is established. In the formulation, since the stopband is minimized, the method can be employed for the design of very highly optimized windows.