In many control engineering problems, it is desired to analyze the systems at particular frequency intervals of interest. This paper focuses on the development of frequency interval cross gramians for both linear and bilinear systems. New generalized Sylvester equations for calculating the frequency interval cross gramians are derived in order to be used to obtain information regarding controllability and observability within a single matrix. The advantage of the proposed method is that it is computationally more efficient compared to existing gramian-based techniques since only half of the number of equations need to be solved in order to obtain information regarding the controllability and observability of a system compared to existing techniques. Numerical examples are provided to demonstrate the computational efficiency of the proposed method which uses frequency interval cross gramians relative to existing methods.