Most research works on frequency-selective (FS) millimeter wave (mmWave) hybrid multiple-input multiple-output (MIMO) systems opted to use orthogonal frequency-division multiplexing (OFDM) waveform, while rare studies adopted filter bank based multicarrier (FBMC) waveform for such systems! Isn’t FBMC compatible for mmWave hybrid MIMO systems? In this paper we investigate these inquiries. In which we design orthogonal matching pursuit based hybrid precoding and combining algorithms with limited feedback to adopt FBMC-offset quadrature amplitude modulation (OQAM) signaling for FS mmWave MIMO systems. Simulation results show that FBMC-OQAM can be a feasible candidate signaling waveform for mmWave hybrid MIMO systems.