We demonstrate a table-top source delivering ultra-broadband THz pulses with electric field strength exceeding 100 kV/cm at a repetition rate of 200 kHz. The source is based on optical rectification of 23 fs pulses at 1030 nm delivered by a ytterbium-doped fiber laser followed by a nonlinear temporal compression stage. We generate THz pulses with a conversion efficiency of up to 0.11 % with a spectrum extending to 11 THz using a 1 mm thick GaP crystal and a conversion efficiency of 0.016 % with a spectrum extending to 30 THz using a 30 µ m thick GaSe crystal. The essential features of the emitted THz pulse spectra are well captured by simulations of the optical rectification process relying on coupled nonlinear equations. Our ultrafast laser-based source uniquely satisfies an important requirement of nonlinear THz experiments, namely the emission of ultra-broadband THz pulses with high electric field amplitudes at high repetition rates, opening a route towards nonlinear time-resolved THz experiments with high signal-to-noise ratios.