A double minimum six-dimensional potential energy surface (PES) is determined in symmetry coordinates for the most stable rhombic (D2h) B4 isomer in its 1Ag electronic ground state by fitting to energies calculated ab initio. The PES exhibits a barrier to the D4h square structure of 255 cm(-1). The vibrational levels (J=0) are calculated variationally using an approach which involves the Watson kinetic energy operator expressed in normal coordinates. The pattern of about 65 vibrational levels up to 1600 cm(-1) for all stable isotopomers is analyzed. Analogous to the inversion in ammonia-like molecules, the rhombus rearrangements lead to splittings of the vibrational levels. In B4 it is the B1g (D4h) mode which distorts the square molecule to its planar rhombic form. The anharmonic fundamental vibrational transitions of 11B4 are calculated to be (splittings in parentheses): G(0)=2352(22) cm(-1), nu1(A1g)=1136(24) cm(-1), nu2(B1g)=209(144) cm(-1), nu3(B2g)=1198(19) cm(-1), nu4(B2u)=271(24) cm(-1), and nu5(Eu)=1030(166) cm(-1) (D4h notation). Their variations in all stable isotopomers were investigated. Due to the presence of strong anharmonic resonances between the B1g in-plane distortion and the B2u out-of-plane bending modes, the higher overtones and combination levels are difficult to assign unequivocally.