We propose an extension of the Fokker-Planck model of the Boltzmann equation to get a correct Prandtl number in the Compressible Navier-Stokes asymptotics for polyatomic gases. This is obtained by replacing the diffusion coefficient (which is the equilibrium temperature) by a non diagonal temperature tensor, like the Ellipsoidal-Statistical model is obtained from the Bathnagar-Gross-Krook model of the Boltzmann equation, and by adding a diffusion term for the internal energy. Our model is proved to satisfy the properties of conservation and a H-theorem. A Chapman-Enskog analysis shows how to compute the transport coefficients of our model. Some numerical tests are performed to illustrate that a correct Prandtl number can be obtained.