Zinc phosphate glasses (ZPG) are of interest because of their femto-second response and chemical durability. The present investigation has been done to enhance the physical properties of ZPG by adding external guest graphitic particles. In this investigation, we present the synthesis and characterization of zinc phosphate glass (ZPG) and its composites with different volume fractions of the graphite particles. The homogenous mixing of filler into the host zinc phosphate glass matrix is evident from X-ray diffraction (XRD), energy-dispersive X-ray (EDX) spectroscopy, and Scanning electron microscopy (SEM). Fourier-transform infrared (FTIR) spectroscopy reveals the decrease of the hygroscopicity of zinc phosphate glass with filler content. Moreover, the thermal conductivity of ZPG is estimated as a function of graphite volume fraction using the infrared photothermal radiometry technique (PTR). The experimental behavior of thermal conductivity has been further explained via Nan's model. Additionally, the electrical conductivity of zinc phosphate glass and its composites has also been determined. The observed enhancement in the electrical conductivity of ZPG with the addition of filler volume fraction is attributed to the percolation mechanism of graphitic particles. This study evinces the potential use of ZPG/graphite composites in the smart glasses, battery materials, and superior thermoelectric materials.