Nanocomposite polymer electrolytes based on a plasticized high molecular weight poly(oxyethylene) (POE) reinforced with high aspect ratio cellulose nanoparticles were reported. The influence of tetra(ethylene) glycol dimethyl ether (TEGDME) as plasticizer is investigated. The study mainly focuses on the dynamic mechanical behavior and ionic conductivity performances. The miscibility of the blend POE/TEGDME was investigated using both thermal and mechanical investigations. Viable polymer electrolytes can be obtained from this combination, conciliating acceptable ionic conductivities and outstanding mechanical performances on a large temperature range.