In this article we present a new approach for finding the generating function counting (non-singular) walks with small steps in the quarter plane. We obtain its explicit expression in terms of infinite series, while in the literature, its standard expression is given in terms of solutions to boundary value problems. As an illustration of the computational interest of our approach, we work out these new formulae for Kreweras' model: this leads to an expression for the generating function with Weierstrass Zeta functions, and eventually (using transformation theory of elliptic functions) to the well-known algebraic expression.