We design a Hybrid High-Order method for elliptic problems on curved domains. The method uses a cut cell technique for the representation of the curved boundary and imposes Dirichlet boundary conditions using Nitsche's method. The physical boundary can cut through the cells in a very general fashion and the method leads to optimal error estimates in the H1-norm.