This paper presents the Renewal platform and the new features it will provide for the online evaluation of news recommender systems. The platform is currently under development. In future organized competitions, it will allow the collection of real-time feedback from users reading news stories through a dedicated mobile application in order to evaluate competing recommender systems in online settings. We discuss the benefits over offline settings and the differences with existing online platforms dedicated to this task. We also present the results of a simulation allowing us to determine under which conditions, notably in terms of number of users and number of evaluation days, it is possible to organize a Renewal competition.