Although radiation level is a serious concern which requires continuous monitoring, many existing systems are designed to perform this task. Radiation early warning system (REWS) is one of these systems which monitor the gamma radiation level in air. Such system requires high manual intervention, depends totally on experts' analysis, and has some shortcomings that can be risky sometimes. In this paper, the approach called RIMI (refining incoming monitored incidents) will be introduced which aims to improve this system while becoming more autonomous with keeping the final decision to the experts. A new method is presented which will help in changing this system to become more intelligent while learning from past incidents of each specific system.