Objective: Our goal is to use existing and to propose new time-frequency entropy measures that objectively evaluate the improvement on epileptic patients after medication by studying their resting state EEG recordings. An increase in the complexity of the signals would confirm an improvement in the general state of the patient. Methods: We review the Rényi entropy based on time-frequency representations, along with its time-varying version. We also discuss the entropy based on singular value decomposition computed from a time-frequency representation, and introduce its corresponding time-dependant version. We test these quantities on synthetic data. Friedman tests are used to confirm the differences between signals (before and after proper medication). Principal component analysis is used for dimensional reduction prior to a simple threshold discrimination. Results: Experimental results show a consistent increase in complexity measures in the different regions of the brain. These findings suggest that extracted features can be used to monitor treatment. When combined, they are useful for classification purposes, with areas under ROC curves higher than 0.93 in some regions. Conclusion: Here we applied time-frequency complexity measures to resting state EEG signals from epileptic patients for the first time. We also introduced a new time-varying complexity measure. We showed that these features are able to evaluate the treatment of the patient, and to perform classification. Significance: The time-frequency complexities, and their time-varying versions, can be used to monitor the treatment of epileptic patients. They could be applied to a wider range of problems.