The exponentially weighted moving average (EWMA) control chart is a memory-type chart known to be more efficient in detecting small and moderate shifts in the process parameter. The double EWMA (DEWMA) chart is an extension of the EWMA chart that is more effective than the latter in the detection of small-to-moderate shifts. This paper proposes a new distribution-free (or nonparametric) triple EWMA (TEWMA) control chart based on the Wilcoxon rank-sum (W) statistic to improve the detection ability in the process location parameter. Moreover, a new fast initial response (FIR) feature is added to further improve the sensitivity of the new TEWMA chart. The performance of the proposed TEWMA chart with and without FIR features is compared to those of the existing EWMA and DEWMA W charts. It is observed that the TEWMA chart with and without FIR features is superior to the competing charts in most situations. A real-life illustration is provided to show the application and implementation of the new chart.