In practice, sometimes the process data did not come from a known population distribution. So the commonly used Shewhart variables control charts are not suitable since their performance could not be properly evaluated. In this paper, we propose a new EWMA Control Chart based on a simple statistic to monitor the small mean shifts in the process with non-normal or unknown distributions. The sampling properties of the new monitoring statistic are explored and the average run lengths of the proposed chart are examined. Furthermore, an Arcsine EWMA Chart is proposed since the average run lengths of the Arcsine EWMA Chart are more reasonable than those of the new EWMA Chart. The Arcsine EWMA Chart is recommended if we are concerned with the proper values of the average run length.