I would suggest to find out the cause of non-normality. Do not adjust the control limits. Outliers should guide you in the direction of cause and effect. What is the gage r & r for the measurement system? How was the data collected? What are the KPIVs for the process control?