This paper proposes a model-free reinforcement learning (MFRL) process control scheme using Bayesian inference (MFRL-BI) to reduce variations in manufacturing systems. The MFRL-BI controller updates the distribution of disturbances in real-time using Bayesian inference to improve control accuracy. The effectiveness of the proposed method is demonstrated in a nonlinear chemical mechanical planarization (CMP) process.