Process control is crucial in semiconductor manufacturing to reduce variations and enhance product quality. This study introduces reinforcement learning (RL) methods for process control, proposing a new RL-based controller that outperforms traditional run-to-run controllers, especially in handling complex nonlinear processes.