Accurate control of the polarization states of laser light is important in precision measurement experiments. In experiments involving the use of a vacuum environment, the stress-induced birefringence effect of the vacuum windows will affect the polarization states of laser light inside the vacuum system, and it is very difficult to measure and optimize the polarization states of the laser light in situ. The purpose of this protocol is to demonstrate how to optimize the polarization states of the laser light based on the fluorescence of ions in the vacuum system, and how to calculate the birefringence of vacuum windows based on azimuthal angles of external wave plates with Mueller matrix. The fluorescence of Mg ions induced by laser light that is resonant with the transition of |3P3/2,F = 4, mF = 4 → |3S1/2,F = 3, mF = 3 is sensitive to the polarization state of the laser light, and maximum fluorescence will be observed with pure circularly polarized light. A combination of half-wave plate (HWP) and quarter-wave plate (QWP) can achieve arbitrary phase retardation and is used for compensating the birefringence of the vacuum window. In this experiment, the polarization state of the laser light is optimized based on the fluorescence of Mg ion with a pair of HWP and QWP outside the vacuum chamber. By adjusting the azimuthal angles of the HWP and QWP to obtain maximum ion fluorescence, one can obtain a pure circularly polarized light inside the vacuum chamber. With the information on the azimuthal angles of the external HWP and QWP, the birefringence of the vacuum window can be determined.