Within the framework of the Kibble-Zurek Mechanism, we investigate the universal behavior of the non-equilibrium critical fluctuations, using the Langevin dynamics of model A. With properly located typical time, length and angle scales, $\tau_{\mbox{\tiny KZ}}$, $l_{\mbox{\tiny KZ}}$, and $\theta_{\mbox{\tiny KZ}}$, the constructed function $\bar{f}_n((\tau-\tau_c)/\tau_{\mbox{\tiny KZ}},\theta_{\mbox{\tiny KZ}})$ for the cumulants of the sigma field show universal behavior near the critical point, which are independent from some non-universal factors, such as the relaxation time or the evolution trajectory.