Under the Basel II accord, a single factor model characterizes the regulatory capital calculations and the portfolio credit risk of the internal ratings based approach. However, this model assumes independent and identically distributed common factor which may produce inaccurate estimates of default probabilities and asset correlation. In this paper, we address a dynamic factor model to improve this phenomenon. This model can capture both dynamic behavior of default risk and dependence among individual obligors. We use a Monte Carlo Expectation Maximization (MCEM) algorithm along with a Gibbs sampler and an acceptance methods when estimating the unknown parameters. Moreover, the empirical study using the default data from the Standard and Poor's shows evidence of profound serial dependence of the default rate in the Standard and Poor's data.