Based on incomplete Cholesky decomposition with two thresholds,we propose an improved incomplete Cholesky conjugate gradient (ICCG) method with diagonal elements modification.It ensures accurate and efficient decomposition and solution of large scale sparse linear equations. The method shows advantage in computing time and storage requirment.It is applicable to solve the systems of linear equations from FEM finite element method.