This work extends the idea of the traditional complex-amplitude expanded phase field crystal (APFC) model using the Ginzburg-Landau approach. A fast structural APFC model is proposed as a quick and effective method for describing different crystal structures. Taking square and rectangular phases as examples, we systematically determine the structure-dependent parameters in the fast structure APFC model and validates its effectiveness through numerical simulations. In particular, when dealing with rectangular phases, it is found that this method not only solves the stability problem of the rectangular phase but also describes the structural phase transition between rectangular and orthorhombic layered phases, demonstrating the capability of the model in describing multiple structural phase transitions. Finally, through simulating the classic rotation-shrinking of a circular grain, we confirm the ability of the model for correctly predicting physical laws and reveal the roles of different crystal symmetries on the rotation-shrinking behavior of the grain. The proposed method in this paper can effectively promote the application of APFC models in the simulation research of more and larger material systems.