Local influence analysis is an important statistical method for studying the sensitivity of a proposed model to model inputs. One of its important issues is related to the appropriate choice of a perturbation vector. In this paper, we develop a general method to select an appropriate perturbation vector and a second-order local influence measure to address this issue in the context of latent variable models. An application to nonlinear structural equation models is considered. Six perturbation schemes are investigated, including three schemes under which simultaneous perturbations are made on components of latent vectors to assess the influence of these components and pinpoint the influential ones. The proposed procedure is illustrated by artificial examples and a simulation study as well as a real example.