Let $M$ be a smooth manifold. Let $X \in \Gamma(TM)$ be a vector field on $M$, which vanishes at a finite number of points. (Every smooth manifold admits such a vector field).
Consider the subgroup $\{\phi \in \operatorname{Diff}(M)| \phi_*X=X \}$?
Is it always a finite dimensional Lie group? Or can it be infinite-dimensional?