You have the talent to educate and influence; you should not shy away from battle. While you think your son needs a better place and you question your influence on the community, remember, one mitzvah does not hurt another; on the contrary, staying there and helping your community will bring you Hashem's help with your children.
https://www.torahrecordings.com/rebbe/igroskodesh/012/007/4239