Given that 'love your neighbor as yourself' is a fundamental principle in the Torah, ahavat chinam extends to those beyond the scope of 'your friend, your neighbor' (including those who may not be religious), yet you still love them.
https://www.torahrecordings.com/rebbe/igroskodesh/012/005/4135