Think about it. Isn’t light+eyes and ears+sound just the same in terms of their “influence at a distance”? We don’t feel that as abnormal or magic - simply because we’ve sensors for them and are used to it. But physically speaking light and magnetism are based on electromagnetic forces.
source of sorts
Earth's field is very large and very weak compared to small strong household magnets.
Whatever senses we've evolved for navigation could be dealing in a completely different scales so as to be useless.
It might be like trying to use a 5ml teaspoon to measure the volume liquid in a of a bathtub.
or using an alcohol thermometer to measure the temperature of molten iron