I suspect "not on the radar" is accurate - and prejudice tends to be less of a factor when groups are not perceived as a threat. (My husband grew up on the Oregon coast and says that any racism he heard growing up was far more likely to be directed against Latino farm workers than against people of African ancestry. Because Latinos were the "other" they saw.)