Not every tough issue black people go through is due to racism