There is something to be said for that, but ignoring the differences doesn't mean you are being fair. Having the same rights doesn't mean we all come from the same place or go about things the same way. There is respect in acknowledging that.
Isn't racism, at its root, about respect? I respect you as a person and not because of what race you are or are not. I afford everyone an equal amount of respect, regardless of their race. I don't disrespect someone purely because they belong to any specific race (or don't belong).
Not all black music, I imagine, and not all black artists, but I sure as hell wouldn't take it upon myself to tell a black man or woman how to feel about someone adopting their cultural expression. It would be a dick move. Like what, they need more entitlement and infantilizing? I'll pass.
For the music argument, I see an argument that "black" music has to be afforded a level of respect from "white" artists that "black" musicians don't have to give "white" artists/music on account of them being black and white artists being white. There's probably no argument that will get me on board with that.