I am well aware it has nothing to do with skin colour.

Black/brown/red/white/yellow shoes, black/brown/red/white/yellow hats, black/brown/red/white/yellow shirts... are perfectly fine because of actual colours.

Now, when it comes to...

Black Lists for Block Lists and White Lists for Allow Lists. Yes, there is racial psychology/metaphor behind it. It's not okay. It makes no sense at all to call it 'Black' or 'White' because clearly Block and Allow are not colours. What's wrong with actual technical terminology like 'Block Lists' and 'Allow Lists'?