Does anyone else have a 'gray' mindset/perspective?

I don't always see everything as black or white. There are numerous times when I see gray. As in, I see both sides of things, and I don't necessarily pick a side, but I understand both. This has caused arguments and turmoil in some relationships and friendships, as they feel that I'm not on their side and that I'm defending the other when, genuinely, I see and have empathy for both.

Now, there are certain things I AM black or white about, but it seems I'm gray in a lot of others. I feel like I just can't help it sometimes because although some people might believe something (or a situation) is wrong, I might somewhat agree but also, at the same time, feel empathy and understand why that person did it or why that thing happened. I can see how this can be annoying to others, but maybe I'm just too empathetic? Idk, but I'd like to hear from other INFJs.

I know this is vague so far, so if anyone needs better examples, please let me know