'Compromise' in a allo-ace relationship

I've been feeling guilty over hypotheticals lately. I'm not in a relationship at the moment, but I've been thinking about how I could never probably date an allo person.

Let's say they want sex however many days -- I simply don't want sex at all. The 'compromise' would be to have sex less frequently than they'd like and more frequently than I'd like, but it doesn't really feel like a compromise to me. I feel like not having sex is the default for everyone, a neutral state that you only get to experience sometimes. To have sex even rarely to me just feels like I'd be losing. I feel bad because relationships inherently involve sometimes having to sacrifice your preferences for the one you love, but I just can't. I feel selfish and horrible. At least I'm not actually in this situation I guess.