Am I being a nit picker or did I have a valid point?

If he truly meant that he wants you to be his exclusive then it shouldn't be a problem and he should respect your limitations and differences, but at the same time you have to understand and respect his limitations and differences. If he restricts of something you ask then you have to understand him in order for him to understand you. Relationships fails when only one recieves and one gives both of you have to give and take and when that occurs the relationship will bring peace and prosperity.