I’m dealing with a similar thing with poultry right now. If I eat it too frequently, it gives me ridiculous, flu and allergy-like symptoms. However, now that I’ve basically eliminated it from my diet, I can eat it on occasion without much issue.
It took me forever to figure out because poultry is often a filler meat.