It happens to me with avocado. Intolerance would be the better word for it. Whenever ordering sushi I need to pick it out or I’ll have a painful digestion (and nausea) later on. Some avocados hit really bad and others I’ve eaten pieces accidentally without major consequences but anyway, I find most people don’t understand the word ‘intolerant’ or maybe they don’t give a fuck, whereas if you say ‘allergic’ you have their attention.