Generally considered safe for most people, annatto color is also linked to potential health benefits including reduced inflammation. It has antioxidant, antimicrobial, and anticancer properties. However, some people may experience an allergic reaction to annatto which can cause itchiness, swelling, low blood pressure, hives, and stomach pain. It can also trigger symptoms of IBS (irritable bowel syndrome) in some situations.