We need to reduce noise in our inboxes, so development experiments should not trigger email alerts. Proposed to add tiers to the manifest, that status can interpret - is this "production," "development," or "maintenance" with proposed behaviours being:
production - email alert when health status changes
development / maintenance - no email alerts