Bring your Service in Pagerduty into maintenance mode, and out of it - in an ansible role

See Ansible Galaxy here

Or go directly to the git repo