Zulip supports Puppet integration and can notify you when Puppet runs fail (or when they happen at all).

You can follow the instructions at https://forge.puppetlabs.com/mbarr/puppet_zulip to get it set up.

Thanks to Matt from Kensho for submitting this integration!