ade55dc39c
Fix PATH for Postgres backup cron job
...
(imported from commit 9e4b868d444d73f9eab1507851b1b3ab47655977)
2013-08-28 15:16:25 -04:00
cfb623ae5c
Bump os x app to 0.3.6
...
(imported from commit 51ddf87797a94b97dec8ce998a08a83ed8837196)
2013-08-28 14:20:20 -04:00
1d13c091ef
pg_backup_and_purge.py: Set up logging
...
(imported from commit 0948f548b005505a7f0c38c3af245815ec9efd6c)
2013-08-28 13:30:51 -04:00
9d895e53d5
Add SHELL, PATH, and ROOT variables to crontab
...
(imported from commit 3e556b12bb1c5332bd08ba267d24e0dd524bff7d)
2013-08-27 17:28:07 -04:00
071415ae93
Update desktop apps to 0.3.5 in sparkle
...
(imported from commit cf7c1b9dbbc0cbda5c4776d7b4f523f9f4f885a8)
2013-08-27 15:42:06 -04:00
611955e9fa
zephyr_mirror: Use the new reasonable --log-path option.
...
(imported from commit 2208e4c47cf49e3005cc3b93314b8c2a0ffc23c6)
2013-08-27 14:21:26 -04:00
1ece1c17c3
zephyr_mirror: Stop logging to the old resend log.
...
We were intending to just be directing the logger logs, not logging
every message for potentially resending.
(imported from commit 9dd53e3968880745a8c01244db5d2c2247dfe85c)
2013-08-27 14:21:26 -04:00
92623c74e9
Fix comment typo
...
(imported from commit 6da9e7d98f790a0728dfe3338f18e91d93afb464)
2013-08-27 13:44:26 -04:00
7409e81775
Add nagios alert for Postgres backups
...
(imported from commit 1ffe019b898751aea215dda1826113c1df5bee5c)
2013-08-27 13:29:41 -04:00
ee0a3e55b7
puppet: Don't restart all services when doing supervisor config update.
...
(imported from commit 767dc26293f301ee18fc149156ad43ad1bd4b43c)
2013-08-26 18:17:26 -04:00
3152a8ef6e
nagios: Update stats to new stats.zulip.net host.
...
(imported from commit 1053750c9ba90ac21a9b523f84eefe5525e18e6d)
2013-08-26 18:17:26 -04:00
7014a661d2
zmirror: Add monitoring for personals mirrors.
...
(imported from commit acb7f2222076d2f3884a2e52c7032cb48fde1757)
2013-08-26 18:17:26 -04:00
c162127386
puppet: Move supervisord configuration to better path.
...
(imported from commit e243bb4c8ea180a3c6e74447b575e398169f7b67)
2013-08-26 18:17:26 -04:00
64a629f086
puppet: Make sure the humbug user owns supervisord socket properly.
...
This prevents the humbug user from losing access to the socket every
time that we restart supervisord.
(imported from commit 14dba25101d5e55bda4be46f4faa1d1d1db9a9be)
2013-08-26 18:17:26 -04:00
e2ea7c3c14
Import supervisord config into puppet.
...
(imported from commit e3247d11c8054f07fc44172eb21b7d76fd230615)
2013-08-26 18:17:25 -04:00
98aa534d3d
puppet: Add zmirror_personals machine type.
...
(imported from commit 3712d4ac1c2faa53cd9211441cc52da98de19e9b)
2013-08-26 18:17:25 -04:00
9893b37520
puppet: Fix zmirror supervisor configuration.
...
(imported from commit 3998cf36d6f9a60e6464e910db9cce57581710af)
2013-08-26 18:17:25 -04:00
50c98c2da2
check_pg_replication_lag: Check for the critical conditions before the warning condition
...
Otherwise critical conditions are only reported as warnings.
(imported from commit 3e0e21f952e206e8df5b971633a8b0981540efc7)
2013-08-26 15:49:28 -04:00
14f2b41c5d
Add Nagios plugin for monitoring the Postgres replication lag
...
(imported from commit 0196cca357ba58b08ac74065ce84f0e49141d30d)
2013-08-22 17:36:19 -04:00
1bd4093e9b
Update Postgres pg_hba to match reality
...
(imported from commit 953fcff4df31cf7a1b14d674fe6df381f348fe72)
2013-08-22 11:47:03 -04:00
33872fc427
puppet: Fix path for rabbitmq-numconsumers.
...
(imported from commit 8d893057e837c8e8f45bc262cc7f3477ea5da415)
2013-08-21 12:01:55 -04:00
b8873e3283
Use /var/lib/nagios_state over /var/run/nagios for check status files.
...
The previous path would get destroyed on reboot.
(imported from commit 27e8fa54fc1e4001166db93b1fb59e87e0b1ccf5)
2013-08-20 17:09:09 -04:00
605171d1da
zephyr_mirror: Renew kerberos tickets when starting up class mirror.
...
(imported from commit 34b0a78558c6f20043efe986a16064387f36f1c0)
2013-08-20 15:27:24 -04:00
a8e28bb99a
puppet: Set correct permissions for supervisor.sock.
...
We can't do this with a "file" entry because it doesn't handle objects
of type socket.
(imported from commit 5f0f79f1a7905c4d70cc7e2f4c474b0629841c12)
2013-08-20 15:27:24 -04:00
12ec430cb8
puppet: Fix typo in email mirror configuration.
...
(imported from commit f81ca5ba28046be701f672df1fc3409e09841aec)
2013-08-20 15:27:24 -04:00
6850f25907
[manual] puppet: Move rabbitmq cron jobs into puppet.
...
When we deploy this, we should remove the relevant jobs from root's
crontab on our app servers.
(imported from commit 749be952d504f5a4d243cf59f6430acc689fc821)
2013-08-20 15:27:24 -04:00
9e6e57f349
puppet: Run sync-public-streams via supervisor.
...
(imported from commit f515cd36cd3138bcc8a13310276f3a6bb961ce33)
2013-08-20 15:27:23 -04:00
1a7d946bd1
puppet: Move zephyr_mirror crontab into /etc/cron.d.
...
(imported from commit e93e630704ce7e85346f54f095c642010058fc09)
2013-08-20 15:27:21 -04:00
c7be859d21
puppet: Run zephyr_mirror.py via supervisord.
...
(imported from commit 09086a1dd298e7ee9b655ccd6c58ac720bbc7798)
2013-08-20 15:26:50 -04:00
00279ae705
puppet: Add debathena.list to zmirror configuration.
...
(imported from commit 3d54bd495b5f8f582ec4d1f7a859ac0c0b63930b)
2013-08-20 15:26:50 -04:00
d3e1d0301d
Remove dummy 10.0.0.0/8 routes on interface configure.
...
(imported from commit 8a01137550b668a71871d20b1ebc1e62f0fdbaf4)
2013-08-19 16:19:47 -04:00
91ff010853
Configuration to create schroots.
...
(imported from commit 27288bfdc5b39aa5c8804ac9628dc960b621ca7f)
2013-08-19 16:19:45 -04:00
428148c67f
Install Mosh on our servers.
...
This makes me happy when I'm working on an airplane.
(imported from commit adda8c3355cd5e54210c9706df72fb02697db1f6)
2013-08-19 16:19:26 -04:00
7dc3a155ba
Add a crontab entry for the email mirror.
...
(imported from commit cd1765c78cc7d298c6856563107a33354e45e441)
2013-08-16 16:09:18 -04:00
2c8f08e237
nagios: add a command to check that the email mirror is running.
...
(imported from commit 812626c2ed665bdf19e0b52319f0f8fcc37c2359)
2013-08-16 16:09:18 -04:00
74d4feb5ec
Remove legacy gitit files.
...
(imported from commit 818f4b95e82c5909be5909f24864614ff89517fc)
2013-08-16 13:21:37 -04:00
368ace069c
Use PyDNS instead of shelling out to `host`
...
On Debian systems, this is found in the `python-dns` package.
On OS X and others, install "pydns" using your Python package manager.
(imported from commit 17827d0a1d3d72b12945df5563295a1573bfa1ed)
2013-08-12 13:09:19 -07:00
aefaca8f73
Update trac configuration from prod server.
...
(imported from commit 3a671e629e6ab9e8d7efece0370eda9cea415363)
2013-08-08 10:22:32 -04:00
e8f1a349b8
Add Zulip Nagios integration to puppet.
...
(imported from commit 62b53e4f8a31ec8ab21d5bb5435a320c8e4eab95)
2013-08-08 10:22:31 -04:00
53a47e8534
Rename Humbug-based variables/paths in Nagios plugin.
...
(imported from commit fe8e33241215ea880f7351c3c86b0fb546faf8d3)
2013-08-08 10:22:31 -04:00
3005792734
Rename Humbug-based variables in Trac plugin.
...
(imported from commit 5d406cb6c5fe7b1fbd4da706f7ac6bb6e381cadb)
2013-08-08 10:22:31 -04:00
6550134b3e
Rename humbug_*_config.py to zulip_*_config.py.
...
(imported from commit a1d4dd22c59f812f0eb4875dc70c89ce96a4b90c)
2013-08-08 10:22:31 -04:00
747a9c536f
Rename the 'humbug' API module to 'zulip'.
...
(imported from commit b3a3d7c05459cbb0110cd0fbe2197d779f3a6264)
2013-08-08 10:22:31 -04:00
2ea1bb05a5
Rename ~/.humbugrc to ~/.zuliprc.
...
(imported from commit a0d53dd20097a56971874dc1d84c6f95267e84f2)
2013-08-08 10:22:31 -04:00
68ff801d43
Monitor the FTS update log length with nagios.
...
(imported from commit 7970f39b42fee179525bc2b15e18954ba0570462)
2013-08-07 12:08:20 -04:00
7b9305b06f
Rename Django project to zproject.
...
This includes a hack to preserve humbug/backends.py as a symlink, so
that we don't need to regenerate all our old sessions.
(imported from commit b7918988b31c71ec01bbdc270db7017d4069221d)
2013-08-07 11:04:03 -04:00
d8f78a5e2d
Fix some remaining references to zephyr.
...
(imported from commit 2072d3451cc08bc32b997d7fafaafd7b6ac568df)
2013-08-07 10:00:08 -04:00
1026215512
Update email addresses registered with Nagios.
...
(imported from commit f44cdb9f4ccbf146fbb1bfc17ebcc40270ded794)
2013-08-07 10:00:08 -04:00
7232369619
Rename humbug puppet module to zulip.
...
(imported from commit 7ed2a40439a48f4ef47932b345b9fac1a76cbb58)
2013-08-07 10:00:08 -04:00
1f1af26048
Change Humbug => Zulip in text/comments.
...
(imported from commit 2f9d73431ae40e1b9e9e11bc2f4f62f566ae758a)
2013-08-07 10:00:07 -04:00
e111a2f9a5
[manual] Rename Django app from zephyr to zerver.
...
This needs to be deployed to both staging and prod at the same
off-peak time (and the schema migration run).
At the time it is deployed, we need to make a few changes directly in
the database:
(1) UPDATE django_content_type set app_label='zerver' where app_label='zephyr';
(2) UPDATE south_migrationhistory set app_name='zerver' where app_name='zephyr';
(imported from commit eb3fd719571740189514ef0b884738cb30df1320)
2013-08-06 07:39:36 -04:00
b13361708f
Warn users when sshing in to lb0.zulip.net
...
(imported from commit df30627fa6ee5eaf5589eb833879c7e03b204d5c)
2013-07-31 10:50:19 -04:00
0008edc9d5
[manual] Add worker process for processing asynchronous FTS updates
...
Unlike the other workers, this process runs on the database server.
To prevent duplicate work, only the worker on the master actually
processes updates.
To deploy, we in theory just need to apply the new puppet config. In
practice, the database servers aren't on wheezy yet, so the changes
should be applied by hand to postgres0 and postgres1. This only
needs to be done on deploy to staging.
(imported from commit d679ffc0838f9fc8c7f0bede08a5568b339b7ddb)
2013-07-30 18:13:05 -04:00
7637574345
Install molly-guard on our servers
...
(imported from commit 8c065763e649a86e50754c738458f09e7d0cf71d)
2013-07-30 17:45:20 -04:00
942cc94b04
Install files to customise postgres for maximum performance.
...
Configuration provided by Zev.
(imported from commit 4d0cdbb6747689863208079e2c21864521e1cf02)
2013-07-26 17:11:54 -04:00
7b6579c74c
s/humbughq/zulip/ in graphite setup
...
(imported from commit 5c87bbe3d1ae4f57c5f66899b66cbd4417e49887)
2013-07-26 16:23:03 -04:00
7c2de24213
Make trac.ini world-readable
...
This is bringing our puppet configuration in line with reality.
(imported from commit 48a10676a9f28566dd89fff1337a4b34c23c0b61)
2013-07-26 16:14:55 -04:00
5e2dda4d73
Configuration for puppetized MediaWiki on trac.
...
(imported from commit cff2becbe590e50414f74a31ea2a2914de49f4bd)
2013-07-26 16:14:55 -04:00
85988df75d
[third] Import Auth_remoteuser.php into puppet.
...
This is a module we're using for REMOTE_USER support in MediaWiki. It is
not used in any app code nor is it distributed, nor is it incorporated
into any comapny works.
License: GPLv2+
(imported from commit da9a81db251cf850335987697ea8383623b58c53)
2013-07-26 16:14:55 -04:00
41504762a1
env-wal-e: Use a different bucket if not running on an app postgres server.
...
(imported from commit e06be77d544532885fbc4769fedb55eedac22ccd)
2013-07-26 16:14:55 -04:00
76a58fe800
We are no longer using gitit nor is wiki running off git.zulip.net.
...
(imported from commit fbe1bc2804a5ed6ccecb7b3090b55d7e9fa5b1bc)
2013-07-26 16:14:55 -04:00
639d963ff5
Split out app-specific postgres configuration.
...
(imported from commit 979811e69f436d02023a6c62e614a39c19bf64b8)
2013-07-26 16:14:55 -04:00
0d077e7f41
[manual] Use api.zulip.com to access the Humbug API.
...
This needs to be deployed after the nginx configuration is deployed.
(imported from commit 167a3d9d27595d40883bb400ebcc44c4ad9b6a2f)
2013-07-25 17:27:46 -04:00
4f8f46544c
[manual] Add additional zulip hosts to nginx config.
...
We'll need to do a puppet apply on prod for this to take effect.
(imported from commit 764926317712ed8abebc429fb13d43c755e0f130)
2013-07-25 17:27:45 -04:00
9bef184eda
Fix check_send_receive_time always checking prod.
...
The value it is passed is usually https://staging.humbughq.com , not
just staging.humbughq.com.
(imported from commit c3cd8fc5baa767377f506570aa8e7d2e1ed399ec)
2013-07-25 17:27:45 -04:00
cdeaceea47
Fix URLs for wiki following mediawiki transition.
...
(imported from commit 140b4f7044f6e68c16d743c0e91dcf5a2557311e)
2013-07-25 17:27:45 -04:00
77b0ddef78
[manual] Rename shakespeare users to zulip.com domain.
...
We need to update our Nagios configuration when this is deployed.
(imported from commit 28cc3ecfe30c41562742733d6952c8e69b87d67e)
2013-07-25 17:19:17 -04:00
1f08f4e70f
Rename nagios bot to zulip.com domain.
...
(imported from commit 9a2fba54295b4c473e030d3ff6ededbc3e2455af)
2013-07-25 17:16:53 -04:00
e539d6b2ac
[manual] Add python-sourcemap dependency
...
(imported from commit 784cfa09ecea58f479adb0b17906a4d0ec10f618)
2013-07-23 15:57:07 -04:00
508ddca539
puppet: Specify commands for restarting supervisord.
...
(imported from commit e1a6322fd9ecf1655ec4325d0fcaf0ad160202ae)
2013-07-23 11:30:46 -04:00
cd71840942
Use a better output filename for Django logs.
...
(imported from commit 97d37d9167ac8463ea54fb7a75a3f923fc78edee)
2013-07-17 17:50:19 -04:00
23beabb80c
[manual] Rename manage.py subscribe_new_users to process_signups.
...
The old name was very confusing, and this fits the convention of "the
processor for the signups" queue a la "process_user_activity".
This requires doing a
supervisorctl stop humbug-workers:humbug-events-subscribe-new-users
puppet apply
to deploy the supervisord configuration changes and properly restart
the signups queue.
(imported from commit 0ee2dad837142afa64025446e22956709771a192)
2013-07-17 17:50:19 -04:00
27586559dc
Remove Puppet configuration for zulip-staging.
...
The file was already deleted.
(imported from commit 04c68076ad59709c2848f81ca81db9612f9c65b8)
2013-07-17 17:50:19 -04:00
f61b4ddb25
Remove second duplicate python-boto instance.
...
(imported from commit 11ef02de82d0f8cdd4c1cf3813e5d09619d4665b)
2013-07-17 17:50:19 -04:00
642f347790
puppet: Add check_postgres.pl nagios plugin
...
(imported from commit 9d9d0ff74dc0fdf17d81b9a0b450df7cb37d04d5)
2013-07-17 14:34:00 -04:00
d16b336f29
puppet: Remove duplicate python-boto package declaration
...
(imported from commit ef3f8f73bc43363317be9b5875ed95e6fa13f4a3)
2013-07-17 14:34:00 -04:00
81c05e02c2
nagios: Check for the expected number of autossh processes on munin.humbughq.com
...
(imported from commit 77d35b2aaacf303f6118d7794f481e393868da59)
2013-07-17 14:34:00 -04:00
14e58ff6e4
Monitor postgres1
...
The fact that we weren't already was an oversight on my part.
(imported from commit 2082ae79ac2884f26e98b430bcb08c15938a26c0)
2013-07-17 14:34:00 -04:00
431acdb186
munin: Rename postgres to postgres0
...
(imported from commit 07c324b5b7e0579e7b97b07c4fdf55f0e66f131c)
2013-07-17 14:34:00 -04:00
b4a208445b
Run check_postgres.pl against the correct database
...
We were previously running it against the 'postgres' database, which
meant we weren't actually checking the non-clusterwide statistics.
(imported from commit a6be529b16d5f1927463e49a7f7f4cf0b5299213)
2013-07-17 14:34:00 -04:00
e4c9abb021
Remove duplicate ipython entry from puppet
...
(imported from commit 2657ed1d707900ea4b1074fe59a0b662647805e4)
2013-07-15 18:07:56 -04:00
1f811133d1
Serve static /dist/ content on app servers when hostname zulip.com is used
...
(imported from commit cc78ffafdffe5df2baf08bdd70a219dbb694337d)
2013-07-15 16:49:55 -04:00
bb0a7c8fc3
[manual] Switch various configuration files to refer to .zulip.net.
...
We only want to change cases where we're talking about the hostname; HTTP
requests should still go to staging.humbughq.com for now.
Before this commit is deployed the hostname of staging.humbughq.com should
be changed to staging.zulip.net on the VM.
(the same for prod)
(imported from commit 7412530773f720ac227f40061c9ddb1a851e19bb)
2013-07-15 16:49:55 -04:00
9bef61ad87
Interpret X-Forwarded-For on app servers' nginx.
...
See:
http://nginx.org/en/docs/http/ngx_http_realip_module.html#set_real_ip_from
(imported from commit adc4ebf46aefd1c71bda187d84519d8c31f6c590)
2013-07-15 16:49:55 -04:00
44b49b3bf8
Puppet configuration and associated nginx files for lb0.zulip.net.
...
lb0.zulip.net will proxy connections to the relevant backend servers.
Depressingly, SSL certificate verification of the backend servers is not
performed at this time, see:
<http://trac.nginx.org/nginx/ticket/13 >
The above-mentioned bug has existed since 2011, but a CVE was not
allocated until January. The nginx developers don't seem to care. Sigh.
In any case, this is of somewhat limited impact at Humbug, since we can
have reasonable confidence that communications within AWS are not
subject to active MITMs. Passive MITM is not a concern, because the
traffic *is* in fact encrypted.
(imported from commit c96e1235fc17192c7452e0417a1309cfcda62de2)
2013-07-15 16:49:55 -04:00
ebde5ab341
Switch to logging module instead of syslog.
...
(imported from commit 4c2c2f0f23e2688ce916d33d0cf513e386dca70c)
2013-07-15 16:49:54 -04:00
4843303267
Automatically configure iptables and routing for secondary interfaces.
...
This is a horrible hack.
(imported from commit 01dca4514f01f7ad419d735b8879a25a999b552e)
2013-07-15 16:49:54 -04:00
0696a3fbd7
Automatically configure all interfaces (including virtual!) at boot
...
On EC2-VPC we have the ability to attach multiple addresses to one
interface, and multiple interfaces to one machine.
We should configure those interfaces whenever our system boots, and
ideally whenever networking is restarted.
This commit adds a script that is executed once eth0 is brought up that
proceeds to configure all subsequent interfaces, real and virtual.
The script is configured to be installed (along with the helper script
that calls it) on all systems via Puppet.
(imported from commit fdc153ef649edbb8fedd40ff4d77262aae593c39)
2013-07-15 16:49:54 -04:00
6a61c8d237
[manual] Change Humbug to Zulip in Sparkle, and start with 0.3.4
...
This requires a puppet apply on prod
(imported from commit 6890146fd5330acd1c5cbac5609191f332ebca4a)
2013-07-15 13:31:15 -04:00
bc7ee2bd45
Make python-django-guardian a dependency according to puppet.
...
(imported from commit 05c53f714b0ac3e5f86d946c8ab6fb2eaac8827b)
2013-07-12 11:29:11 -04:00
2a5e53eaec
[manual] Update desktop apps to 0.3.3
...
This requires a puppet apply on prod
(imported from commit aba8004684de70772d2ddd31a563b3650c4cbd9b)
2013-07-05 16:41:26 -04:00
6eb3d8b8b1
Syntax fix for staging_app_frontend.pp.
...
(imported from commit c363e6e9c18b08467555a1f0520680736dab2dd1)
2013-07-02 14:54:16 -04:00
7b30a8e7c0
Explicitly copy over the zulip-staging files in Puppet.
...
Unlike other directories, we explicitly enumerate the files we want to be
present in sites-available, so the previous commit series did not actually
instruct puppet to make the zulip-staging files accessible.
(imported from commit 22efc4d272eba8d6c869edbaa9114c50e1988288)
2013-07-02 12:14:41 -04:00
1be1cb121c
nginx / Puppet configuration for staging.zulip.com
...
We create a new sites-available entry which is essentially a duplicate of
sites-available/humbug-staging with s/humbug/zulip, and add the associated
symlink directive in Puppet.
(imported from commit febcb585ce93c21c6849d96458cc2bd096b30538)
2013-07-02 12:04:56 -04:00
975e13a1b8
Update sparkle to our 0.3.0 release
...
(imported from commit bd02d67fbd13d709b579f93a69d625da5517eec7)
2013-07-02 10:40:12 -04:00
7036915933
Add windows sparkle files
...
(imported from commit b7c0770acd34f44e961014a00d2059dfc7bef701)
2013-07-01 16:25:35 -04:00
3bdd446651
puppet: Fix nginx configuration for api.humbughq.com.
...
(imported from commit d8b535b666a3b3d758a62812a118413c619c09a5)
2013-06-28 15:57:28 -04:00
ea8a80603a
[manual] Change API URLs to be based on api.humbughq.com/api.
...
This must be deployed after we update our running nginx configuration
to serve api.humbughq.com.
(imported from commit b5c34ebdd595f55eecd6dca6a18a37f105107bd5)
2013-06-28 15:57:27 -04:00
83cd963c49
Remove unused imports
...
(imported from commit 9e3050c72a2d1137b9096c6cfa1c3945341b9a56)
2013-06-27 16:22:39 -04:00
6f874995ff
[schema] Use custom stopwords file for full text search
...
This stop words file is just the default Postgres english stop file
with all the rest of the letters of the alphabet added. Adding the
extra letters ensures that, e.g., "bed" doesn't get transformed into
"bed | b".
(imported from commit 0be3ef9a43eb524ed4f081d5081a786cf602c487)
2013-06-27 14:18:53 -04:00
Zev Benjamin
Leo Franchi
Tim Abbott
Luke Faraone
Luke Faraone
Jessica McKellar
Tim Abbott
Zev Benjamin
Leo Franchi
Scott Feeney
Scott Feeney