8d4896809a
Deduplication of configuration: Database Initialization
...
Comment tweaked slightly by tabbott.
2016-08-05 13:33:22 -07:00
3839a25c74
Annotate generate_secrets.py.
2016-08-04 15:53:23 -07:00
3b277c3b1f
install: Give nice error message on installation failure.
2016-07-31 19:24:45 -07:00
8b285ec0ff
puppet: Read camo key from zulip-secrets.conf.
2016-07-31 00:23:24 -07:00
35339f5117
Rename local_settings_template to prod_settings_template.
2016-07-19 20:59:59 -07:00
07afc9d34b
Move production health check doc to separate page.
2016-07-12 15:46:10 -07:00
a9835c0ab2
Activate virtualenv in production Python code.
...
The manage.py change effectively switches the Zulip production server
to use the virtualenv, since all of our supervisord commands for the
various Python services go through manage.py.
Additionally, this migrates the production scripts and Nagios plugins
to use the virtualenv as well.
2016-06-27 19:55:35 -07:00
f7ce5fc179
generate_secrets: Silence mypy error with configparser.
...
See https://github.com/python/typeshed/issues/307 .
2016-06-20 09:03:09 -07:00
a9a6687b7d
Make generate-secrets script use existing values.
...
Fixes #1035
2016-06-20 17:00:27 +05:00
b401ec0af7
Warn on postgres-init-db if >200 messages exist.
...
Closes #548 .
2016-06-13 15:57:51 -07:00
cf15b0b4e6
Fix hanging nc and 'invalid wait time' error on Trusty.
...
Apparently, 0 isn't a supported wait time value in some versions of nc.
2016-06-02 18:02:13 -07:00
94e4b39112
Replace python2.7 by python everywhere.
2016-05-29 05:03:08 -07:00
149938d468
Change shebangs from python2.7 to python.
2016-05-29 05:03:08 -07:00
6e1872987d
Move bin/get-django-setting to scripts/.
2016-05-07 19:37:06 -07:00
6e1e4aaef6
postgres-init-db: Add POSTGRES_USER argument.
2016-04-26 15:27:35 -07:00
dc772518e7
Don't chown supervisor socket if it doesn't exist.
2016-04-26 15:27:35 -07:00
9d9bfb27ef
Correct shell quoting around $DEFAULT_USER in terminate-psql-sessions
...
Previously, we used shell quoting that would result in the shell variable not
being substituted. Instead, we use `"`s that will allow for variable
substitution.
2016-02-19 02:09:50 +00:00
dfbea01c8f
Add support for running OpenBSD in development environment.
2016-01-21 22:33:55 -08:00
84f7a1f1ea
Make rabbitmq, redis, and memcached configurable via user settings.py.
...
Previously these were hardcoded in zproject/settings.py to be accessed
on localhost.
[Modified by Tim Abbott to adjust comments and fix configure-rabbitmq]
2016-01-21 22:07:56 -08:00
b2a92877ff
Don't print echo commands in initialize-database post-success message.
2015-12-25 10:38:44 -08:00
64a142f0a2
Fix running postgres-init-db via a relative path.
...
If the user runs ./scripts/setup/postgres-init-db, then dirname "$0"
would no longer refer to the correct directory after cd /.
2015-12-25 10:06:45 -08:00
827babdf29
terminate-psql-sessions: Remove dependency on bc.
...
Fixes #281 .
2015-11-11 21:35:16 -08:00
421560af21
postgres-init-db: Stop all services before recreating database.
2015-11-01 18:11:39 -08:00
3c31f9a2e3
Drop database users prior to DROP/CREATE database.
...
This fixes an annoying issue where one tries to rebuild the database,
and it fails due to there being existing connections.
The one thing that is potentially scary about this implementation is
that it means it's now a lot easier to accidentally drop your
production database by running the wrong script; might be worth adding
a "--force" flag controlling this behavior or something.
Thanks to Nemanja Stanarevic and Neeraj Wahi for prototypes of this
implementation! They did most of the work and testing for this.
2015-11-01 18:11:39 -08:00
f3783fb4a1
Apply Python 3 futurize transform libfuturize.fixes.fix_print_with_import.
2015-11-01 09:26:16 -08:00
d5435fad1d
Consistently use /usr/bin/env python2.7 in shebangs and commands.
2015-10-21 22:58:21 +00:00
e75ba630fb
initialize-database: Make management command errors fatal again.
...
We accidentally made this non-fatal when we added the nice error
output telling users to run postgres-init-db.
2015-10-15 12:21:46 -04:00
bf694fa832
Flush memcached whenever we drop the databases.
...
This fixes some issues that we've had where commands will fail is
confusing ways after the database is rebuilt because data from before
the database was dropped is still in the memcached cache.
2015-10-15 12:18:41 -04:00
0608e32eeb
Cause install to return 1 on failure.
...
This fixes issue #123 . Namely, the script in scripts/setup/install was
returning 0. Adding `set -e` and `set -o pipeline` causes the install
script to exit and return 1 if any part fails, including piping output
(`set -o pipeline` does this).
2015-10-07 08:46:16 -04:00
21b7048e54
install: Verify that the script has sufficient privileges.
2015-09-30 10:55:49 -07:00
92aebe595b
Dramatically extend post-install documentation for production Zulip.
2015-09-30 09:04:14 -07:00
5bf66e04fc
initialize-database: Print nice instructions for how to redo if fails.
...
Most of our installation process is idempotent, but this step in
particular is not, so it's important to provide a clear error message
about how to proceed.
2015-09-29 18:27:27 -07:00
0d12dfd06f
Improve shell quoting hygiene
...
Most of these problems were found by ShellCheck
(http://www.shellcheck.net ).
Signed-off-by: Anders Kaseorg <andersk@mit.edu>
2015-09-25 23:25:08 -04:00
2348a83678
postgres-init-db: Fix running with cwd=/root.
...
(imported from commit d2ac25fa8c54b89eed80e941b3eacf1a4c2f5546)
2015-09-25 00:22:15 -07:00
cf17168c9f
Move prod README to root of repository.
...
(imported from commit db108ffa7f88f22610ecee085abdcd6c5a2bb681)
2015-09-22 21:22:11 -07:00
5be0c2902e
Connect to the zulip database correctly in postgres-init-db
...
(imported from commit b6ab80567ff5d229a00c7d2cf5866bca0ee9c7c5)
2015-08-29 12:07:33 -07:00
942e97d886
Create directory to write log of initial installation into
...
(imported from commit fa352a7b4f57379df14249fd5f168249ead64777)
2015-08-28 09:40:30 -07:00
d8b44606a3
Make configure-rabbitmq fail on error
...
If there's a problem with Django settings then RMQPW would just be
empty, causing more confusing errors downstream.
(imported from commit 5948b1a15eb92fc032ea02e499be58365d8e9ecb)
2015-08-28 09:37:58 -07:00
4e61c06903
Fix postgres syntax when creating zulip schema in production
...
(imported from commit 51ba85b995e4b5044f914163dab7f2ae14df908f)
2015-08-28 09:37:46 -07:00
5768fd7f49
Remove reference to Zulip deployment key from Zulip Voyager README
...
(imported from commit 74a4f86839fb76eb175016453d91b916b9ce416d)
2015-08-23 21:44:27 -07:00
a3d85f501b
Create tsearch_extras in production database setup
...
(imported from commit e6c699b06f022d923b57ccee7ad778f870bf890d)
2015-08-21 16:54:35 -07:00
d281fc75fd
Rename generate_voyager_secrets.py => generate_secrets.py.
...
(imported from commit c2f370c3b241601b4f6883d3953ceec1efda71be)
2015-08-21 10:33:36 -07:00
e3f38acbce
Enterprise => Voyager.
...
(imported from commit 41b9a67301aeaf5fd40bbbb8f34a326ca98431fd)
2015-08-21 10:33:35 -07:00
3f7cb34b00
enterprise => voyager
...
(imported from commit 04be792bb480d5e5db1c91d296d1000cf1682571)
2015-08-21 10:33:35 -07:00
362f9c6c5f
Django 1.7: syncdb and migrate are now synonyms
...
(imported from commit b8a1b2476892bab2418240b04deea6aa40ff1b03)
2015-08-20 23:01:26 -07:00
ec5ed87ca0
Make get_secret return None instead of an exception if the secret isn't defined.
...
Remove empty key generation from generate_enterprise_secrets, since get_secret ignores missing keys now.
(imported from commit 32d61e3058f0d41bfb4b17775e581a3c84540fe7)
2015-08-20 21:54:38 -07:00
9000d27f12
Update generate_enterprise_secrets to support running in production.
...
(imported from commit 1051f668ebe684cc60ba4444e815ef60398fad61)
2015-08-20 17:33:16 -07:00
0a20f168a7
Auto-generate dev-secrets file.
...
Source LOCAL_DATABASE_PASSWORD and INITIAL_PASSWORD_SALT from the secrets file.
Fix the creation of pgpass file.
Tim's note: This will definitely break the original purpose of the
tool but it should be pretty easy to add that back as an option.
(imported from commit 8ab31ea2b7cbc80a4ad2e843a2529313fad8f5cf)
2015-08-20 00:20:44 -07:00
0dae10eab4
Remove unused secret HASH_SALT.
...
(imported from commit 831c4cb7680b7bf8dadbd930195175e9a4186356)
2015-08-18 20:17:48 -07:00
cf7ea9bef9
Allow configure-rabbitmq to be run w/o sudo
...
(imported from commit 98e820d92b42420d6851a967f6675940ee4d8217)
2015-08-16 16:45:07 -07:00
9a6f34a807
Make generate_enterprise_secrets.py work regardless of path.
...
(imported from commit c1ab8231fbe907a32b18c02a00cee51011abbb21)
2013-11-14 09:10:10 -05:00
037460b24c
Fix permissions on install script.
...
(imported from commit af71b3a4988059c58e741bf94d0c28383c08f704)
2013-11-14 08:56:06 -05:00
486fcfa53f
README
...
(imported from commit c02dfbd15ab6bac5a450d04075b15a7c44e8ddfe)
2013-11-14 08:19:20 -05:00
87a6838e0e
enterprise: Log the output of upgrade-zulip and install scripts
...
We may eventually want to rotate the log files, but this seems good
enough for now.
(imported from commit 9a54fa6b40bc62f68e52ef552c1a676856b21829)
2013-11-14 08:08:59 -05:00
67ed16a12e
enterprise: Make /root/zulip be a symlink to ~zulip/deployments/next
...
(imported from commit 2a0e7f99fe4517e45ad2794b7fa464df08d40db1)
2013-11-13 16:26:04 -05:00
c54322f76a
install: Move DROP SCHEMA PUBLIC to run in zulip database.
...
(imported from commit 1eef44e7255b8fe1314f7763ebfc6c04083305e5)
2013-11-13 15:35:45 -05:00
c842b42b12
postgres-init-db: The zulip user doesn't need CREATE DB on enterprise.
...
Also clean up the series of similar blocks.
(imported from commit fdb468bd6be3077bdbf2d72289064397ea04f27a)
2013-11-13 15:35:45 -05:00
b4ace85d3a
Make sure everything under /home/zulip is owned by zulip.
...
(imported from commit f6c8b6c0a6dc8b7ada79cb4951818f06faa873e7)
2013-11-13 12:07:15 -05:00
0299964051
Make the Zulip user able to edit settings.py.
...
(imported from commit c69ff2b2e9f176ae2e78b76a7b022e00d09e7c00)
2013-11-13 12:02:50 -05:00
6bcd5a7ffc
Update installation instructions to include configuring the app.
...
(imported from commit 89395815c32416ec0636efcff12eb76f5d890bbd)
2013-11-13 12:02:50 -05:00
6aaa2b1a24
Create the zulip database owned by zulip.
...
(imported from commit cc6e895d9e97bdd9d084c7b1a7204bd5b7ae5cd8)
2013-11-13 12:02:50 -05:00
0ec8a7a2f1
install: Make sure we own everything under /var/log/zulip
...
supervisord may start up during the install process and do a bunch of
incorrect stuff, with the net effect of creating files in there owned
by root.
(imported from commit 28379af9680bf9d3c72da196f329abdf8c82c6be)
2013-11-13 12:02:50 -05:00
b2d4883165
postgres-init-db: Split into internal and external versions for now.
...
(imported from commit 3516b1377e5914dac2b504961922ef8d08148d1f)
2013-11-13 12:02:50 -05:00
f4a9e99498
puppet: Move the postgres dictionary symlink creation to puppet.
...
(imported from commit 823f6683e3d8f3604da68e55dd6761ecb38d4b63)
2013-11-13 12:02:50 -05:00
45f21cbb14
Setup the database after the Zulip user is fully setup.
...
Otherwise we may run into permissions issues.
(imported from commit a8013c84796d16146336c2809dcd8cd935b43a7b)
2013-11-13 12:02:50 -05:00
e1a8f511fe
configure-rabbittmq: Make it work if you run it a second time.
...
This is to make it easier to just run the install script again if it
fails.
(imported from commit 65deb9d001e061d58deecd44c4683231de76dc79)
2013-11-13 12:02:50 -05:00
c7d9bf41bc
Rename SSL certificates for Zulip Enterprise.
...
(imported from commit 4f15f2aee2bcc7450953488c94e8b88734aeaff7)
2013-11-12 15:57:42 -05:00
270f5730fa
Rename local server => enterprise in some scripts.
...
(imported from commit 98cdb4c2e1be5a6abb59821eb32f749c058b773b)
2013-11-12 15:57:42 -05:00
966fde261a
puppet: Rename local_server => enterprise.
...
(imported from commit 5faa269df5937f6db99098e44aaea7d0a4f2c14a)
2013-11-12 15:57:02 -05:00
21f1058fd2
Rename local_server=>enterprise in DB initialization script.
...
(imported from commit 76e26f43858e3baa6ed1b38d67973ed41acf04f3)
2013-11-12 15:57:02 -05:00
b461e3c10e
Add a README file documenting the installation process for local server.
...
(imported from commit 4fb149a39acb4dda7ee0d2f038212534f410e064)
2013-11-12 15:57:01 -05:00
57b5231063
install: Script the install process more fully.
...
We can probably later merge the create-database code with that of our
internal do-destroy-rebuild-database.
(imported from commit 323932dbf2eb916545d6ebdda70eb1f5e1abb181)
2013-11-12 15:57:01 -05:00
2e41515cc3
localserver: Make the zulip user own supervisor.sock.
...
We really should fix this in supervisor itself, since in particular we
lose this setting every time the system is rebooted.
(imported from commit a700078b158808340f5f30812235449c74508cde)
2013-11-12 15:57:01 -05:00
03bf4ba423
postgres-init-db: Don't hardcode LOCAL_DATABASE_PASSWORD.
...
(imported from commit e2cf6c6c0abb688c77661e4849e7b574b4222e68)
2013-11-12 09:38:43 -05:00
5f7c530285
install: Set puppet deploy type for local server.
...
(imported from commit c8b7ac3a7741470851f6fa9c27677e1238c1dce7)
2013-11-12 09:34:25 -05:00
26d7411bc0
generate_localserver_secrets: Fix path to camo defaults file.
...
(imported from commit 4456715e038b10978b3ce1e7454d625795f336e7)
2013-11-12 09:34:25 -05:00
bf0fda7426
Use the enterprise apt key when installing local server.
...
(imported from commit 24fa7474a77cac7b1d033c6732de6873d4aa9880)
2013-11-12 09:34:25 -05:00
30e5543eae
install: Use mkdir -p so that running it again on error works.
...
(imported from commit 361985ce7463c9ccaa7b2eaf1b23ca262e64560d)
2013-11-12 09:34:25 -05:00
cb72df39b1
install: Configure rabbitmq during setup process.
...
(imported from commit c610e6bac9a1d6f2c856664ba1e17bbfcc5e551a)
2013-11-12 09:34:11 -05:00
8eaef81f6b
localserver: Install site settings via a symlink to /etc/zulip/settings.py.
...
(imported from commit b0bedfe3fc4e9039f30061ae9cbdc34069f1f284)
2013-11-12 09:34:07 -05:00
92a230acaa
install: Unpack the initial Zulip tarball in deployments/
...
(imported from commit 2b340aacaa5233fd8708d6392e3c9210e866acbd)
2013-11-12 09:22:50 -05:00
5b71ceb03c
localserver: Setup apt repo first in install script.
...
(imported from commit d26e3dffcfa2d7feeb58eb8c01e17460a8dfced0)
2013-11-12 09:12:06 -05:00
6b9ebfdad5
localserver: Fix leftover code in install script.
...
This should have been removed when forking from our internal install
script.
(imported from commit cb0c0790ba8343d62ef5f5171b219c458a16e906)
2013-11-05 17:06:31 -05:00
6fea6a7856
Make our install script executable.
...
(imported from commit 26be3f76b2654701b7361f2b369e9b82eeeda54e)
2013-11-05 17:06:31 -05:00
787215d743
[manual] Switch over to new /etc/zulip/zulip.conf config file
...
Run the following commands as root before deploying this branch:
# /root/zulip/tools/migrate-server-config
# rm /etc/zulip/machinetype /etc/zulip/server /etc/zulip/local /etc/humbug-machinetype /etc/humbug-server /etc/humbug-local
(imported from commit aa7dcc50d2f4792ce33834f14761e76512fca252)
2013-11-05 14:14:19 -05:00
a53c7c0f45
Update local server install script for puppet move.
...
(imported from commit 4bd7292dd54e9091747dce44b41b57a42496bc3b)
2013-11-01 10:30:17 -04:00
806fab9fe9
localserver: Initial prototype for an install script.
...
(imported from commit b0afd6493e2d5878e3c31d17f0bdee19b34062a5)
2013-10-30 20:39:39 -04:00
38c5629505
Move generate_localserver_secrets.py to scripts/setup.
...
(imported from commit 8d9ca2fc78700a38ec3ce5866b2b1032aabe1635)
2013-10-28 10:54:48 -04:00
1a448c256e
Move get-django-setting to bin/.
...
(imported from commit b4d908897550f9818b6db862d95bb0cbbc1da15a)
2013-10-28 10:54:48 -04:00
cdd7ab895d
Move postgres-init-db to scripts/setup/.
...
(imported from commit 7844fc5cac3e3c90466216e14b2c5b25b4830216)
2013-10-28 10:54:48 -04:00
0a44ba2a28
Move servers/configure-rabbitmq to scripts/setup/.
...
(imported from commit 2b4d5ccb88675447ae744fb985246211deef7486)
2013-10-28 10:54:48 -04:00
Alexander Trost
Tim Abbott
Sumana Harihareswara
Eklavya Sharma
Umair Khan
Michael Cordover
acrefoot
Luke Faraone
Vladislav Manchev
Reid Barton
Steven Oud
Raphael
Ged Lawrenson
Anders Kaseorg
Tim Abbott
David Roe
Yoyo Zhou
Cat Miller
Luke Faraone
Zev Benjamin