Mateusz Mandera
dbe508bb91
models: Migration of Message.pub_date to date_sent, part 2.
...
Fixes #1727 .
With the server down, apply migrations 0245 and 0246. 0246 will remove
the pub_date column, so it's essential that the previous migrations
ran correctly to copy data before running this.
2019-10-05 19:01:34 -07:00
Tim Abbott
aae610f65c
analytics: Fix creation of shylock user.
...
Previously, the shylock user was created using a bad duplicate of our
standard create_user code path; we fix this by just calling into that
code path.
2019-09-19 14:16:38 -07:00
Anders Kaseorg
becef760bf
cleanup: Delete leading newlines.
...
Previous cleanups (mostly the removals of Python __future__ imports)
were done in a way that introduced leading newlines. Delete leading
newlines from all files, except static/assets/zulip-emoji/NOTICE,
which is a verbatim copy of the Apache 2.0 license.
Signed-off-by: Anders Kaseorg <anders@zulipchat.com>
2019-08-06 23:29:11 -07:00
Wyatt Hoodes
fa227d79af
typing: Fix options typing in management/commands.
...
We simply state that certain options are `Optional`.
The following files are affected:
add_users_to_mailing_list
send_to_email_mirror
fill_memcached_caches
client_activity
2019-07-31 12:13:56 -07:00
Roman Godov
a50824e031
models: Rename Subscription.in_home_view field to is_muted.
...
This renames Subscription.in_home_view field to is_muted, for greater
clarity as to what it does just from seeing the setting name, without
having to look it up.
Also disabled an obsolete test_migrations test.
Fixes #10042 .
2019-05-12 22:08:10 -07:00
Vishnu Ks
123bcea518
management: Don't use sys.exit(1).
...
Using sys.exit in a management command makes it impossible
to unit test the code in question. The correct approach to do the same
thing in Django management commands is to raise CommandError.
Followup of b570c0dafa
2019-05-03 14:20:39 -07:00
Anders Kaseorg
643bd18b9f
lint: Fix code that evaded our lint checks for string % non-tuple.
...
Signed-off-by: Anders Kaseorg <anders@zulipchat.com>
2019-04-23 15:21:37 -07:00
Harshit Bansal
0e401c4f18
minor: Fix an artifact of delivery email migration in `populate_analytics_db`.
2019-03-05 13:52:59 -08:00
Tim Abbott
216d2ec1bf
production: Add optional support for submitting usage statistics.
...
See documentation for details.
2019-02-26 17:35:10 -08:00
Wyatt Hoodes
bb6a75c3dc
populate_analytics_db.py: Subscribe user for exporting.
...
AssertionErrors were raised when attempting to run manual comparison
tests to ensure correctness when exporting the analytics realm using
export_from_config. This was caused by this populate_analytics_db
stream being created without any subscribers, which violates an
invariant.
We fix this by simply subscribing the 'shylock' user to that stream.
2019-02-04 10:59:24 -08:00
Anders Kaseorg
f5197518a9
analytics/zilencer/zproject: Remove unused imports.
...
Signed-off-by: Anders Kaseorg <andersk@mit.edu>
2019-02-02 17:31:45 -08:00
ss62171
5649b954ef
stream_stats: Add a column representing type of stream.
...
This adds a column which represents whether a stream is public or
private.
Fixes #11374 .
2019-01-31 15:04:45 -08:00
ss62171
5fd9748e13
stream_stats: List number of private and public streams for each realm.
...
Previously, we only displayed public streams and didn't list the
number of them. Now, we just list all streams.
2019-01-31 15:04:09 -08:00
Tim Abbott
0deeffff6d
populate_analytics_db: Make shylock an organization admin.
...
This means the analytics realm satisfies the usual Zulip invariant
that every realm has at least one organization admin.
2018-08-31 15:26:15 -07:00
Roman Godov
34ae3dfd44
models: Delete unused Subscription.notifications field.
...
This deletes the unused Subscription.notifications field and removes
it from some testing and analytics code (which should not have been
using it in the first place).
Fixes #10042 .
2018-07-26 15:54:57 -07:00
Anders Kaseorg
8d52f0e0c0
analytics/management/commands/check_analytics_state.py: Avoid shelling out for mv.
...
Signed-off-by: Anders Kaseorg <andersk@mit.edu>
2018-07-19 10:43:37 -07:00
Vishnu Ks
2c8effe9fe
models: Add USER_CREATED event type constant to RealmAuditLog.
2018-07-10 15:42:26 +05:30
Tim Abbott
b9fa7d7b6d
populate_analytics_db: Flush memcached after deleting analytics realm.
...
This fixes a subtle bug where if you reran populate_analytics_db
directly, we'd end up in a weird state where memcached fetched the
"old" pre-flush UserProfile object for shylock when loading /stats,
which ultimately would result in /stats appearing totally broken.
2018-07-09 15:13:59 +05:30
Eeshan Garg
0a43e5e257
Replace all user-facing references to "invite-only" with "private".
...
Fixes #9611 .
2018-06-12 13:37:45 -04:00
Nikhil Kumar Mishra
fa9d79e203
stats: Add 1 day actives and total users to number of users chart.
2018-05-20 10:56:16 -07:00
Nikhil Kumar Mishra
26decb4c48
stats: Add 1day_actives::day CountStat to analytics tables.
2018-05-20 10:56:16 -07:00
Rishi Gupta
1af7fc7344
stats: Add /stats/installation.
2018-05-18 15:12:36 -07:00
Aditya Bansal
5adf983c3c
analytics: Change use of typing.Text to str.
2018-05-10 14:19:49 -07:00
neiljp (Neil Pilgrim)
8b697b4093
mypy: Annotate stream_data in populate_analytics_db.py handle function.
2018-03-25 08:59:08 -07:00
neiljp (Neil Pilgrim)
9e1dbde82d
mypy: Final small migrations to python3.5 annotations in many files.
2018-03-12 11:23:30 -07:00
Archana BS
b5a860b234
analytics: Populate messages_in_stream:is_bot:day in dev.
2018-03-04 13:17:00 -08:00
Rishi Gupta
1d581a9c6e
nagios: Add nagios check for analytics state.
...
This should help us detect issues where the analytics cron jobs aren't
running properly.
The cron/nagios part of the implementation done by tabbott.
2018-02-09 16:36:05 -08:00
rht
01885cdedc
analytics: Use Python 3 syntax for typing (final).
2017-11-22 12:16:59 -08:00
rht
d1689b5884
analytics: Use python 3 syntax for typing.
2017-11-17 13:16:49 -08:00
Tim Abbott
2b43a0302a
python: Sort imports in smaller apps.
2017-11-15 15:55:49 -08:00
rht
51c1a6dfc9
analytics: Text-wrap long lines exceeding 110.
...
License: Apache-2.0
Signed-off-by: rht <rhtbot@protonmail.com>
2017-11-10 16:22:00 -08:00
derAnfaenger
19bc55aa45
Fix various typos.
...
The typos and their corrections were found with the
aid of https://github.com/lucasdemarchi/codespell .
2017-11-09 16:26:38 +01:00
rht
fa09076ec9
analytics/management: Remove unused imports (F401).
2017-11-07 16:37:09 -08:00
rht
ec5120e807
refactor: Remove six.moves.zip import.
2017-11-07 10:46:42 -08:00
rht
691598a88b
py3: Remove "from six.moves import range".
...
This is no longer required, since in Python 3, this is what the range
built-in does.
2017-10-17 23:28:14 -07:00
rht
2f3ae84e5a
py3: Remove all `__future__ import division`.
2017-10-17 23:09:12 -07:00
Rishi Gupta
e31758c257
analytics: Do not run update_analytics_counts if there are no realms.
...
Having no realms was not possible before, but will be once system bots are
no longer on a special system realm.
2017-10-05 11:22:06 -07:00
Rishi Gupta
0f31cddf49
analytics: Add management command to clear single stat.
2017-10-05 11:22:06 -07:00
rht
dc5136ed96
analytics: Remove unused optparse import.
2017-09-30 09:22:08 -07:00
rht
4494112862
analytics: Remove absolute_import.
2017-09-27 20:20:07 -07:00
rht
74f8a527e4
analytics: Remove print_function.
2017-09-27 18:05:45 -07:00
Greg Price
c127630dcf
Delete some obsolete usage-stats tools.
...
These are no longer useful, with our spiffy new analytics framework,
and we haven't in fact been using them for some time, while the
`active-user-stats` cron job does cause regular mail from cron.
Just delete them.
2017-07-31 17:06:15 -07:00
Vishnu Ks
b0e4cfd480
analytics: Replace get_user_profile_by email in client_activity.
2017-07-14 13:35:43 -07:00
Aditya Bansal
42b0680ab2
pep8: Add compliance with rule E261 populate_analytics_db.py.
2017-05-31 17:07:15 -07:00
umkay
d9b23b39d3
mypy: Fix strict-optional in analytics.
2017-05-26 15:39:39 -07:00
Aditya Bansal
13d9b98c39
pep8: Add compliance with rule E261 to analyze_mit.py.
2017-05-07 23:21:50 -07:00
Aditya Bansal
9e11185fe2
pep8: Add compliance with rule E261 to active_user_stats.py.
2017-05-07 23:21:50 -07:00
Rishi Gupta
92978d6fb2
analytics: Fix --utc argument in update_analytics_counts.py.
2017-04-28 16:15:07 -07:00
Rishi Gupta
73ae2abd4e
analytics: Add --verbose option to update_analytics_counts.py.
2017-04-28 16:15:07 -07:00
Rishi Gupta
dfbeab73b5
analytics: Change update_analytics_counts to only use hour boundaries.
...
Fixes a recent regression where analytics were not being run on hour
boundaries.
Includes a migration that dumps all the analytics data.
2017-04-28 16:15:07 -07:00