Commit Graph

56454 Commits

Author SHA1 Message Date
Alex Vandiver 548bb5362e message_cache: Rename "to_dict" functions which deal with bytes. 2024-02-14 17:31:31 +00:00
Alex Vandiver 96119e45b9 message_cache: Rename update_to_dict_cache to update_message_cache.
This better describes what it does.
2024-02-14 17:31:31 +00:00
Alex Vandiver 93a071a1f8 message: Split MessageDict and friends into its own file. 2024-02-14 17:31:30 +00:00
Alex Vandiver 11bde84580 message: Move render_markdown into zerver.lib.markdown. 2024-02-14 17:31:30 +00:00
Alex Vandiver eaf58438ec message_edit: Carry the QuerySet through as much as possible.
Rather than pass around a list of message objects in-memory, we
instead keep the same constructed QuerySet which includes the later
propagated messages (if any), and use that same query to pick out
affected Attachment objects, rather than limiting to the set of ids.
This is not necessarily a win -- the list of message-ids *may* be very
long, and thus the query may be more concise, easier to send to
PostgreSQL, and faster for PostgreSQL to parse.  However, the list of
ids is almost certainly better-indexed.

After processing the move, the QuerySet must be re-defined as a search
of ids (and possibly a very long list of such), since there is no
other way which is guaranteed to correctly single out the moved
messages.  At this point, it is mostly equivalent to the list of
Message objects, and certainly takes no less memory.
2024-02-14 17:31:30 +00:00
Alex Vandiver a2657b843c topic: Use a single SQL statement to propagate message moves.
Rather than use `bulk_update()` to batch-move chunks of messages, use
a single SQL query to move the messages.  This is much more efficient
for large topic moves.  Since the `edit_history` field is not yet
JSON (see #26496) this requires that PostgreSQL cast the current data
into `jsonb`, append the new data (also cast to `jsonb`), and then
re-cast that as text.

For single-message moves, this _increases_ the SQL query count by one,
since we have to re-query for the updated data from the database after
the bulk update.  However, this is overall still a performance
improvement, which improves to 2x or 3x for larger topic moves.  Below
is a table of duration in seconds to run `do_update_message` to move a
topic to a new stream, based on messages in the topic, for before and
after this change:

| Topic size |  Before  |  After  |
| ---------- | -------- | ------- |
| 1          |   0.1036 |  0.0868 |
| 2          |   0.1108 |  0.0925 |
| 5          |   0.1139 |  0.0959 |
| 10         |   0.1218 |  0.0972 |
| 20         |   0.1310 |  0.1098 |
| 50         |   0.1759 |  0.1366 |
| 100        |   0.2307 |  0.1662 |
| 200        |   0.3880 |  0.2229 |
| 500        |   0.7676 |  0.4052 |
| 1000       |   1.3990 |  0.6848 |
| 2000       |   2.9706 |  1.3370 |
| 5000       |   7.5218 |  3.2882 |
| 10000      |  14.0272 |  5.4434 |
2024-02-14 17:25:06 +00:00
Alex Vandiver 7dcc7540f9 message: Add a bulk_access_stream_messages_query method.
This applies access restrictions in SQL, so that individual messages
do not need to be walked one-by-one.  It only functions for stream
messages.

Use of this method significantly speeds up checks if we moved "all
visible messages" in a topic, since we no longer need to walk every
remaining message in the old topic to determine that at least one was
visible to the user.  Similarly, it significantly speeds up merging
into existing topics, since it no longer must walk every message in
the new topic to determine if the user could see at least one.

Finally, it unlocks the ability to bulk-update only messages the user
has access to, in a single query (see subsequent commit).
2024-02-13 16:39:52 +00:00
Alex Vandiver c118f1874e streams: Remove a lie from the docstring. 2024-02-13 15:39:45 +00:00
Alex Vandiver db3bcb8889 message_edit: len(changed_messages) is always > 0.
It is only ever added to, and starts as a one-element list.
2024-02-13 04:06:38 +00:00
Tim Abbott 68be070306 message_edit: Ensure gaining_usermessage_user_ids is set.
This makes this code path a bit easier to follow.
2024-02-13 04:06:38 +00:00
Tim Abbott fc679b09a3 message_edit: Clarify unmodified_user_messages logic. 2024-02-13 04:06:38 +00:00
Alex Vandiver 13b9c87f93 tests: Reserve "Internal" client, used by email gateway and topic moves. 2024-02-13 04:06:35 +00:00
Alex Vandiver a84de411a9 tests: Clear in-memory Client caches before testing query counts.
This makes counts more apples-to-apples comparable when run
back-to-back.
2024-02-13 03:57:43 +00:00
Karl Stolley 35098f4959 Revert "plans: Handle table widths in CSS."
This reverts commit 960e29dc5a.

An earlier draft of the comparison table made this CSS necessary;
it should have been removed before merging.
2024-02-12 15:18:01 -08:00
Karl Stolley 5f509f5b0c plans: Remove unnecessary comparison-table conditional. 2024-02-12 15:18:01 -08:00
Karl Stolley 5be2e8fa64 portico: Beef up IntersectionObserver on comparison table. 2024-02-12 15:18:01 -08:00
Aman Agrawal 7ca85bed71 stripe: Fix $0 invoices being generated on upgrade.
Instead of charging the customer using the attached payment
method and then creating the invoice, we create an invoice and
force an immediate payment for the invoice via the attached
payment method.
2024-02-12 15:15:56 -08:00
Alya Abbott a5cd63f3f2 help: Improve Roles and permissions page.
- Edit role descriptions and surrounging content.
- Add instructions for modifying roles and managing permissions.
2024-02-12 13:35:02 -08:00
Alya Abbott 73a62f4dc8 help: Move instructions for changing a user's role into /include. 2024-02-12 13:35:02 -08:00
Lauryn Menard 831381f160 email-log: Update CSS styles for dev environment email log.
Removes reliance on bootstrap alert and label rules/styles that
were used or expected for this email log page.
2024-02-12 11:35:36 -08:00
roanster007 07ccd29a9b typing_status: Add an extra notification_event_type to Recipients.
This is a preparatory commit. It adds an extra notification_event_type
to the Recipient type. This can be used to differentiate between
typing notifications and message edit typing notifications since
they send different events.
2024-02-12 10:51:12 -08:00
roanster007 6ab63874f2 message_edit: Refactor check_update_message method.
This is a preparatory commit that refactors the check_update_message
method to extract the checks containing whether a user can edit the
message or not into a separate method -validate_message_content_edit,
so that it can be re used later.
2024-02-12 10:51:12 -08:00
roanster007 ea2b659314 message_edit_notice: Change edited notice computation logic location.
This commit extracts the edited notice computation logic of
edited_in_left_col, edited_alongside_sender and edited_status_message
to a new function - set_edited_notice_locations and calls it right
after the method merge_message_groups.

This is a preparatory commit, and is done since theses three variables
were previously wrongly initialized in the beginning for live messages
received.

We also introduce a modified flag to decide whether to display the
edited notice or not. This is useful since now we are computing
the edited notice values even when messages are not edited, and
hence we show the notices only when the modified flag is true.
2024-02-12 10:51:12 -08:00
Varun Singh e4c6476c57 ts: Update extension of recently migrated '.js' files. 2024-02-12 09:49:54 -08:00
Varun Singh 5f9b6d82a4 typing_events: Convert module to TypeScript. 2024-02-12 09:49:54 -08:00
Varun Singh bec806db18 typing_events: Refactor 'narrowed_by_topic_reply' conditional.
Fetching narrow 'stream_id' and 'topic' into variables will
help with upcoming type assertion.
2024-02-12 09:49:54 -08:00
Varun Singh 0ec622c5f4 typing_events: Refactor 'get_key' function.
The function body contains only two conditionals, so the
'switch' statements can be replaced with simple 'if's that
return immediately, thus making the code block cleaner.
2024-02-12 09:49:54 -08:00
Varun Singh c8f135b97a page_params: Add typing notifications constant to type. 2024-02-12 09:49:54 -08:00
Prakhar Pratyush a764f9ce25 corporate: Fix 'free_trial=True` for legacy customers during upgrade.
Earlier, we were not setting `free_trial` = False for legacy
customers in `do_upgrade`.

This lead to a bug where customers were upgraded even before the
payment was complete. 'process_initial_upgrade' was always getting
called instead of 'setup_upgrade_payment_intent_and_charge'.

This commit fixes the incorrect behaviour.
2024-02-12 09:06:06 -08:00
evykassirer d3b5a76a67 stream bar: Convert module to typescript. 2024-02-10 07:07:08 -08:00
Alya Abbott c0cdfd78fb contributor docs: Tweak wording in "Counting contributions" intro. 2024-02-10 07:06:35 -08:00
Alya Abbott 8fa39c2dc9 contributor docs: Rename "Contributor statistics" to "Counting contributions". 2024-02-10 07:06:35 -08:00
evykassirer 49d79730b8 resize: Convert module to typescript. 2024-02-09 21:17:16 -08:00
evykassirer 4d6cfcb0ff resize: Remove unused return value of resize_sidebars. 2024-02-09 21:17:16 -08:00
evykassirer 781387781b resize: Don't pass unused value to resize_bottom_whitespace. 2024-02-09 21:17:16 -08:00
evykassirer d913ab1e3c resize: Fix buggy check for #stream_settings element. 2024-02-09 21:17:16 -08:00
Tim Abbott 3f7b26d8bd message_notifications: Shorten other users string.
This makes it more likely to not be truncated.
2024-02-09 18:03:29 -08:00
Aman Agrawal 7bab31068a message_notification: Set title based on length of title.
Including content length in this calculation doesn't make sense.
2024-02-09 18:03:29 -08:00
Aman Agrawal 192306f9ee notification: Use display_recipient to get other_recipient length. 2024-02-09 18:03:29 -08:00
Aman Agrawal 2d2e2f8882 message_notifications: Translate private message content. 2024-02-09 18:03:29 -08:00
Tim Abbott b975301e84 notifications: Remove custom truncation logic.
This logic was part of the original desktop notifications
implementation in 4cb0c6225e.

There's no apparent standard for the number of characters allowed to
be shown in a desktop notification, so truncating at 150 characters
arbitrarily seems wrong.

Further, we've decided it's no longer a priority to truncate at word
boundaries, we can rely on the browser to take responsibility for
truncation.

Fixes #25260.
2024-02-09 17:27:59 -08:00
David Rosa cc472e87f9 integrations: Update incoming webhooks overview and walkthrough.
- Updates incoming webhooks overview and walkthrough to be consistent
  with the `zerver/webhooks/` codebase.
- Tweaks the documentation for better readability.
2024-02-09 17:24:18 -08:00
Tim Abbott 27deebe45b click_handlers: Remove dead code for Bootstrap popovers. 2024-02-09 17:06:03 -08:00
Tim Abbott e17e231b2a stream_popover: Remove dead unsub code.
This seems to have been dead since it was introduced in
64079b382f.
2024-02-09 17:06:03 -08:00
sanchi-t edf8b13430 stream_popover: Hide popover when clicked on `unsubscribe`. 2024-02-09 17:06:03 -08:00
Eeshan Garg 03dd5daecc docs: Add page explaining contributor stats on /team. 2024-02-09 16:56:44 -08:00
Rinwaoluwa fbe7285af8 left_sidebar: Remove export in deselect_top_left_corner_items.
It is safe to remove the export, because
deselect_top_left_corner_items isn't called anywhere else outside the
file.
2024-02-09 15:53:05 -08:00
Rinwaoluwa afe3bcd6c5 left_sidebar: Simplify deselection with deselect_top_left_corner_item.
Refactoring to avoid duplication, improve readability, and standardize
deselection logic by converting calls to remove to
deselect_top_left_corner_items.
2024-02-09 15:51:57 -08:00
Anders Kaseorg 497bd740e9 web: Replace Zod z.union with z.discriminatedUnion or .nullable.
Signed-off-by: Anders Kaseorg <anders@zulip.com>
2024-02-09 18:48:20 -05:00
Tim Abbott d5281292d5 compose_ui: Clean up placeholder logic.
This removes messy indirection through email addresses in passing a
set of users between two modules.
2024-02-09 15:11:17 -08:00