Mirror
/
zulip
mirror of https://github.com/zulip/zulip.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
zulip/web/tests/copy_and_paste.test.js

185 lines
21 KiB
JavaScript
Raw Normal View History

js: Add "use strict" directive to CommonJS files. ES and TypeScript modules are strict by default and don’t need this directive. ESLint will remind us to add it to new CommonJS files and remove it from ES and TypeScript modules. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-08-01 03:43:15 +02:00
"use strict";
eslint: Fix unicorn/prefer-node-protocol. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2024-10-09 00:25:41 +02:00
const assert = require("node:assert/strict");
zjsunit: Deglobalize assert. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-11-30 23:46:45 +01:00
copy_paste: Strip back tests to only test handler. This gets us out of the brittle business of trying to mock a complex event like "paste"--which mocking basically means we are testing against the mock more than a real event. The test name is also changed to clarify the handler being tested. See CZO discussion behind this change: https://chat.zulip.org/#narrow/stream/43-automated-testing/topic/mocking.20browser.20events.3F/near/1615110
2023-07-27 19:03:32 +02:00
const {zrequire} = require("./lib/namespace");
node_tests: Move to web/tests. This lets us simplify the long-ish ‘../../static/js’ paths, and will remove the need for the ‘zrequire’ wrapper. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2023-02-22 23:04:10 +01:00
const {run_test} = require("./lib/test");
zjsunit: Deglobalize namespace. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-12-01 00:02:16 +01:00
js: Normalize strings to double quotes. Prettier would do this anyway, but it’s separated out for a more reviewable diff. Generated by ESLint. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 01:29:15 +02:00
const copy_and_paste = zrequire("copy_and_paste");
compose: Transform stream/topic urls on paste. Transforming valid stream/topic urls to the #**stream>topic** syntax. - A valid url contains a stream and optionally a topic but nothing else, and in that order. It must belong to the same origin as the Zulip server. The stream id present in the pasted url should correspond to an actual stream in the current server. - `near` links are not transformed. - Use-mention distinction is respected by not transforming a valid url if pasted using `Ctrl+Shift+V`. - No transformation occurs inside a code block. - On pressing `Ctrl+Z` after pasting, the actual pasted link is restored. - No transformation occurs if the url is pasted over an existing url in a markdown link syntax. - No transformation occurs if the stream or topic name contained in the pasted url is known to produce broken stream/topic syntax links (as per #30071). Fixes #29136
2024-07-12 06:58:32 +02:00
const stream_data = zrequire("stream_data");
stream_data.add_sub({
stream_id: 4,
name: "Rome",
});
run_test("try_stream_topic_syntax_text", () => {
const test_cases = [
[
urls: Generate narrow links in frontend with "channel" operator. Fixes #30385.
2024-10-03 18:37:58 +02:00
"http://zulip.zulipdev.com/#narrow/channel/4-Rome/topic/old.20FAILED.20EXPORT",
compose: Transform stream/topic urls on paste. Transforming valid stream/topic urls to the #**stream>topic** syntax. - A valid url contains a stream and optionally a topic but nothing else, and in that order. It must belong to the same origin as the Zulip server. The stream id present in the pasted url should correspond to an actual stream in the current server. - `near` links are not transformed. - Use-mention distinction is respected by not transforming a valid url if pasted using `Ctrl+Shift+V`. - No transformation occurs inside a code block. - On pressing `Ctrl+Z` after pasting, the actual pasted link is restored. - No transformation occurs if the url is pasted over an existing url in a markdown link syntax. - No transformation occurs if the stream or topic name contained in the pasted url is known to produce broken stream/topic syntax links (as per #30071). Fixes #29136
2024-07-12 06:58:32 +02:00
"#**Rome>old FAILED EXPORT**",
],
[
urls: Generate narrow links in frontend with "channel" operator. Fixes #30385.
2024-10-03 18:37:58 +02:00
"http://zulip.zulipdev.com/#narrow/channel/4-Rome/topic/100.25.20profits",
compose: Transform stream/topic urls on paste. Transforming valid stream/topic urls to the #**stream>topic** syntax. - A valid url contains a stream and optionally a topic but nothing else, and in that order. It must belong to the same origin as the Zulip server. The stream id present in the pasted url should correspond to an actual stream in the current server. - `near` links are not transformed. - Use-mention distinction is respected by not transforming a valid url if pasted using `Ctrl+Shift+V`. - No transformation occurs inside a code block. - On pressing `Ctrl+Z` after pasting, the actual pasted link is restored. - No transformation occurs if the url is pasted over an existing url in a markdown link syntax. - No transformation occurs if the stream or topic name contained in the pasted url is known to produce broken stream/topic syntax links (as per #30071). Fixes #29136
2024-07-12 06:58:32 +02:00
"#**Rome>100% profits**",
],
[
urls: Generate narrow links in frontend with "channel" operator. Fixes #30385.
2024-10-03 18:37:58 +02:00
"http://zulip.zulipdev.com/#narrow/channel/4-Rome/topic/old.20API.20wasn't.20compiling.20erratically",
compose: Transform stream/topic urls on paste. Transforming valid stream/topic urls to the #**stream>topic** syntax. - A valid url contains a stream and optionally a topic but nothing else, and in that order. It must belong to the same origin as the Zulip server. The stream id present in the pasted url should correspond to an actual stream in the current server. - `near` links are not transformed. - Use-mention distinction is respected by not transforming a valid url if pasted using `Ctrl+Shift+V`. - No transformation occurs inside a code block. - On pressing `Ctrl+Z` after pasting, the actual pasted link is restored. - No transformation occurs if the url is pasted over an existing url in a markdown link syntax. - No transformation occurs if the stream or topic name contained in the pasted url is known to produce broken stream/topic syntax links (as per #30071). Fixes #29136
2024-07-12 06:58:32 +02:00
"#**Rome>old API wasn't compiling erratically**",
],
urls: Generate narrow links in frontend with "channel" operator. Fixes #30385.
2024-10-03 18:37:58 +02:00
["http://different.origin.com/#narrow/channel/4-Rome/topic/old.20FAILED.20EXPORT"],
compose: Transform stream/topic urls on paste. Transforming valid stream/topic urls to the #**stream>topic** syntax. - A valid url contains a stream and optionally a topic but nothing else, and in that order. It must belong to the same origin as the Zulip server. The stream id present in the pasted url should correspond to an actual stream in the current server. - `near` links are not transformed. - Use-mention distinction is respected by not transforming a valid url if pasted using `Ctrl+Shift+V`. - No transformation occurs inside a code block. - On pressing `Ctrl+Z` after pasting, the actual pasted link is restored. - No transformation occurs if the url is pasted over an existing url in a markdown link syntax. - No transformation occurs if the stream or topic name contained in the pasted url is known to produce broken stream/topic syntax links (as per #30071). Fixes #29136
2024-07-12 06:58:32 +02:00
// malformed urls
urls: Generate narrow links in frontend with "channel" operator. Fixes #30385.
2024-10-03 18:37:58 +02:00
["http://zulip.zulipdev.com/narrow/channel/4-Rome/topic/old.20FAILED.20EXPORT"],
["http://zulip.zulipdev.com/#not_narrow/channel/4-Rome/topic/old.20FAILED.20EXPORT"],
compose: Transform stream/topic urls on paste. Transforming valid stream/topic urls to the #**stream>topic** syntax. - A valid url contains a stream and optionally a topic but nothing else, and in that order. It must belong to the same origin as the Zulip server. The stream id present in the pasted url should correspond to an actual stream in the current server. - `near` links are not transformed. - Use-mention distinction is respected by not transforming a valid url if pasted using `Ctrl+Shift+V`. - No transformation occurs inside a code block. - On pressing `Ctrl+Z` after pasting, the actual pasted link is restored. - No transformation occurs if the url is pasted over an existing url in a markdown link syntax. - No transformation occurs if the stream or topic name contained in the pasted url is known to produce broken stream/topic syntax links (as per #30071). Fixes #29136
2024-07-12 06:58:32 +02:00
["http://zulip.zulipdev.com/#narrow/not_stream/4-Rome/topic/old.20FAILED.20EXPORT"],
urls: Generate narrow links in frontend with "channel" operator. Fixes #30385.
2024-10-03 18:37:58 +02:00
["http://zulip.zulipdev.com/#narrow/channel/4-Rome/not_topic/old.20FAILED.20EXPORT"],
["http://zulip.zulipdev.com/#narrow/channel/4-Rome/topic/old.20FAILED.20EXPORT/near/100"],
["http://zulip.zulipdev.com/#narrow/channel/4-Rome/", "#**Rome**"],
["http://zulip.zulipdev.com/#narrow/channel/4-Rome/topic"],
compose: Transform stream/topic urls on paste. Transforming valid stream/topic urls to the #**stream>topic** syntax. - A valid url contains a stream and optionally a topic but nothing else, and in that order. It must belong to the same origin as the Zulip server. The stream id present in the pasted url should correspond to an actual stream in the current server. - `near` links are not transformed. - Use-mention distinction is respected by not transforming a valid url if pasted using `Ctrl+Shift+V`. - No transformation occurs inside a code block. - On pressing `Ctrl+Z` after pasting, the actual pasted link is restored. - No transformation occurs if the url is pasted over an existing url in a markdown link syntax. - No transformation occurs if the stream or topic name contained in the pasted url is known to produce broken stream/topic syntax links (as per #30071). Fixes #29136
2024-07-12 06:58:32 +02:00
["http://zulip.zulipdev.com/#narrow/topic/cheese"],
["http://zulip.zulipdev.com/#narrow/topic/pizza/stream/Rome"],
// characters which are known to produce broken #**stream>topic** urls.
urls: Generate narrow links in frontend with "channel" operator. Fixes #30385.
2024-10-03 18:37:58 +02:00
["http://zulip.zulipdev.com/#narrow/channel/4-Rome/topic/100.25.20profits.60"],
["http://zulip.zulipdev.com/#narrow/channel/4-Rome/topic/100.25.20*profits"],
["http://zulip.zulipdev.com/#narrow/channel/4-Rome/topic/.24.24 100.25.20profits"],
["http://zulip.zulipdev.com/#narrow/channel/4-Rome/topic/>100.25.20profits"],
compose: Transform stream/topic urls on paste. Transforming valid stream/topic urls to the #**stream>topic** syntax. - A valid url contains a stream and optionally a topic but nothing else, and in that order. It must belong to the same origin as the Zulip server. The stream id present in the pasted url should correspond to an actual stream in the current server. - `near` links are not transformed. - Use-mention distinction is respected by not transforming a valid url if pasted using `Ctrl+Shift+V`. - No transformation occurs inside a code block. - On pressing `Ctrl+Z` after pasting, the actual pasted link is restored. - No transformation occurs if the url is pasted over an existing url in a markdown link syntax. - No transformation occurs if the stream or topic name contained in the pasted url is known to produce broken stream/topic syntax links (as per #30071). Fixes #29136
2024-07-12 06:58:32 +02:00
];
for (const test_case of test_cases) {
const result = copy_and_paste.try_stream_topic_syntax_text(test_case[0]);
const expected = test_case[1] ?? null;
assert.equal(result, expected, "Failed for url: " + test_case[0]);
}
});
copy_and_paste: Add a simple extensible test suite. This commit is mostly about adding the test suite; some of the results are things we'd like to change.
2017-11-23 21:17:08 +01:00
copy_and_paste: Fix formatting of code pasted from VS Code. Since the html copied from VS Code is not structured as code but as styled divs for each line, any code copied from it would be pasted unformatted with blank lines between each line of code. This has now been fixed, by detecting VS Code style code blocks by the CSS property `white-space: pre` and pasting the text within as is, as code.
2024-02-29 16:31:01 +01:00
run_test("maybe_transform_html", () => {
// Copied HTML from VS Code
let paste_html = `<div style="color: #cccccc;background-color: #1f1f1f;font-family: 'Droid Sans Mono', 'monospace', monospace;font-weight: normal;font-size: 14px;line-height: 19px;white-space: pre;"><div><span style="color: #c586c0;">if</span><span style="color: #cccccc;"> (</span><span style="color: #9cdcfe;">$preview_src</span><span style="color: #cccccc;">.</span><span style="color: #dcdcaa;">endsWith</span><span style="color: #cccccc;">(</span><span style="color: #ce9178;">"&amp;size=full"</span><span style="color: #cccccc;">))</span></div></div>`;
let paste_text = `if ($preview_src.endsWith("&size=full"))`;
const escaped_paste_text = "if ($preview_src.endsWith(&quot;&amp;size=full&quot;))";
const expected_output = "<pre><code>" + escaped_paste_text + "</code></pre>";
assert.equal(copy_and_paste.maybe_transform_html(paste_html, paste_text), expected_output);
// Untransformed HTML
paste_html = "<div><div>Hello</div><div>World!</div></div>";
paste_text = "Hello\nWorld!";
assert.equal(copy_and_paste.maybe_transform_html(paste_html, paste_text), paste_html);
});
copy_paste: Strip back tests to only test handler. This gets us out of the brittle business of trying to mock a complex event like "paste"--which mocking basically means we are testing against the mock more than a real event. The test name is also changed to clarify the handler being tested. See CZO discussion behind this change: https://chat.zulip.org/#narrow/stream/43-automated-testing/topic/mocking.20browser.20events.3F/near/1615110
2023-07-27 19:03:32 +02:00
run_test("paste_handler_converter", () => {
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
/*
Pasting from another Zulip message
*/
// Bold text
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
let input =
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><span style="color: hsl(0, 0%, 13%); font-family: arial, sans-serif; font-size: 12.8px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: hsl(0, 0%, 100%); text-decoration-style: initial; text-decoration-color: initial;"><span> </span>love the<span> </span><b>Zulip</b><b> </b></span><b style="color: hsl(0, 0%, 13%); font-family: arial, sans-serif; font-size: 12.8px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: hsl(0, 0%, 100%); text-decoration-style: initial; text-decoration-color: initial;">Organization</b><span style="color: hsl(0, 0%, 13%); font-family: arial, sans-serif; font-size: 12.8px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: hsl(0, 0%, 100%); text-decoration-style: initial; text-decoration-color: initial;">.</span>';
assert.equal(
copy_and_paste.paste_handler_converter(input),
" love the **Zulip** **Organization**.",
);
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
// Inline code
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
input =
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><span style="color: hsl(210, 12%, 16%); font-family: -apple-system, BlinkMacSystemFont, &quot;Segoe UI&quot;, Helvetica, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: hsl(0, 0%, 100%); text-decoration-style: initial; text-decoration-color: initial; display: inline !important; float: none;">The<span> </span></span><code style="box-sizing: border-box; font-family: SFMono-Regular, Consolas, &quot;Liberation Mono&quot;, Menlo, Courier, monospace; font-size: 13.6px; padding: 0.2em 0.4em; margin: 0px; background-color: hsla(210, 13%, 12%, 0.05); border-radius: 3px; color: hsl(210, 12%, 16%); font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;">JSDOM</code><span style="color: hsl(210, 12%, 16%); font-family: -apple-system, BlinkMacSystemFont, &quot;Segoe UI&quot;, Helvetica, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: hsl(0, 0%, 100%); text-decoration-style: initial; text-decoration-color: initial; display: inline !important; float: none;"><span> </span>constructor</span>';
assert.equal(copy_and_paste.paste_handler_converter(input), "The `JSDOM` constructor");
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
// A python code block
copy_and_paste: Refactor code block turndown code to reduce duplication. So far, there were 2 separate turndown rules for code blocks; one for general ones, and the other for Zulip message code blocks. Now the filter rule has been generalised to handle both cases together. As a side effect, the bug where partially copied Zulip code blocks lost formatting on pasting has been fixed.
2024-02-02 01:22:13 +01:00
input = `<meta http-equiv="content-type" content="text/html; charset=utf-8"><p>zulip code block in python</p><div class="codehilite zulip-code-block" data-code-language="Python"><pre><span></span><code><span class="nb">print</span><span class="p">(</span><span class="s2">"hello"</span><span class="p">)</span>\n<span class="nb">print</span><span class="p">(</span><span class="s2">"world"</span><span class="p">)</span></code></pre></div></meta>`;
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
assert.equal(
copy_and_paste.paste_handler_converter(input),
copy_and_paste: Refactor code block turndown code to reduce duplication. So far, there were 2 separate turndown rules for code blocks; one for general ones, and the other for Zulip message code blocks. Now the filter rule has been generalised to handle both cases together. As a side effect, the bug where partially copied Zulip code blocks lost formatting on pasting has been fixed.
2024-02-02 01:22:13 +01:00
'zulip code block in python\n\n```Python\nprint("hello")\nprint("world")\n```',
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
);
turndown: Paste single line of code as inline code in markdown. When pasting any code without any newlines, whether from a code block or a code span, it will always be pasted as inline code. That is, a line of code copied from within a code span will retain code span formatting on paste, and a line of code copied from within a code block will be pasted as inline code, instead of a 1 line code block.
2023-11-29 22:53:07 +01:00
// Single line in a code block
input =
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><pre><code>single line</code></pre>';
assert.equal(copy_and_paste.paste_handler_converter(input), "`single line`");
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
// Raw links without custom text
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
input =
dependencies: Upgrade Source Sans Pro font to Source Sans 3. https://blog.adobe.com/en/2020/11/30/whats-new-in-source-sans-3.html Signed-off-by: Anders Kaseorg <anders@zulip.com>
2021-02-23 06:58:00 +01:00
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><a href="https://zulip.readthedocs.io/en/latest/subsystems/logging.html" target="_blank" title="https://zulip.readthedocs.io/en/latest/subsystems/logging.html" style="color: hsl(200, 100%, 40%); text-decoration: none; cursor: pointer; font-family: &quot;Source Sans 3&quot;, &quot;Helvetica Neue&quot;, Helvetica, Arial, sans-serif; font-size: 14px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: hsl(0, 0%, 100%);">https://zulip.readthedocs.io/en/latest/subsystems/logging.html</a>';
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
assert.equal(
copy_and_paste.paste_handler_converter(input),
"https://zulip.readthedocs.io/en/latest/subsystems/logging.html",
);
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
// Links with custom text
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
input =
compose: Always retain link formatting when pasting just a link. We add anchors to the list of enclosing elements we don't strip away.
2023-11-08 04:17:01 +01:00
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><a class="reference external" href="https://zulip.readthedocs.io/en/latest/contributing/contributing.html" style="box-sizing: border-box; color: hsl(283, 39%, 53%); text-decoration: none; cursor: pointer; outline: 0px; font-family: Lato, proxima-nova, &quot;Helvetica Neue&quot;, Arial, sans-serif; font-size: 16px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: hsl(0, 0%, 99%);">Contributing guide</a>';
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
assert.equal(
copy_and_paste.paste_handler_converter(input),
compose: Always retain link formatting when pasting just a link. We add anchors to the list of enclosing elements we don't strip away.
2023-11-08 04:17:01 +01:00
"[Contributing guide](https://zulip.readthedocs.io/en/latest/contributing/contributing.html)",
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
);
compose: Always retain `ol` tag when pasting content enclosed by it.
2023-11-07 09:21:38 +01:00
// Only numbered list (list style retained)
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
input =
compose: Always retain `ol` tag when pasting content enclosed by it.
2023-11-07 09:21:38 +01:00
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><ol><li>text</li></ol>';
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
assert.equal(copy_and_paste.paste_handler_converter(input), "1. text");
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
// Heading
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
input =
compose: Remove formatting enclosing entire selection when pasting. If the selection copied, is entirely within a single element, like text within a heading (like `h1`) we discard this outermost element and only convert the inner HTML to markdown. However, we retain `pre` so a code block within it stays as is and does not change into inline code, losing all its linebreaks.
2023-11-05 08:38:03 +01:00
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><h1 style="box-sizing: border-box; font-size: 2em; margin-top: 0px !important; margin-right: 0px; margin-bottom: 16px; margin-left: 0px; font-weight: 600; line-height: 1.25; padding-bottom: 0.3em; border-bottom: 1px solid hsl(216, 14%, 93%); color: hsl(210, 12%, 16%); font-family: -apple-system, BlinkMacSystemFont, &quot;Segoe UI&quot;, Helvetica, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;">Zulip overview</h1><p>normal text</p>';
assert.equal(copy_and_paste.paste_handler_converter(input), "# Zulip overview\n\nnormal text");
compose: Always retain `ol` tag when pasting content enclosed by it.
2023-11-07 09:21:38 +01:00
// Only heading (strip heading style)
input =
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><h1 style="box-sizing: border-box; font-size: 2em; margin-top: 0px !important; margin-right: 0px; margin-bottom: 16px; margin-left: 0px; font-weight: 600; line-height: 1.25; padding-bottom: 0.3em; border-bottom: 1px solid hsl(216, 14%, 93%); color: hsl(210, 12%, 16%); font-family: -apple-system, BlinkMacSystemFont, &quot;Segoe UI&quot;, Helvetica, Arial, sans-serif, &quot;Apple Color Emoji&quot;, &quot;Segoe UI Emoji&quot;, &quot;Segoe UI Symbol&quot;; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;">Zulip overview</h1>';
assert.equal(copy_and_paste.paste_handler_converter(input), "Zulip overview");
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
// Italic text
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
input =
compose: Remove formatting enclosing entire selection when pasting. If the selection copied, is entirely within a single element, like text within a heading (like `h1`) we discard this outermost element and only convert the inner HTML to markdown. However, we retain `pre` so a code block within it stays as is and does not change into inline code, losing all its linebreaks.
2023-11-05 08:38:03 +01:00
'<meta http-equiv="content-type" content="text/html; charset=utf-8">normal text <i style="box-sizing: inherit; color: hsl(0, 0%, 0%); font-family: Verdana, sans-serif; font-size: 15px; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: hsl(0, 0%, 100%); text-decoration-style: initial; text-decoration-color: initial;">This text is italic</i>';
assert.equal(
copy_and_paste.paste_handler_converter(input),
"normal text *This text is italic*",
);
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
// Strikethrough text
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
input =
compose: Remove formatting enclosing entire selection when pasting. If the selection copied, is entirely within a single element, like text within a heading (like `h1`) we discard this outermost element and only convert the inner HTML to markdown. However, we retain `pre` so a code block within it stays as is and does not change into inline code, losing all its linebreaks.
2023-11-05 08:38:03 +01:00
'<meta http-equiv="content-type" content="text/html; charset=utf-8">normal text <del style="box-sizing: inherit; color: hsl(0, 0%, 0%); font-family: Verdana, sans-serif; font-size: 15px; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: hsl(0, 0%, 100%); text-decoration-style: initial; text-decoration-color: initial;">This text is struck through</del>';
assert.equal(
copy_and_paste.paste_handler_converter(input),
"normal text ~~This text is struck through~~",
);
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
// Emojis
input =
emoji: Convert spritesheets to webp. This provides significant size savings: | Emoji set | png size | webp size | webp/png percent | | ----------- | -------- | --------- | ---------------- | | google-blob | 1968954 | 1373350 | 69.75% | | twitter | 2972820 | 2149672 | 72.31% | | google | 3455270 | 2327834 | 67.37% | Since these are the largest assets that we ship to clients, it is worth shaving off every byte we can.
2024-08-22 18:08:03 +02:00
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><span style="color: rgb(221, 222, 238); font-family: &quot;Source Sans 3&quot;, sans-serif; font-size: 14px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(33, 45, 59); text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial; display: inline !important; float: none;">emojis:<span> </span></span><span aria-label="smile" class="emoji emoji-1f642" role="img" title="smile" style="height: 20px; width: 20px; position: relative; margin-top: -7px; vertical-align: middle; top: 3px; background-position: 55% 46.667%; display: inline-block; background-image: url(&quot;http://localhost:9991/webpack/files/generated/emoji/google.webp&quot;); background-size: 6100%; background-repeat: no-repeat; text-indent: 100%; white-space: nowrap; overflow: hidden; color: rgb(221, 222, 238); font-family: &quot;Source Sans 3&quot;, sans-serif; font-size: 14px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(33, 45, 59); text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial;">:smile:</span><span style="color: rgb(221, 222, 238); font-family: &quot;Source Sans 3&quot;, sans-serif; font-size: 14px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(33, 45, 59); text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial; display: inline !important; float: none;"><span> </span></span><span aria-label="family man woman girl" class="emoji emoji-1f468-200d-1f469-200d-1f467" role="img" title="family man woman girl" style="height: 20px; width: 20px; position: relative; margin-top: -7px; vertical-align: middle; top: 3px; background-position: 23.333% 75%; display: inline-block; background-image: url(&quot;http://localhost:9991/webpack/files/generated/emoji/google.webp&quot;); background-size: 6100%; background-repeat: no-repeat; text-indent: 100%; white-space: nowrap; overflow: hidden; color: rgb(221, 222, 238); font-family: &quot;Source Sans 3&quot;, sans-serif; font-size: 14px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(33, 45, 59); text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial;">:family_man_woman_girl:</span>';
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
assert.equal(
copy_and_paste.paste_handler_converter(input),
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
"emojis: :smile: :family_man_woman_girl:",
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
);
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
// Nested lists
input =
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><ul style="padding: 0px; margin: 0px 0px 5px 20px; color: rgb(221, 222, 238); font-family: &quot;Source Sans 3&quot;, sans-serif; font-size: 14px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: 400; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; background-color: rgb(33, 45, 59); text-decoration-thickness: initial; text-decoration-style: initial; text-decoration-color: initial;"><li style="line-height: inherit;">bulleted</li><li style="line-height: inherit;">nested<ul style="padding: 0px; margin: 2px 0px 5px 20px;"><li style="line-height: inherit;">nested level 1</li><li style="line-height: inherit;">nested level 1 continue<ul style="padding: 0px; margin: 2px 0px 5px 20px;"><li style="line-height: inherit;">nested level 2</li><li style="line-height: inherit;">nested level 2 continue</li></ul></li></ul></li></ul>';
assert.equal(
copy_and_paste.paste_handler_converter(input),
"* bulleted\n* nested\n * nested level 1\n * nested level 1 continue\n * nested level 2\n * nested level 2 continue",
);
compose: Fix bug where extra line breaks were pasted between blocks. Due to the way turndown pads every block element with 2 new lines, and makes `br` double space by default, we would get 3 blank lines pasted when there's just 1 line break between 2 paragraphs. Now we set `br` to an empty string, and since turndown collapses sequences of multiple new lines to `\n\n` (1 blank line), so any 2 block elements will now always have 1 blank line between them, irrespective of if and how many line breaks there are between them in the copied HTML.
2023-11-17 10:19:19 +01:00
// 2 paragraphs with line break/s in between
input =
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><p>paragraph 1</p><br><p>paragraph 2</p>';
assert.equal(copy_and_paste.paste_handler_converter(input), "paragraph 1\n\nparagraph 2");
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
// Pasting from external sources
// Pasting list from GitHub
input =
'<div class="preview-content"><div class="comment"><div class="comment-body markdown-body js-preview-body" style="min-height: 131px;"><p>Test list:</p><ul><li>Item 1</li><li>Item 2</li></ul></div></div></div>';
assert.equal(copy_and_paste.paste_handler_converter(input), "Test list:\n* Item 1\n* Item 2");
// Pasting list from VS Code
js: Reformat with Prettier. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2020-07-15 00:34:28 +02:00
input =
docs: Fix capitalization mistakes. Signed-off-by: Anders Kaseorg <anders@zulip.com>
2021-05-10 07:02:14 +02:00
'<div class="ace-line gutter-author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90za3z66zs0z65zz65zq8z75zlaz81zcz66zj6g2mz78zz76zmz66z22z75zfcz69zz66z ace-ltr focused-line" dir="auto" id="editor-3-ace-line-41"><span>Test list:</span></div><div class="ace-line gutter-author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90za3z66zs0z65zz65zq8z75zlaz81zcz66zj6g2mz78zz76zmz66z22z75zfcz69zz66z line-list-type-bullet ace-ltr" dir="auto" id="editor-3-ace-line-42"><ul class="listtype-bullet listindent1 list-bullet1"><li><span class="ace-line-pocket-zws" data-faketext="" data-contentcollector-ignore-space-at="end"></span><span class="ace-line-pocket" data-faketext="" contenteditable="false"></span><span class="ace-line-pocket-zws" data-faketext="" data-contentcollector-ignore-space-at="start"></span><span>Item 1</span></li></ul></div><div class="ace-line gutter-author-d-iz88z86z86za0dz67zz78zz78zz74zz68zjz80zz71z9iz90za3z66zs0z65zz65zq8z75zlaz81zcz66zj6g2mz78zz76zmz66z22z75zfcz69zz66z line-list-type-bullet ace-ltr" dir="auto" id="editor-3-ace-line-43"><ul class="listtype-bullet listindent1 list-bullet1"><li><span class="ace-line-pocket-zws" data-faketext="" data-contentcollector-ignore-space-at="end"></span><span class="ace-line-pocket" data-faketext="" contenteditable="false"></span><span class="ace-line-pocket-zws" data-faketext="" data-contentcollector-ignore-space-at="start"></span><span>Item 2</span></li></ul></div>';
turndown: Improve pasting experience, focused on pasting Zulip messages. Turned off and tested escaping with `/` (for now). Added support + tests for: - headings. - strikethrough. - nested lists. - code blocks. Improved handling of: - links (custom and raw, ignored when wrapping a single image). - images (now pasted in Zulip's link like syntax). - custom emojis. - LaTeX (no garbage symbols, unformatted plain text is pasted) Added tests for emojis. Known concerns: - External images aren't handled anymore by upload.js -- is this a bug? - Tables lose their formatting on paste.
2023-04-18 19:34:19 +02:00
assert.equal(copy_and_paste.paste_handler_converter(input), "Test list:\n* Item 1\n* Item 2");
compose: Completely remove style elements when pasting HTML as markdown. Turndown would strip `<style>` tags, but retain the content enclosed. This resulted in unwanted content being pasted, like the comment nodes inside the `<style>` tag when pasting cell/s copied from Google Sheets.
2023-11-10 01:59:32 +01:00
// Pasting from Google Sheets (remove <style> elements completely)
input =
'<meta http-equiv="content-type" content="text/html; charset=utf-8"><style type="text/css"><!--td {border: 1px solid #cccccc;}br {mso-data-placement:same-cell;}--></style><span style="font-size:10pt;font-family:Arial;font-style:normal;text-align:right;" data-sheets-value="{&quot;1&quot;:3,&quot;3&quot;:123}" data-sheets-userformat="{&quot;2&quot;:769,&quot;3&quot;:{&quot;1&quot;:0},&quot;11&quot;:3,&quot;12&quot;:0}">123</span>';
assert.equal(copy_and_paste.paste_handler_converter(input), "123");
Add run_test helper for individual tests. This run_test helper sets up a convention that allows us to give really short tracebacks for errors, and eventually we can have more control over running individual tests. (The latter goal has some complications, since we often intentionally leak setup in tests.)
2018-05-15 12:40:07 +02:00
});