Commit graph

52 commits

Author SHA1 Message Date
Tamás Zolnai
35db23ea5a cypress: disable macro test for NC run.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Iec4d50e4d883330707437e796d450d8325ba419b
2021-03-17 17:31:01 +01:00
Tamás Zolnai
53642adf96 cypress: remove getLOVersion() method.
By now, we don't run the same online branch against more
core branches, so this code is obsolete.

Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: I90768d16628e735129880cc4cf823bf0b7d9ad1e
2021-02-05 16:38:23 +01:00
Tamás Zolnai
0db412ccf0 cypress: add new Save/Print test to php-proxy/NC blacklists.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Id494a522e0961894cdf9e5ce56b19b781a724974
2021-01-28 15:27:51 +01:00
Tamás Zolnai
0a0d185258 cypress: NC: disable failing spellchecking tests.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: I3d48a5069eb0bfad8168826b6ab79ccd7f207b32
2021-01-11 12:28:48 +01:00
Tamás Zolnai
a13b1a93bc cypress: try to handle support file better during parallel run.
When we run cypress tests in parallel (e.g. make check -j4), the
tests randomly fail with an uncaught error. The issue might be
because the same support file is shared between the different threads,
and they might access it at the same time. We try to create different
instances of the support file via preprocessing. Let's see whether it
makes the issue go away.

Issue's error message was:
"An uncaught error was detected outside of a test:
SyntaxError: The following error originated from your test code, not from Cypress.
Unexpected end of input"

Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: I7b256cd686fb2b0e79ab602e95d197388a5aadca
2020-12-17 19:12:44 +01:00
Tamás Zolnai
e368d04695 cypress: NC: make test retries work.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Ic8ca85e34de5ee26ee27d24a001de060b6169e86
2020-12-15 15:09:03 +01:00
Tamás Zolnai
f5c3e7c0ac cypress: php-proxy: reenable retries.
It works now, to run the same test twice.

Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: I0e288049aad42b9534ce3743c6d5a8d4a22bf926
2020-12-15 15:09:03 +01:00
Tamás Zolnai
0c08b6dad0 cypress: php-proxy: reenable table related tests.
There was an issue about tile invalidation related to
Writer tables. This was fixed in the meantime, so we can
enable table tests. I added an additional fix for
these tests to make it work with php-proxy too.

Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Id3f8288b65e597a49f0a45c8d106d5ed9f6ead46
2020-12-03 14:56:19 +01:00
Tamás Zolnai
979afcc0a1 cypress: NC: disable failing 'Automatic spell checking.' test.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: I6762c08b9a921eb942ee537195cbe530f3260dc1
2020-12-02 15:03:38 +01:00
Tamás Zolnai
01813eceec cyperss: php-proxy: Undo / Repair test passes now.
Change-Id: I17293ecc2f1490855cc1a217776b8c853c8c974c
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-19 13:47:24 +01:00
Tamás Zolnai
04139d31cd cypress: diable this new multi-user test case for NC and php-proxy.
Change-Id: I18688e130f9ac5b8976ca60ad44b798c48181129
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-14 12:24:36 +01:00
Tamás Zolnai
d9ce03331d cypress: php-proxy: reenable this test.
The issue was fixed triggered by this test case.

Change-Id: I00522835c25ca18aa374958c5b33b13f35e79563
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-13 23:17:06 +01:00
Tamás Zolnai
6620c77c3a cypress: php-proxy: disable this unstable test.
Change-Id: I6fa2f777c95dac57d4ae8b13063c04f44d1ff20c
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-13 08:53:14 +01:00
Tamás Zolnai
10df5de391 cypress: NC: disable retries.
In NC environment it does not work properly.

Change-Id: I9adbb01b450103a6ac2aa211eb933a5ab3f5fcd2
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-13 08:53:14 +01:00
Tamás Zolnai
175b32ddb1 cypress: NC: disable this unstable test.
Change-Id: Ifd7b970aac8e5f6a6bfc1a58d75eddf63ea42fd7
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-13 08:53:14 +01:00
Tamás Zolnai
2581ab44f9 cypress: remove core/master blacklist.
It is outdated.

Change-Id: I29de4a7ddbacb62cd091446929fe9ba56ce9baf9
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-12 16:38:11 +01:00
Tamás Zolnai
ffc114e909 cypress: php-proxy: disable calc undo / redo tests.
We might hit a race conidtion here. I'll need to
investigate this later. It seems sometimes the
selectio is what is undo-ed and not the text
modification.

Change-Id: Ib9c6214cefd0b8625116681c3cbca17899beaece
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-12 05:40:08 +01:00
Tamás Zolnai
f4dc257423 cypress: php-proxy: disable formula bar related tests.
It's a known issue that formula bar is very laggy,
which makes test to fail.

Change-Id: Ia2cbee763c596065e36d178913a8df400adb4668
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-10 20:18:32 +01:00
Tamás Zolnai
8829bc1167 cypress: php-proxy: disable retries.
For some reason the build hangs with retries. It must be
an issue with cypress itself, but I did not manage to
find a small reproducable test to report a bug about it yet.

Change-Id: I89874a2601649274ed9f7bf7a0e88c9cd1ffcf6f
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-09 21:56:09 +01:00
Tamás Zolnai
000c1390c2 cypress: php-proxy: disable all saving related tests.
It's a known issue, that with php-proxy we can't load
the same document twice.

Change-Id: I401a74734e1781f76847387ee9677a0fe6ca699d
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-09 12:54:20 +01:00
Tamás Zolnai
941754f978 cypress: NC: disable newly added Print test.
Change-Id: I30f5ea0bcb767b41ef62267c4935bdaf374d11e5
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-06 14:51:21 +01:00
Tamás Zolnai
3c0abda0e4 cypress: NC: disable new Saving test.
We need to do this differently in an NC environment.

Change-Id: I260fbe42851794e630be327bc25ec34201cad36c
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-05 20:29:22 +01:00
Tamás Zolnai
e9652b99b2 cypress: NC: disable printing also in Impress tests.
Change-Id: I2b2b12094ecaff828803418bf30372265e7855b3
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-03 22:00:16 +01:00
Tamás Zolnai
6d37d7aa6d cypress: NC: disable save related tests.
In an NC environment reopening a document is not that easy.

Change-Id: Id18042dc08ab82c0538b03c17ecf6c9fb697cb23
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-03 16:06:07 +01:00
Tamás Zolnai
221c02af36 cypress: NC: disable normal image insertion test.
On NC we have different options for image insertion.
In the feature, it would be good to create NC specific
tests too for image insertion.

Change-Id: I540bbe0ddd66e3a2a4560282fd48f9f9002f970d
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-03 10:20:19 +01:00
Tamás Zolnai
255224abca cypress: php-proxy: disable new image insertion test.
It's a known issue, that image insertion test does
not work with php-proxy.

Change-Id: I0cd22ff4a96893c386fce28c5ef87716fd7b9b71
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-11-02 20:44:53 +01:00
Tamás Zolnai
02be3eaa94 cypress: NC: test nextcloud specific features also in Impress / Calc.
Change-Id: I47c5a318239c2b5c96f1bf8f69298d3369f67d43
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/103290
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-09-24 10:58:44 +02:00
Tamás Zolnai
11b384b195 cypress: NC: test nextcloud specific features.
Change-Id: I52bc1709f29de1d69c2ae52c806bedad4eee8bc4
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/103254
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-09-23 16:41:44 +02:00
Tamás Zolnai
1d26d6513b cypress: disable multi-user tests for NC / php-proxy.
Change-Id: I3393a1fb0b998bd82295d6d566594ed05af50634
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/103102
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-09-21 14:49:21 +02:00
Tamás Zolnai
08ae0508f2 cypress: php-proxy: blacklist formulabar related test.
Change-Id: Ia5224adc358d6099056ee0b9938ab8b50e7f4e80
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/102893
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-09-17 13:17:12 +02:00
Tamás Zolnai
228d8af563 cypress: php-proxy: blacklist table related tests.
The application freezes with tables, beacuse of an
invalidate tiles loop. With php-proxy the lot of invalidate
tile messages blocks the execution.

Change-Id: Ife08b7cb335afc69108d970a8f0147be1ae9d90e
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/102892
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-09-17 12:23:45 +02:00
Tamás Zolnai
1fa089901e cypress: php-proxy: fix shape related tests.
Change-Id: I59e115785357e213346c9c403dc3078ef0b2b706
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/102891
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-09-17 12:23:32 +02:00
Tamás Zolnai
bdcfb9a1f0 cypress: php-proxy: blacklist image insertion tests.
For some reasion cypress image loading mechnism is not
working with php-proxy. Without cypress image insertion
works. So now I disable this test, later we can fix-up
cypress test to handle this scenario.

Change-Id: Id1b62f28b3f0cdfe9e26cc96dbafcbacbf472be8
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/102889
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-09-17 12:23:05 +02:00
Tamás Zolnai
142231151a cypress: NC: blacklist some tests.
In NC environment we don't handle cy.document() and
cy.window() well. Disable related tests for now.

Change-Id: Ibb9a9783bf1718a030d10fc69f8b7653fb12bc15
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/102471
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-09-11 18:28:12 +02:00
Tamás Zolnai
c99f2232b4 cypress: introduce ENABLE_VIDEO_REC flag.
We can enable video recording with this flag,
during a headless test run, so we can see what
happend on the UI.

Change-Id: I4558563a3de71742d8d6b1ca67f0c518d543afc7
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/99787
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-07-30 15:26:47 +02:00
Tamás Zolnai
5b70bcd4d3 cypress: avoid spaces in core version string.
It causes issues when passing this string as a
command line argument.

Change-Id: I9af569c8ab941f392800c3c678085c384bec2908
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/99374
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-07-24 15:30:29 +02:00
Tamás Zolnai
86f2db47a4 cypress: add an option to dump only console.error() messages.
With the ENABLE_LOGGING flag we get all errors coming from
the browser, which is a lot. So I introduce ENABLE_CONSOLE_LOG
flag now, which dumps only console.error() messages, so we
can debug the client code easier when we run a test in headless mode.

It will be useful for multi-user tests, where we can't use the
interactive test runner, because we need to run more users at
the same time.

Change-Id: Icfa62412b83e37398c54e9ac7b4120d76a87fb92
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/99071
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Tested-by: Jenkins
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-07-20 18:15:55 +02:00
Tamás Zolnai
f934aa59a8 cypress: update writer table related tests.
Change-Id: I70039a14d6ad8ee33ae833c24111e6ca8d8caee4
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/98202
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-07-06 13:07:36 +02:00
Tamás Zolnai
97b82b5dec cypress: enable page setup tests.
Change-Id: I8eeb91c76e42cd868c491534e57cb08d2ea7675d
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/98190
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-07-06 10:16:17 +02:00
Tamás Zolnai
93a0f40341 cypress: reenable font size related tests.
They are fixed now:
8b3cb9a176

Change-Id: Ia6e4348c62c1b9b3ded827640e0a33a8ce15c487
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/97842
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-07-03 14:17:20 +02:00
Tamás Zolnai
9ac9bc8be4 cypress: add initial code coverage support.
It's not optimal now, beacuse it changes source files.

Change-Id: I01cfb0be37eb0ef21dd1d606d9260b455a1cd585
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/97036
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Tested-by: Jenkins
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-25 13:27:53 +02:00
Tamás Zolnai
1949cad473 cypress: tests for page setup (writer, mobile)
Change-Id: I8c3db014daa00608351156c1de8d615b30314701
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/96605
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-18 15:16:06 +02:00
Tamás Zolnai
c0e7b862da cypress: update desktop/calc/focus_spec.js
Clicking on the formulabar is not a reliable way to move
the cursor to a specific text position.

Change-Id: I9ea48f4591707531a3dfdfb02b18d6fcb08921a6
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/96163
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Tested-by: Jenkins
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-11 21:24:36 +02:00
Tamás Zolnai
08c20c5620 cypress: update impress/apply_paragraph_props_spec.js test.
Change-Id: I8a404f7704fbe2a010b017f48128b1135f6ff8e3
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/96050
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-10 17:50:15 +02:00
Tamás Zolnai
0e38bc6017 cypress: update impress/apply_font_spec.js test.
Change-Id: Ie305e3f29115ab88c019445e61a9961b7a952904
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/96029
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-10 17:21:38 +02:00
Tamás Zolnai
f64dfc2999 cypress: disable failing tests with cp-6-4 branch.
Change-Id: I137a1e9dbe6121052b78b146135288205e4bde2f
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/95851
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-08 19:47:49 +02:00
Tamás Zolnai
5149305dba cypress: better way of filter out tests based on core version.
We use cypress-select-tests to filter out tests before
the tests are started. One advantage is that these tests
are showed as skipped in the log and also beforeAll() is
not called for these test cases which can speed things up.

Also we can avoid to add too much noise to the test code.
When we are working with more branches, we can just add
blacklists separately for all branches.

Change-Id: Ie7808614e42a19a0820f372720cc391511e165f5
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/95585
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Tested-by: Jenkins
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-06 17:53:37 +02:00
Henry Castro
6e230e4ba6 cypress: enable logging browser side
This time the logs come from the browser

Change-Id: If9b66a140b0174d0e3ef1e1e492ceeb49953d563
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/94468
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Henry Castro <hcastro@collabora.com>
2020-05-21 19:53:43 +02:00
Tamás Zolnai
dc15a4c398 cypress: integrate cypress-failed-log package.
To get a better log in case of error.

Change-Id: Id8f72c78cb8a80e30ba3012147caa8106e1e7ce2
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90470
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-13 15:00:54 +01:00
Tamás Zolnai
cb9fa14d23 cypress: fix failures caused by dirty test documents.
It seems sometimes writeFileSync() method does not
actually overwrites the document and some tests loads
a test document modified by an other test.
Hopefully removal of the file will solve this issue.

Change-Id: I2cecfd367acce185eeebbdc4269a73a9d1d2dd5a
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90339
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-11 19:12:21 +01:00