Commit graph

82 commits

Author SHA1 Message Date
Tamás Zolnai
9afe83e306 cypress: don't clear cypress cache by make check.
It's a global cache. Calling make clean on one branch
can break the build on a different because the
shared cache is removed.

Change-Id: Id03fb6b6fd69e899276abc93c3d907538576d8bd
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/97841
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-07-03 14:30:22 +02:00
Tamás Zolnai
9205b4e309 cypress: improve error matcher.
Change-Id: Idad9b6a37b86160c65e0af25bee844652b83f77b
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/97229
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-26 15:54:56 +02:00
Tamás Zolnai
e198daae3d cypress: fix build.
Change-Id: Ie8df2a37312c0bee5827cb9378c2147a6b30bffd
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/97228
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-26 15:26:12 +02:00
Tamás Zolnai
2a48c97a84 cypress: improve coverage run.
Change-Id: I48637063c998a7c72da8e610ae0c8cc18c61a52a
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/97152
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Tested-by: Jenkins
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-25 21:35:50 +02:00
Tamás Zolnai
9ac9bc8be4 cypress: add initial code coverage support.
It's not optimal now, beacuse it changes source files.

Change-Id: I01cfb0be37eb0ef21dd1d606d9260b455a1cd585
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/97036
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Tested-by: Jenkins
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-25 13:27:53 +02:00
Tamás Zolnai
725fa229e4 cypress: improve error log.
Change-Id: I5b91553af3f7fee5233c779fd2abd597af10fb02
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/96328
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-15 14:44:10 +02:00
Tamás Zolnai
7da449d23c cypress: improve error matcher.
Change-Id: I82f209bfb32660723c1a0ec686b8ba363aa612fc
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/95854
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-09 00:04:50 +02:00
Tamás Zolnai
3543df5430 cypress: better way of detecting core version.
We need this information earlier before we load the
test document. We can use call LO binary to get
the version string.

Change-Id: I72927df1fd79ff12906b55376c3474aa973dce07
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/95584
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-05 16:33:26 +02:00
Tamás Zolnai
558bf487ed cypress: workaround cypress issue with absolute path and symlinks.
https://github.com/cypress-io/cypress/issues/3482
Absolute path was introduced for that case when
somebody uses a separate builddir. However cypress
has an issue with absolute path. Let's avoid this
issue when builddir and sourcedir are the same.

Change-Id: Ic825d0abba86cafb1e243da510fd1aefb77575a6
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/95406
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-03 13:10:53 +02:00
Tamás Zolnai
a845757e82 cypress: clean cypress cache by 'make clean'.
Change-Id: I4799155fd16c69f83cc9c023206b3a3bc7d2bed2
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/95401
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-06-03 11:38:12 +02:00
Tamás Zolnai
c3c9f25954 cypress: deduplicate config related code in make file.
And break commands to multiple lines for better readability.

Change-Id: I5ee25bb34e69f80346a0dbfd3cf5b81329cc8438
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/94711
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-05-22 23:41:26 +02:00
Tamás Zolnai
015beba207 cypress: document the new spec option of make run-* commands.
Mention it also in the log in case of error.

Change-Id: Ib99dc2d2122a0658c86b223d94fec24de106fbd4
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/94710
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-05-22 23:41:20 +02:00
Henry Castro
defe39ac29 cypress: run interactive specific unit test
If unit test fails, so we can run interactive unit
test to analyse the results (command line)

Change-Id: I44fff4a442b2f6be0dbfced1359e27fc07c2c12e
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/94426
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-05-22 21:09:07 +02:00
Henry Castro
16028271bb cypress: fix running single unit test
When builddir != srcdir

Stills error:

"The support file is missing or invalid.

Your `supportFile` is set to `cypress_test/support/index.js`, but either
the file is missing or it's invalid. The `supportFile` must be a `.js`
or `.coffee` file or, if you're using a preprocessor plugin, it must be
supported by that plugin.

Correct your `cypress.json`, create the appropriate file, or set
`supportFile` to `false` if a support file is not necessary for your
project."

Change-Id: If1aeb55a3821735022dfa57af217130f18cd9dbf
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/94424
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-05-22 21:08:59 +02:00
Henry Castro
6e230e4ba6 cypress: enable logging browser side
This time the logs come from the browser

Change-Id: If9b66a140b0174d0e3ef1e1e492ceeb49953d563
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/94468
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Henry Castro <hcastro@collabora.com>
2020-05-21 19:53:43 +02:00
Tamás Zolnai
09dec12811 cypress: improve the output in case of error.
Mention also the command for the interactive test runner.

Change-Id: Ia013ea589229542d571d9a587ec85ae05ed6b4da
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/94590
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-05-20 21:41:54 +02:00
Henry Castro
e6f5917812 cypress: fix error running single unit test
builddir != srcdir

Change-Id: I2521c3e11f05f0c91bf0e8f5667a5466493acac0
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/94080
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Henry Castro <hcastro@collabora.com>
2020-05-13 16:51:29 +02:00
Tamás Zolnai
84f46074f9 cypress: start Xvfb with screen argument.
It fixes an error during cypress verify:
https://github.com/cypress-io/cypress/issues/6184

Change-Id: I993bf6cda5f8018d394ee6ee506f99d07b1e6e56
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/93793
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-05-10 12:45:28 +02:00
Tamás Zolnai
50d4451c21 cypress: catch also "Command failed:" as an error.
Change-Id: Ie5649886eabf3994ba003dc9e7b9b28790c1a58b
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/93925
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-05-10 12:15:46 +02:00
Tamás Zolnai
4008c7120d cypress: don't run mobile and desktop tests in parallel.
With the recent mobile detection related changes having
mobile and dekstop tests running in parallel make the build
fail.

A related commit:
255d24ba8f

Change-Id: I69929b5dbd37298e27409d247a651c79f6dbe33f
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/93222
Tested-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-04-30 18:26:34 +02:00
Tamás Zolnai
91bcea3195 cypress: add eslint plugin files as a dependency of NPM installation.
So the build will update the plugin package after every change.

Change-Id: I687def1d29fe3acdd364b61c69ac1a7d3cf7cb84
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/93115
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-04-29 06:58:14 +02:00
Tamás Zolnai
98e3994e6a cypress: add an own eslint config for the test code.
This parserOptions was added for cypress test so
move that into the tests' own config:
b2ec95dcfd

Change-Id: I3c565d212409cc01621eca97cd59ae7869d852cc
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/92857
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-04-24 14:41:31 +02:00
Tamás Zolnai
dde40739f6 cypress: write out the command for running the test file in case of failure.
Change-Id: Iba856ee675a4a545e7f44d396a92638633ec9540
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/92225
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-04-14 20:48:07 +02:00
Tamás Zolnai
96819f81cb cypress: generate test names dynamically for the parallel build.
Also improve afterAll(). Having test files with the same suffix
led to test failure. We can have better result with a regex.

Change-Id: I8d678aa17eb0e28e643cc86f584aab713ca153ca
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/92157
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-04-14 16:22:35 +02:00
Tamás Zolnai
b394c5a8f7 cypress: introduce a second chance for the tests to pass.
In parallel build try to run the specific test files
for a second time if they fail. Let's be realist,
testing an online application always has some
unreliabilities, let's make things more reliable with
running test more times and abort the build only if
the test fails consistently.

This is enabled only for parallel builds now, so we
have it on Jenkins. A simple make check will be more
deterministic. I also added an option to disable second
chance for parallel build: see CYPRESS_NO_SECOND_CHANCE
make file variable.

Change-Id: Ib7c554a238ded7ee15908b9f0c2d2c92ef0dcf32
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/91987
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-04-14 11:38:44 +02:00
Tamás Zolnai
56c6f5cc48 cypress: mobile: add some tests for alignment properties in Calc.
Change-Id: I6a0209a484041a3df44e5472a4b0679193dd38c1
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/91912
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-04-08 14:30:13 +02:00
Tamás Zolnai
bdef8193b8 cypress: simplify output error matcher.
Change-Id: I18392d8aabd9f3f4ba43139f9e951faead8b9667
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/91876
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-04-08 11:24:38 +02:00
Tamás Zolnai
efdc8b25b4 cypress: run JS error check also for make run commands.
Change-Id: I0a00d64e2222cbad5fc7e89711a89bb3620f793f
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/91875
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-04-08 11:22:20 +02:00
Tamás Zolnai
aeb48c3ad5 cypress: Catch any "Error:" in log.
Change-Id: Ia82f896e7ff4299e25ac38283f0e518bef25f875
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/91808
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-04-07 12:40:16 +02:00
Tamás Zolnai
d41348e841 cypress: add the issue link about hash values.
Change-Id: Ied7d05a2b5d112c222076d5799e44dd89a2f8641
2020-04-04 17:09:41 +02:00
Tamás Zolnai
4246d1e73a cypress: Catch also timout error of the new cypress-wait-until package.
Change-Id: I0b9856bbf933040a107c6cb8fe738d7a9f30a4a1
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/91653
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-04-03 18:19:33 +02:00
Tamás Zolnai
ab10cc1c83 cypress: mobile: number formatting tests in Calc.
Change-Id: I07b919f4bc06f5f368c23b5fed014cb5011c8e68
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/91411
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-31 13:30:04 +02:00
Tamás Zolnai
732a69e69b cypress: use hardcoded value as WSD hash.
cypress test framework has a problem with some
specific hashes (for example: 769e98018) and it
do not pass these values to the test code, which
make all test fail with 404 error.

Change-Id: I385b1621de25fdf90e6169bdff25eaf3c18cf81e
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/91101
Reviewed-by: Michael Meeks <michael.meeks@collabora.com>
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
2020-03-26 15:58:22 +01:00
Tamás Zolnai
3b1ca68a21 cypress: mobile: add spellchecking tests for impress.
Change-Id: I7b3909c79ca1fad27c5e3754a36f38f659e467e1
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90712
Tested-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-19 14:48:42 +01:00
Tamás Zolnai
6e96d4f6df cypress: catch "Uncaught TypeError" error in the log.
During parallel build.

Change-Id: I18d78250650e5d16ff9a4ff8588a2e955a934f44
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90721
Tested-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-19 12:30:54 +01:00
Tamás Zolnai
29aa5e15d2 cypress: calc-mobile: add tests for spellchecking menu.
Change-Id: If0c1af21c69b49452ccdc24e3c908396a045e03d
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90615
Tested-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-17 18:23:10 +01:00
Tamás Zolnai
8c6bc949da cypress: better parallel build detection.
Now it works both with '-j' and with '-j <number>'.

Change-Id: I41ebace6fd799f103ce557a8cf8419fea786faca
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90496
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-14 22:04:32 +01:00
Tamás Zolnai
f49783b7be cypress: add package.json as a dependency of local npm installation.
So packages will be reinstalled, when packages.json changes.

Change-Id: I4731b4995bc969a474ea3fcd36e1135ed03ec62c
2020-03-12 19:02:32 +01:00
Michael Meeks
9e0ec98aaf cypress: rename the user-agent to not include a space.
Makes some combinations of chrome etc. happy it seems.

Change-Id: Ica8063e42a8719f2ba45de9084ad1fddd6fb58bd
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90419
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-12 18:51:30 +01:00
Tamás Zolnai
d0fe43bffa cypress: catch also AssertionError.
Change-Id: I78a5d0f5a160a68197019735565689f61a5cdb39
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90372
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-12 12:06:55 +01:00
Tamás Zolnai
bbf31dc62a cypress: mobile: test changing font properties in calc.
Change-Id: I23b26ed9d9866bace0b8f83a7e54674d8c49d451
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90292
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-10 19:48:43 +01:00
Tamás Zolnai
ae759479f7 cypress: better way to find out test failure.
Change-Id: I2a398714976f65977cc64490206e7e57c1da5d86
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90256
Tested-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-10 14:56:51 +01:00
Tamás Zolnai
79073f6ce1 cypress: mobile: add first insertion related tests for calc.
Change-Id: I57561ef5687119cd53d99ea46e9ca3a269548422
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90237
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-10 11:18:04 +01:00
Tamás Zolnai
90c5717466 cypress: mobile: avoid hard coded coordinates for calc focus tests.
Change-Id: I9da74fcd090371cbea5b3a8c8836bf9236f709b3
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90224
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-09 15:39:40 +01:00
Tamás Zolnai
68924966c0 cypress: mobile: merge styles tests to font tests.
There is not much more we can test about styles,
since now we have only an apply style button.

Change-Id: I92a1a6dc60701743af44928966475cf4471b317b
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/90108
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-06 15:19:34 +01:00
Tamás Zolnai
d9a23d9668 parallel-cypress: improve console output of parallel test run.
Change-Id: I29440bafdba101c3f4e86de7d587330b972289de
2020-03-03 16:00:30 +01:00
Tamás Zolnai
033e353e9d parallel-cypress: restore original sequential build.
Running all tests in one command will display a better output
and also might be faster.

Change-Id: Ib061fad28eeb1246c774bfb7fd958c3f5b9c317b
2020-03-03 12:41:54 +01:00
Yunusemre Şentürk
e18b7ca425 Wait until Xvfb says it is ready
Change-Id: I3af4428802d6e0ee380536e8dbad1de8aa6d9337
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/89727
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-03-03 12:41:54 +01:00
Tamás Zolnai
2cfd990e75 parallel-cypress: Start own Xvfb in CI environment.
It's not necessary when we build with one job, but when
there are more jobs they try to start their own Xvfb
and they might use the same DISPLAY number for that
which leads to a failure or a freeze.
See also:
https://docs.cypress.io/guides/guides/continuous-integration.html#Xvfb

Change-Id: I2fb301b1d8e889b2898d6792fb38cece303129a6
2020-03-03 12:41:54 +01:00
Tamás Zolnai
eb3b3e54d4 parallel-cypress: during parallel build don't write out execution line-by-line
Because in this case, the output of the different threads will be
mixed in the command line.
For sequential build keep the original behavior.

Change-Id: Ibf9bf7c6111f8b5b0cf188fab66b97dedd613c65
2020-03-03 12:41:54 +01:00