Commit graph

14 commits

Author SHA1 Message Date
Tamás Zolnai
a180d01154 cypress: don't mention video recoring option for interference testing.
cypress video recoring does not work when we have two cypress
instances at the same time.

Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Ib807a001aa497ec9c7ef98df4f8f40236890879c
2021-02-19 11:46:45 +01:00
Tamás Zolnai
219af45449 Revert "cypress: print out test failure output online during parallel build."
It can be confusing to have the same error message twice.

This reverts commit 6786f563f8.

Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: I66f0495262fc5e5c0a228fdfc417e2e3301ad03e
2021-02-16 16:06:48 +01:00
Tamás Zolnai
aa7bcc0490 cypress: make: generate better error message for interference tests.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Ie6347999debc6be0c11672dda29afed0c05e4059
2021-02-05 15:14:45 +01:00
Tamás Zolnai
ca65e63da6 cypress: dont mention video recording option for multi-user tests.
It does not work when two cypress instances running at the
same time.

Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Iae7fe4c4dcc4bb0a970763001e4f966b60f988f2
2021-02-03 14:56:32 +01:00
Tamás Zolnai
18169d795b cypress: mention video recording option in failure log.
It's a useful option to create a video during headless run.
It's much closer to the headless build wrt. timing, than
interactive test runner.

Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Ic9889209ac07b9fe0a9b6e326e60513412950780
2021-01-29 11:04:49 +01:00
Tamás Zolnai
6786f563f8 cypress: print out test failure output online during parallel build.
Before this commit failure logs were gathered inside an error log
file and they were displayed after all tests are finsihed.
After this commit we print this failures logs when the error occurs
and also at the end of the test run. Sometimes Jenkins does not finish
the whole build because of timeout abortion. In this case, it would
be helpful to see some failure logs.

Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Ibe7cb6aa2c9f99912d604c4b642cda363352ffcd
2021-01-14 12:57:41 +01:00
Tamás Zolnai
d4579f08d4 cypress: write out failure online.
We used to write out failure log only in the end of
all cypress tests. Better to log also during running
the tests to get some online feedback.

Change-Id: Ifab3fcfc5491cc586367796cf0da949e1d7e3bc6
2020-10-15 11:56:42 +02:00
Henry Castro
7ace65f5fd cypress: fix buildir != srcdir when run parallel
Change-Id: Id4763a7af8a0d705aefb403dbfb8fb694f97749f
2020-10-09 17:14:34 -04:00
Tamás Zolnai
5c2f5eac2e cypress: use built-in test retries.
It's more effective, since it reruns only the failing test,
not the whole test suite. Also it has a nicer output.

Change-Id: I8a50a20366b76a5cedb4e9383220c53f367c5a68
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/102995
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-09-18 12:50:45 +02:00
Tamás Zolnai
b16182c3c3 cypress: correctly append "Second chance!" string to the output.
Change-Id: I193b4b916babcda4e321b9c83e0301cc8a4b947f
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/101734
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-08-31 15:41:03 +02:00
Tamás Zolnai
3753406ed2 cypress: update error message with multi-user interactive runner command.
Change-Id: Iccaa3fd3fd27133b21a099e463debb3e4d226c5f
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/100312
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-08-07 14:59:49 +02:00
Tamás Zolnai
fd6b984a3c cypress: introduce make check-multi command.
To run multi-user tests only.
- make check-multi runs all multi-user tests.
- make check-multi spec=sidebar_visibility runs
only the test pair with the specified name.

Change-Id: Idada04960a6a2d33c7f36ef57bc1d6a1d1cffa99
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/99682
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-07-29 14:26:51 +02:00
Tamás Zolnai
439b4af8ad cypress: better way of detecting error during parallel run.
We used to grep for error messages in the output, but
it can change what is written out. Better to catch if
the command fails directly.

Change-Id: I8c3cba212b262227551876bfb23629a243424c39
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/99365
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-07-27 23:18:59 +02:00
Tamás Zolnai
09abe6724f cypress: extract parallel test running code to a shell script file.
Change-Id: Ice856737b5b4bcfc6a202b507a03fdfa16938c25
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/99364
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Tested-by: Jenkins
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
2020-07-27 23:18:50 +02:00