By now 'make check-mobile' and 'make check-desktop' commands
are not supposed to run in parallel. So 'make check-mobile -j3'
won't run mobile tests in parallel (three tests at once).
However, before this commit running these make rules with more
jobs, led to build failure. With this commit the build does not
fail, but still ignores the jobs and run the tests on a single job.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: I13e13fdefcfb393ae5a42b4e065bbfe00278236a
So we can catch crashes / debug messages of core code.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Ib11426e7fdd8f219be4715b3f1e2983ad33d7f2b
To run interference tests for desktop tests.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Ibe06399846a37345ab08fd830b6350fe12ba2e37
5 seconds gap between the two users was moved from
js code into the makefile in:
9ff0f3e9fe
We need it for interactive run too.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: Ic8aa541ce30f3146a61875ea66c904e65f0d6cf9
So it's easier to find the loolwsd.log of the last
called command.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: I4d597a3d6683360ef03f15061a68a30db8ae498e
For running interference test in interactive mode.
The interference user is run in the background and
the user running the test code is displayed in the
interactive test runner.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: I3595a618f78603ed3e5321969a7395b60555470b
Added `make check-interfer-mobile` command for running
interference tests. Now it works with writer tests.
I'll generalize it later.
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Change-Id: I2181a8653d61cc6ed873e2887a3e42767f46f177
We have more users running already for one test, better
to avoid side-ffects coming from running more multi-user
test in parallel (they are using the same loolwsd).
Change-Id: I1cbed36a3ffe2825c384b525da361c4cfe781b38
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
We have a way of running the tests against
the actualy php-proxy script:
CYPRESS_INTEGRATION="php-proxy" make check
So let's remove the C++ implementation, so we don't
need to maintain a duplicated code.
Change-Id: Ie095a70a8175cc8cb4894905826d13762127b148
Signed-off-by: Tamás Zolnai <tamas.zolnai@collabora.com>
The idea it to run an existing cypress test while
the same document is opened by a second user. The second
user does some activity (e.g. moving cursor, clicking, etc)
and we check whether it makes any interference with the first
user's view. The first user is doing the actual test's steps,
so we can see if interference breaks the assertions.
Now it's just a prototype for testing it in the CI setup.
Change-Id: I3e02c037754862d628c73bbb4b2d82ea84b8a719
Jenkins sometimes does not work properly and core
installation is not accessible for online build.
In this case the test build was passing without
actually run the tests. Fail on this instead to
avoid getting untested patches in the code repo.
Change-Id: I35c49562dfeaeda5f6c8aa4bd3a746b1f04de3ea
It's more effective, since it reruns only the failing test,
not the whole test suite. Also it has a nicer output.
Change-Id: I8a50a20366b76a5cedb4e9383220c53f367c5a68
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/102995
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
To run mobile test with php-proxy simulation.
It's an initial command, should be improved later,
after php proxy simulation nicely works with the
tests.
Change-Id: Id9d2bacfbf09ca34a2c84e0d32808749df4c1909
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/102321
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
The related issue was fixed upstream.
Change-Id: I8b1191d3c0d5543233ace9322a7d768b3424d62d
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/100435
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
To run multi-user tests in interactive test runner.
It has two non-optional parameter. 'spec' defines the
test file and 'user' defines which user is run in the
interactive test runner. The other user is run in the
background.
Change-Id: I8612c201d7d3aeb2bdadd9d3786fb8eb0b60ab55
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/100167
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Test less which might make this test more stable.
Change-Id: Icf11af96bc5d21a14f0a74a641ffed3f91b6e482
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/99783
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
We need to introduce separate rules to dump
the log and to dump out the error message.
Otherwise GNU make evaluation breaks the workflow.
It evaluates $(wildcard $(ERROR_LOG)) before the
test were actually executed. So first run the tests,
then dump the error output and then go into error state.
Change-Id: I0f8e5de6800f0691cca14019819972437a741382
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/99781
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
To run multi-user tests only.
- make check-multi runs all multi-user tests.
- make check-multi spec=sidebar_visibility runs
only the test pair with the specified name.
Change-Id: Idada04960a6a2d33c7f36ef57bc1d6a1d1cffa99
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/99682
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Before we used the GNU make implicit parallelization
which triggered by recipe structure.
Instead of that we use linux's bakcground process
feature and run one client in the background and
the other one in the foreground.
Change-Id: I9de899686ae67b47eee005f157b6622ae4c5fe33
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/99484
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
It causes issues when passing this string as a
command line argument.
Change-Id: I9af569c8ab941f392800c3c678085c384bec2908
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/99374
Tested-by: Jenkins
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
Newly jails folder is cleaned up after a run.
Change-Id: Ia4f3eb26f61c5f14304e9ae6a3d5b5f60a0ee592
Reviewed-on: https://gerrit.libreoffice.org/c/online/+/98204
Tested-by: Jenkins CollaboraOffice <jenkinscollaboraoffice@gmail.com>
Reviewed-by: Tamás Zolnai <tamas.zolnai@collabora.com>
