currently we're in our trial and trying to setup a working pipeline for siesta test.
We started using web driver to setup our test pipeline (CI). It didn't work, so we tried out puppeteer. The effort to setup was insane, but in the end it seemed to work.
Then our pipelines started failing randomly (without adding tests or chaning anything).
Today i started investigating the issue - first we assumed it may just be the tests - we're still new to this and took beginner issues into consideration.
The issue is now the following:
Using puppeteer, about 43% of test fail (16 out of 37 test runs failed). Puppeteer needs at avarage 45-50 seconds per test run (when it succeeds)
Using webdriver, 3% failed (1 out of 30 tests). Webdriver needs at avarage 34 seconds per run.
I assume, partially that is just because extjs and its long loading time etc etc (using development build on a apache setup to use nyc).
Mostly puppeteer fails with the message "Inactivity timeout 180000ms has been exceeded"
As well we found out, that puppeteer reports 82 tests in our setup, webdriver reports 79. The web UI reports 82 tests as well.
We have a few complex tests which uses mouse movement, clicks etc. Once we excluded them, the test amount was the same with both setups (37 tests), so i guess there is something more to investigate with webdriver.
The result, however, didnt change - we had there as well some issues with randomly failing tests (raw "unit" tests, just creating instance of xy and test some methods which does not render something or do other fancy stuff)
We have the same issues using Windows 10
puppeteer: OS: Windows, agent: Chrome 76.0.3803.0
webdriver: OS: Windows, agent: Chrome 75.0.3770.142
and our automatic ci using linux
puppeteer: OS: Linux, agent: Chrome 76.0.3803.0
Command:
cross-env-shell siesta/bin/puppeteer https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
We're using sencha cmd via ext-gen (node). Some errors just state "Unrecognized class name / alias: Ext.data.Store", properties beeing gone (or references) "Cannot read property 'disabled' of undefined" or the already stated timeout issue.
What can we do to get rid of this errors?
Is there any guide with a working example using webdriver in an docker environment for the CI process?
Regards
Kai
Logs (i cut out some since the thread has a character limit):
webdriver logs
>
> cross-env-shell siesta/bin/webdriver https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 75.0.3770.142
[PASS] tests/integration/authorized/mobile/mobile.spec.js
[PASS] tests/integration/authorized/mobile/behavior.spec.js
[PASS] tests/integration/unauthorized/login.spec.js
[PASS] tests/integration/unauthorized/forgotPassword.spec.js
[PASS] tests/unit/model/Brief.spec.js
[PASS] tests/unit/view/components/base/Grid.spec.js
[PASS] tests/unit/view/main/MainViewModel.spec.js
[PASS] tests/unit/view/user/UserController.spec.js
79 passed, 0 failed assertions took 33.615s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/webdriver https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 75.0.3770.142
[PASS] tests/integration/authorized/mobile/mobile.spec.js
[PASS] tests/integration/authorized/mobile/behavior.spec.js
[PASS] tests/integration/unauthorized/login.spec.js
[PASS] tests/integration/unauthorized/forgotPassword.spec.js
[PASS] tests/unit/model/Brief.spec.js
[PASS] tests/unit/view/components/base/Grid.spec.js
[PASS] tests/unit/view/main/MainViewModel.spec.js
[PASS] tests/unit/view/user/UserController.spec.js
79 passed, 0 failed assertions took 34.762s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/webdriver https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 75.0.3770.142
[PASS] tests/integration/authorized/mobile/mobile.spec.js
[PASS] tests/integration/authorized/mobile/behavior.spec.js
[PASS] tests/integration/unauthorized/login.spec.js
[PASS] tests/integration/unauthorized/forgotPassword.spec.js
[PASS] tests/unit/model/Brief.spec.js
[PASS] tests/unit/view/components/base/Grid.spec.js
[PASS] tests/unit/view/main/MainViewModel.spec.js
[PASS] tests/unit/view/user/UserController.spec.js
79 passed, 0 failed assertions took 33.08s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/webdriver https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 75.0.3770.142
[PASS] tests/integration/authorized/mobile/mobile.spec.js
[PASS] tests/integration/authorized/mobile/behavior.spec.js
[PASS] tests/integration/unauthorized/login.spec.js
[PASS] tests/integration/unauthorized/forgotPassword.spec.js
[PASS] tests/unit/model/Brief.spec.js
[PASS] tests/unit/view/components/base/Grid.spec.js
[PASS] tests/unit/view/main/MainViewModel.spec.js
[PASS] tests/unit/view/user/UserController.spec.js
79 passed, 0 failed assertions took 33.945s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/webdriver https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 75.0.3770.142
[PASS] tests/integration/authorized/mobile/mobile.spec.js
[PASS] tests/integration/authorized/mobile/behavior.spec.js
[PASS] tests/integration/unauthorized/login.spec.js
[PASS] tests/integration/unauthorized/forgotPassword.spec.js
[PASS] tests/unit/model/Brief.spec.js
[PASS] tests/unit/view/components/base/Grid.spec.js
[PASS] tests/unit/view/main/MainViewModel.spec.js
[PASS] tests/unit/view/user/UserController.spec.js
79 passed, 0 failed assertions took 33.96s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/webdriver https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 75.0.3770.142
[PASS] tests/integration/authorized/mobile/mobile.spec.js
[PASS] tests/integration/authorized/mobile/behavior.spec.js
[PASS] tests/integration/unauthorized/login.spec.js
[PASS] tests/integration/unauthorized/forgotPassword.spec.js
[PASS] tests/unit/model/Brief.spec.js
[PASS] tests/unit/view/components/base/Grid.spec.js
[PASS] tests/unit/view/main/MainViewModel.spec.js
[PASS] tests/unit/view/user/UserController.spec.js
79 passed, 0 failed assertions took 34.503s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/webdriver https://tools/siesta-ci.html --max-workers=10 --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 75.0.3770.142
[PASS] tests/integration/authorized/mobile/mobile.spec.js
[PASS] tests/integration/authorized/mobile/behavior.spec.js
[PASS] tests/integration/unauthorized/login.spec.js
[PASS] tests/integration/unauthorized/forgotPassword.spec.js
[PASS] tests/unit/model/Brief.spec.js
[PASS] tests/unit/view/components/base/Grid.spec.js
[PASS] tests/unit/view/main/MainViewModel.spec.js
[PASS] tests/unit/view/user/UserController.spec.js
79 passed, 0 failed assertions took 33.753s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/webdriver https://tools/siesta-ci.html --max-workers=10 --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 75.0.3770.142
[PASS] tests/integration/authorized/mobile/mobile.spec.js
[PASS] tests/integration/authorized/mobile/behavior.spec.js
[PASS] tests/integration/unauthorized/login.spec.js
[PASS] tests/integration/unauthorized/forgotPassword.spec.js
[PASS] tests/unit/model/Brief.spec.js
[PASS] tests/unit/view/components/base/Grid.spec.js
[PASS] tests/unit/view/main/MainViewModel.spec.js
[PASS] tests/unit/view/user/UserController.spec.js
79 passed, 0 failed assertions took 33.226s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/webdriver https://tools/siesta-ci.html --max-workers=10 --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 75.0.3770.142
[PASS] tests/integration/authorized/mobile/mobile.spec.js
[PASS] tests/integration/authorized/mobile/behavior.spec.js
[PASS] tests/integration/unauthorized/login.spec.js
[PASS] tests/integration/unauthorized/forgotPassword.spec.js
[PASS] tests/unit/model/Brief.spec.js
[PASS] tests/unit/view/components/base/Grid.spec.js
[PASS] tests/unit/view/main/MainViewModel.spec.js
[PASS] tests/unit/view/user/UserController.spec.js
79 passed, 0 failed assertions took 33.062s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/webdriver https://tools/siesta-ci.html --max-workers=10 --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 75.0.3770.142
[PASS] tests/integration/authorized/mobile/mobile.spec.js
[PASS] tests/integration/authorized/mobile/behavior.spec.js
[PASS] tests/integration/unauthorized/login.spec.js
[PASS] tests/integration/unauthorized/forgotPassword.spec.js
[PASS] tests/unit/model/Brief.spec.js
should automatically configure multiColumnSort
fail 1 - Subtest `should automatically configure multiColumnSort` threw an exception
Error: [Ext.create] Unrecognized class name / alias: Ext.data.Store
at line 1634, character 23, of https://tools/node_modules/@sencha/ext-core/src/class/ClassManager.js?_dc=1564997545040
at line 8, character 29, of https://tools/tests/unit/view/components/base/Grid.spec.js
at line 369, character 413, of https://tools/siesta/siesta-all.js
at line 1, character 347, of <anonymous>
at line 369, character 344, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 63, character 414, of https://tools/siesta/siesta-all.js
at line 52, character 45, of https://tools/siesta/siesta-all.js
at line 917, character 325, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
should automatically configure the `resetState` plugin
fail 1 - Chain step threw an exception
Error: [Ext.create] Unrecognized class name / alias: Tools.view.components.base.Grid
at line 1634, character 23, of https://tools/node_modules/@sencha/ext-core/src/class/ClassManager.js?_dc=1564997545040
at line 85, character 26, of https://tools/tests/unit/view/components/base/Grid.spec.js
at line 307, character 368, of https://tools/siesta/siesta-all.js
at line 1, character 347, of <anonymous>
at line 307, character 352, of https://tools/siesta/siesta-all.js
at line 218, character 53, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 217, character 35, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 216, character 132, of https://tools/siesta/siesta-all.js
containsPlugin
fail 1 - Subtest `containsPlugin` threw an exception
Error: [Ext.create] Unrecognized class name / alias: Tools.view.components.base.Grid
at line 1634, character 23, of https://tools/node_modules/@sencha/ext-core/src/class/ClassManager.js?_dc=1564997545040
at line 135, character 22, of https://tools/tests/unit/view/components/base/Grid.spec.js
at line 369, character 413, of https://tools/siesta/siesta-all.js
at line 1, character 347, of <anonymous>
at line 369, character 344, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 63, character 414, of https://tools/siesta/siesta-all.js
at line 52, character 45, of https://tools/siesta/siesta-all.js
at line 917, character 325, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
[FAIL] tests/unit/view/components/base/Grid.spec.js
[PASS] tests/unit/view/main/MainViewModel.spec.js
[PASS] tests/unit/view/user/UserController.spec.js
69 passed, 3 failed assertions took 32.293s to complete
=============================== Coverage summary ===============================
Statements : 21.85% ( 435/1991 )
Branches : 17.81% ( 122/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.16% ( 431/1945 )
================================================================================
>
> cross-env-shell siesta/bin/puppeteer https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 76.0.3803.0
[[32mPASS[39m] tests/integration/authorized/mobile/mobile.spec.js
[[32mPASS[39m] tests/unit/view/main/MainViewModel.spec.js
[[32mPASS[39m] tests/integration/unauthorized/forgotPassword.spec.js
[[32mPASS[39m] tests/unit/view/user/UserController.spec.js
[[32mPASS[39m] tests/integration/authorized/mobile/behavior.spec.js
[[32mPASS[39m] tests/unit/model/Brief.spec.js
[[32mPASS[39m] tests/unit/view/components/base/Grid.spec.js
[1m[31mfail 1 - Chain step threw an exception
TypeError: Cannot read property 'disabled' of undefined
at line 28, character 24, of https://tools/tests/integration/unauthorized/login.spec.js
at line 307, character 368, of https://tools/siesta/siesta-all.js
at line 1, character 347, of <anonymous>
at line 307, character 352, of https://tools/siesta/siesta-all.js
at line 218, character 53, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 217, character 35, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 218, character 30, of https://tools/siesta/siesta-all.js
at line 307, character 3, of https://tools/siesta/siesta-all.js[39m[22m
[[31mFAIL[39m] tests/integration/unauthorized/login.spec.js
67 passed, 1 failed assertions took 48.777s to complete
=============================== Coverage summary ===============================
Statements : 20.84% ( 415/1991 )
Branches : 17.37% ( 119/685 )
Functions : 16.48% ( 75/455 )
Lines : 21.13% ( 411/1945 )
================================================================================
>
> cross-env-shell siesta/bin/puppeteer https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 76.0.3803.0
[[32mPASS[39m] tests/integration/authorized/mobile/mobile.spec.js
[[32mPASS[39m] tests/integration/unauthorized/forgotPassword.spec.js
[[32mPASS[39m] tests/integration/authorized/mobile/behavior.spec.js
[[32mPASS[39m] tests/unit/model/Brief.spec.js
[[32mPASS[39m] tests/unit/view/components/base/Grid.spec.js
[[32mPASS[39m] tests/integration/unauthorized/login.spec.js
[31m[WARN] [39mInactivity timeout 180000ms has been exceeded
[[32mPASS[39m] tests/unit/view/main/MainViewModel.spec.js
[[32mPASS[39m] tests/unit/view/user/UserController.spec.js
82 passed, 0 failed assertions took 3m 18s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/puppeteer https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 76.0.3803.0
[[32mPASS[39m] tests/integration/authorized/mobile/mobile.spec.js
[[32mPASS[39m] tests/unit/view/main/MainViewModel.spec.js
[1misLoggedIn[22m
[1m[31mfail 1 - Subtest `isLoggedIn` threw an exception
ReferenceError: User is not defined
at line 9, character 10, of https://tools/tests/unit/view/user/UserController.spec.js
at line 369, character 413, of https://tools/siesta/siesta-all.js
at line 1, character 347, of <anonymous>
at line 369, character 344, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 63, character 414, of https://tools/siesta/siesta-all.js
at line 52, character 45, of https://tools/siesta/siesta-all.js
at line 917, character 325, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 914, character 366, of https://tools/siesta/siesta-all.js[39m[22m
[1mlogout[22m
[1m[31mfail 1 - Subtest `logout` threw an exception
ReferenceError: User is not defined
at line 27, character 5, of https://tools/tests/unit/view/user/UserController.spec.js
at line 369, character 413, of https://tools/siesta/siesta-all.js
at line 1, character 347, of <anonymous>
at line 369, character 344, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 63, character 414, of https://tools/siesta/siesta-all.js
at line 52, character 45, of https://tools/siesta/siesta-all.js
at line 917, character 325, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 914, character 366, of https://tools/siesta/siesta-all.js[39m[22m
[1misPasswordExpired[22m
[1m[31mfail 1 - Subtest `isPasswordExpired` threw an exception
ReferenceError: User is not defined
at line 42, character 22, of https://tools/tests/unit/view/user/UserController.spec.js
at line 369, character 413, of https://tools/siesta/siesta-all.js
at line 1, character 347, of <anonymous>
at line 369, character 344, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 63, character 414, of https://tools/siesta/siesta-all.js
at line 52, character 45, of https://tools/siesta/siesta-all.js
at line 917, character 325, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 914, character 366, of https://tools/siesta/siesta-all.js[39m[22m
[1misPasswordExpiredByDate[22m
[1m[31mfail 1 - Subtest `isPasswordExpiredByDate` threw an exception
ReferenceError: User is not defined
at line 60, character 22, of https://tools/tests/unit/view/user/UserController.spec.js
at line 369, character 413, of https://tools/siesta/siesta-all.js
at line 1, character 347, of <anonymous>
at line 369, character 344, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 63, character 414, of https://tools/siesta/siesta-all.js
at line 52, character 45, of https://tools/siesta/siesta-all.js
at line 917, character 325, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 914, character 366, of https://tools/siesta/siesta-all.js[39m[22m
[1mgetUser[22m
[1m[31mfail 1 - Subtest `getUser` threw an exception
ReferenceError: User is not defined
at line 84, character 20, of https://tools/tests/unit/view/user/UserController.spec.js
at line 369, character 413, of https://tools/siesta/siesta-all.js
at line 1, character 347, of <anonymous>
at line 369, character 344, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 63, character 414, of https://tools/siesta/siesta-all.js
at line 52, character 45, of https://tools/siesta/siesta-all.js
at line 917, character 325, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 914, character 366, of https://tools/siesta/siesta-all.js[39m[22m
[1mrequest[22m
[1m[31mfail 1 - Subtest `request` threw an exception
ReferenceError: User is not defined
at line 100, character 5, of https://tools/tests/unit/view/user/UserController.spec.js
at line 369, character 413, of https://tools/siesta/siesta-all.js
at line 1, character 347, of <anonymous>
at line 369, character 344, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 63, character 414, of https://tools/siesta/siesta-all.js
at line 52, character 45, of https://tools/siesta/siesta-all.js
at line 917, character 325, of https://tools/siesta/siesta-all.js
at line 65, character 357, of https://tools/siesta/siesta-all.js
at line 914, character 366, of https://tools/siesta/siesta-all.js[39m[22m
[[31mFAIL[39m] tests/unit/view/user/UserController.spec.js
[[32mPASS[39m] tests/integration/unauthorized/forgotPassword.spec.js
[[32mPASS[39m] tests/integration/authorized/mobile/behavior.spec.js
[[32mPASS[39m] tests/unit/model/Brief.spec.js
[[32mPASS[39m] tests/unit/view/components/base/Grid.spec.js
[[32mPASS[39m] tests/integration/unauthorized/login.spec.js
68 passed, 6 failed assertions took 45.377s to complete
=============================== Coverage summary ===============================
Statements : 21.5% ( 428/1991 )
Branches : 18.54% ( 127/685 )
Functions : 17.14% ( 78/455 )
Lines : 21.8% ( 424/1945 )
================================================================================
>
> cross-env-shell siesta/bin/puppeteer https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 76.0.3803.0
[[32mPASS[39m] tests/integration/authorized/mobile/mobile.spec.js
[[32mPASS[39m] tests/unit/view/main/MainViewModel.spec.js
[[32mPASS[39m] tests/integration/unauthorized/forgotPassword.spec.js
[[32mPASS[39m] tests/unit/view/user/UserController.spec.js
[[32mPASS[39m] tests/integration/authorized/mobile/behavior.spec.js
[[32mPASS[39m] tests/unit/model/Brief.spec.js
[[32mPASS[39m] tests/unit/view/components/base/Grid.spec.js
[[32mPASS[39m] tests/integration/unauthorized/login.spec.js
82 passed, 0 failed assertions took 50.984s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/puppeteer https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 76.0.3803.0
[[32mPASS[39m] tests/integration/authorized/mobile/mobile.spec.js
[[32mPASS[39m] tests/unit/view/main/MainViewModel.spec.js
[[32mPASS[39m] tests/integration/unauthorized/forgotPassword.spec.js
[[32mPASS[39m] tests/unit/view/user/UserController.spec.js
[[32mPASS[39m] tests/integration/authorized/mobile/behavior.spec.js
[[32mPASS[39m] tests/unit/model/Brief.spec.js
[[32mPASS[39m] tests/unit/view/components/base/Grid.spec.js
[[32mPASS[39m] tests/integration/unauthorized/login.spec.js
82 passed, 0 failed assertions took 51.123s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/puppeteer https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 76.0.3803.0
[[32mPASS[39m] tests/integration/authorized/mobile/mobile.spec.js
[[32mPASS[39m] tests/integration/authorized/mobile/behavior.spec.js
[[32mPASS[39m] tests/integration/unauthorized/login.spec.js
[31m[WARN] [39mInactivity timeout 180000ms has been exceeded
[31m[WARN] [39mInactivity timeout 180000ms has been exceeded
[[32mPASS[39m] tests/unit/view/main/MainViewModel.spec.js
[[32mPASS[39m] tests/integration/unauthorized/forgotPassword.spec.js
[[32mPASS[39m] tests/unit/view/user/UserController.spec.js
[[32mPASS[39m] tests/unit/model/Brief.spec.js
[[32mPASS[39m] tests/unit/view/components/base/Grid.spec.js
82 passed, 0 failed assertions took 3m 34s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/puppeteer https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 76.0.3803.0
[[32mPASS[39m] tests/unit/view/main/MainViewModel.spec.js
[[32mPASS[39m] tests/integration/authorized/mobile/mobile.spec.js
[[32mPASS[39m] tests/unit/view/user/UserController.spec.js
[[32mPASS[39m] tests/integration/authorized/mobile/behavior.spec.js
[[32mPASS[39m] tests/integration/unauthorized/login.spec.js
[31m[WARN] [39mInactivity timeout 180000ms has been exceeded
[[32mPASS[39m] tests/integration/unauthorized/forgotPassword.spec.js
[[32mPASS[39m] tests/unit/model/Brief.spec.js
[[32mPASS[39m] tests/unit/view/components/base/Grid.spec.js
82 passed, 0 failed assertions took 3m 27s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================
>
> cross-env-shell siesta/bin/puppeteer https://tools/siesta-ci.html --headless --nyc.include=**/app/**/*.js --nyc.reporter=html --nyc.reporter=text-summary --report-format JUnit --report-file ../reports/junit/report-frontend.xml
[31m[WARN] [39mUnrecognized coverage report format: text-summary
Launching test suite, OS: Windows, agent: Chrome 76.0.3803.0
[[32mPASS[39m] tests/integration/authorized/mobile/mobile.spec.js
[[32mPASS[39m] tests/unit/view/main/MainViewModel.spec.js
[[32mPASS[39m] tests/integration/unauthorized/forgotPassword.spec.js
[[32mPASS[39m] tests/unit/view/user/UserController.spec.js
[[32mPASS[39m] tests/integration/authorized/mobile/behavior.spec.js
[[32mPASS[39m] tests/unit/model/Brief.spec.js
[[32mPASS[39m] tests/unit/view/components/base/Grid.spec.js
[[32mPASS[39m] tests/integration/unauthorized/login.spec.js
82 passed, 0 failed assertions took 51.523s to complete
=============================== Coverage summary ===============================
Statements : 22% ( 438/1991 )
Branches : 18.54% ( 127/685 )
Functions : 18.02% ( 82/455 )
Lines : 22.31% ( 434/1945 )
================================================================================