Get help with testing, discuss unit testing strategies etc.


Post by steve.schreiner »

We are trying to run tests via jenkins and slimerjs but are getting errors. Is it possible to update to the latest slimerjs as has the --ignore-ssl-errors option but the one included in siesta 4.1.2 does not?
10:51:50 Started by user pavlo.chubatyy
10:51:50 [EnvInject] - Loading node environment variables.
10:51:50 [EnvInject] - Preparing an environment for the build.
10:51:50 [EnvInject] - Keeping Jenkins system variables.
10:51:50 [EnvInject] - Keeping Jenkins build variables.
10:51:50 [EnvInject] - Executing and processing the following script content: 
10:51:50 export SLIMERJSLAUNCHER=`which firefox`
10:51:50 
10:51:50 [/jenkins] $ /bin/bash -xe /tmp/hudson3014766279494713080.sh
10:51:50 ++ which firefox
10:51:50 + export SLIMERJSLAUNCHER=/usr/bin/firefox
10:51:50 + SLIMERJSLAUNCHER=/usr/bin/firefox
10:51:50 [EnvInject] - Script executed successfully.
10:51:50 [EnvInject] - Injecting contributions.
10:51:51 Fetching changes from the remote Git repository
10:51:52 Checking out Revision e4717679dc90644dd3250937577339ea1bbbb2b7 (refs/remotes/origin/master)
10:51:52  > git config core.sparsecheckout # timeout=10
10:51:52  > git checkout -f e4717679dc90644dd3250937577339ea1bbbb2b7
10:51:52  > git rev-list e4717679dc90644dd3250937577339ea1bbbb2b7 # timeout=10
10:51:52 Xvfb starting$ /usr/bin//Xvfb -displayfd 2 -screen 0 1024x768x24 -fbdir /jenkins/xvfb-2016-08-25_10-51-50-7401333302477140739.fbdir
10:52:02 [siesta-tests-pavlo] $ /bin/bash -xe /tmp/hudson8013204187408053414.sh
10:52:02 + echo 'Browser: '
10:52:02 Browser: 
10:52:02 + ui-lib/siesta-4.1.2/bin/slimerjs 'https://10.10.26.56/siesta-tests.html?test=' --report-format=JUnit --report-file=siesta-results.xml --jenkins --verbose --debug --ignore-ssl-errors
10:52:02 
10:52:02 (process:29291): GLib-CRITICAL **: g_slice_set_config: assertion 'sys_page_size == 0' failed
10:52:02 Xlib:  extension "RANDR" missing on display ":99".
10:52:03 JavaScript strict warning: resource://gre/modules/GMPUtils.jsm, line 92: ReferenceError: reference to undefined property this.KEY_LOG_BASE
10:52:03 JavaScript warning: resource://slimerjs/slUtils.jsm, line 155: JavaScript 1.7's let blocks are deprecated
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: coffee-scripts.js, line 8: ReferenceError: reference to undefined property require[a]
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 1503: TypeError: variable scope redeclares argument
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 1513: TypeError: variable scope redeclares argument
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 7119: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 7191: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 7196: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 7201: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 7211: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 7216: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 7221: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 8186: SyntaxError: octal literals and octal escape sequences are deprecated
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 8186: SyntaxError: octal literals and octal escape sequences are deprecated
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 9829: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 9849: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 12804: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 12910: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 12925: SyntaxError: test for equality (==) mistyped as assignment (=)?
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 1023: ReferenceError: reference to undefined property this.properties[name]
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 2515: ReferenceError: reference to undefined property props.init
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 3832: ReferenceError: assignment to undeclared variable use
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 5299: ReferenceError: reference to undefined property from[propName]
10:52:03 JavaScript strict warning: file:///jenkins/workspace/siesta-tests-pavlo/ui-lib/siesta-4.1.2/bin/siesta-launcher-all.js, line 5988: ReferenceError: assignment to undeclared variable TRY
10:52:03 [WARN] Unknown option provided: ignore-ssl-errors
10:52:03 [DEBUG] Dispatcher start
10:52:03 [DEBUG] Runner setup: a Siesta.Launcher.Runner.SlimerJS
10:52:03 [DEBUG] Dispatcher setup starting
10:52:03 [DEBUG] Close page PhantomJS
10:52:03 [DEBUG] Page close started: 1
10:52:03 [ERROR] Setup failed: Error: Error while opening harness page: Can't open page: https://10.10.26.56/siesta-tests.html?test=&phantom=true
10:52:03 [DEBUG] Recevied results for all tests in the suite, proceeding to finalization
10:52:04 Xvfb stopping
10:52:05 Notifying upstream projects of job completion
10:52:05 Finished: SUCCESS

Post by nickolay »

Ok, we'll do that in the next release, ticket created: https://app.assembla.com/spaces/bryntum ... on/details#

Note though, that latest versions of SlimerJS are not standalone (do not include XULRunner, as it has been deprecated by Mozilla) and require the presence of installed FireFox in the system.

Post by steve.schreiner »

Thanks. How soon until the next release? We are blocked by this.

Post by nickolay »

Early next week I think.

Post by pavlo.chubatyy »

What's the recommended way to ignore the ssl errors?

Currently I've found that manual that involves running the firefox and adding the exception for the certificate. It doesn't fit for us as the jenkins slave is headless (no X server is installed there) and I will not be able to add that certificate exception manually on the machine.

Post by nickolay »

Is there a command line switch for Firefox that will ignore such errors?

Post by nickolay »

Btw, according to https://docs.slimerjs.org/current/configuration.html the latest (0.10.0) SlimerJS still does not support "--ignore-ssl-errors" (which comes from PhantomJS), are you sure upgrading to the latest will fix your issue?

Check also this pages:
https://darrendev.blogspot.ru/2013/10/sl ... -self.html
https://github.com/laurentj/slimerjs/issues/26

One more way to go would be to install Chrome on target machine and launch it using "xfvb". Chrome supports "--ignore-ssl-errors" command line option IIRC.

Post Reply