Plugin reports Test Passed if before hook fails

[igerasimov23]

The problem

If test fails in Before hook plugin reports to RP as test passed

Environment

• WebdriverIO version: 4.11
• wdio-reportportal-version version: 0.0.15
• Node.js version: 8.10
• WDIO Testrunner and version(mocha\cucumber\jasmine):
• Additional wdio packages used (if applicable):

Code To Reproduce Issue [ Good To Have ]

describe('test', function () {

  before( function () {
    browser.url('some url');
    assert.isTrue(false, 'test failed')
  })
  
  it('Verify test 1', () => {
    browser.url('some url');
    assert.isTrue(true, 'test passed')
  })
});

[BorisOsipov]

Hi @igerasimov23,

I think there is no tests were reported if hook failed.
Do you mean suite reported as passed? In fact it always reported as passed

[igerasimov23]

you right there are no tests reported if Before hook fails. Is there way to fail suite if before hook fails?

As I looked at API of reportportal we can fail suite as well

[BorisOsipov]

Is there way to fail suite if before hook fails?
As I looked at API of reportportal we can fail suite as well

yes, I will see

[BorisOsipov]

Fixed in 0.0.16

[igerasimov23]

I tested v 0.0.16 and have one question, you don't want to send failure message to suite? API supports it and your plugin can easily do it. Now it seems a little bit odd in RP logs: it has all logs of execution of before hook but not actual failure message. Any thoughts?

[BorisOsipov]

you don't want to send failure message to suite? API supports it and your plugin can easily do it.

I would like, but it is not easy. I will see more.

[BorisOsipov]

@igerasimov23 I've checked this. The problems is wdio reporters by design doesn't report before\after hooks as I now(let me know If you meet reporters that support it). So I don't have access in reporter to error stack trace from before hook.

I will go deeper and try to find some ways to handle this case.