Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

restraint-client barfs raw data and disconnects #204

Open
wizardofoz123 opened this issue Mar 30, 2021 · 2 comments
Open

restraint-client barfs raw data and disconnects #204

wizardofoz123 opened this issue Mar 30, 2021 · 2 comments

Comments

@wizardofoz123
Copy link
Contributor

Sometimes when LWD (WARN Score: 0 . /10_localwatchdog) is hit, restraint-client barfs raw input:

[gigabyte-r120-18.khw] {"headers":{"Host":"localhost:33657","Content-Range":"bytes 1835008-1966079\/3359984","Content-Type":"text\/plain","Accept-Encoding":"gzip, deflate","Connection":"Keep-Alive","Content-Length":"131072","rstrnt-path":"\/recipes\/9781759\/tasks\/17\/logs\/journalctl","rstrnt-method":"PUT","body-length":131072},"body":"bmcuYm9zLnJlZGhhdC

<...>more raw data

1hciAyOSAxNzclient_loop: send disconnect: Broken pipe

Afterwards the system reboots and after a few connection retries, execution of tests continues.

@wizardofoz123
Copy link
Contributor Author

Found out a reproducer by accident:

  1. clone CKI (UPT pipeline) job
  2. start running tests in restraint standalone (e.g. sleep 3600, see example xml below)
  3. run rstrnt-adjust-watchdog -s http://localhost:${{PORT}}/recipes/{recipe_id}/watchdog 1 with correct PORT and recipe_id substituted; PORT is the port of restraintd runner instance (not Beaker restraint)
  4. the task will complete with WARN
  5. restraint barfs raw data

Example restraint xml to used:

<?xml version="1.0" encoding="utf-8"?>
            <job>
             <recipeSet>
              <recipe id="1234" job_id="5678">
                <task name="/distribution/command" role="STANDALONE">
                 <fetch url="https://github.com/beaker-project/beaker-core-tasks/archive/master.tar.gz#command"/>
                 <params>
                  <param name="TESTARGS" value="sleep 3600"/>
                 </params>
                </task>
               </recipe>
             </recipeSet>
            </job>

@idorax
Copy link

idorax commented Jan 16, 2023

  1. start running tests in restraint standalone (e.g. sleep 3600, see example xml below)

Hi @wizardofoz123, is there a constraint command line to reproduce this problem? I'll have a try to reproduce it then fix it, thanks!

  1. run rstrnt-adjust-watchdog -s http://localhost:${{PORT}}/recipes/{recipe_id}/watchdog 1 with correct PORT and recipe_id substituted; PORT is the port of restraintd runner instance (not Beaker restraint)

It should be rstrnt-adjust-watchdog -s http://localhost:${PORT}/recipes/${recipe_id}/watchdog 1, right?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants