llm_pipeline_static: flush streamer after generation loop is complete #5380
| Job | Run time |
|---|---|
| 30m 22s | |
| 15m 52s | |
| 15m 8s | |
| 15m 33s | |
| 16m 6s | |
| 10m 15s | |
| 33m 45s | |
| 12m 21s | |
| 14m 5s | |
| 13m 40s | |
| 21m 29s | |
| 11m 55s | |
| 14m 49s | |
| 25m 48s | |
| 8m 16s | |
| 23m 44s | |
| 7m 13s | |
| 13m 48s | |
| 15m 5s | |
| 36m 14s | |
| 1s | |
| 5h 55m 29s |