Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] 历史日志有时无法查看 #94

Open
1 of 2 tasks
dafei1288 opened this issue Aug 8, 2023 · 4 comments
Open
1 of 2 tasks

[Bug] 历史日志有时无法查看 #94

dafei1288 opened this issue Aug 8, 2023 · 4 comments
Labels
bug Something isn't working

Comments

@dafei1288
Copy link

Search before asking

  • I searched the issues and found no similar issues.

Streamis Component

streamis-server

What happened + What you expected to happen

  1. 执行任务
  2. 当时任务可以查看日志
  3. 经过一点时间,有可能无法查看历史任务日志

Relevent platform

linux

Reproduction script

create table kafka_source_car_speed_info (
carLicense string,
areaId string,
roadId string,
monitorId string,
cameraId string,
actionTime bigint,
speed float,
rt AS TO_TIMESTAMP(FROM_UNIXTIME( actionTime / 1000 , 'yyyy-MM-dd HH:mm:ss')), -- 定义事件时间
WATERMARK FOR rt AS rt - INTERVAL '5' SECOND
) with (
'connector' = 'kafka',
'properties.bootstrap.servers' = 'localhost:19092',
'topic' = 'ttt1',
'format' = 'json'
)

SELECT
CONCAT(areaId,'',roadId,'',monitorId) ckey,
COUNT(1) cars,
SUM(speed) sumed,
SUM(speed) / COUNT(1) ,
TUMBLE_START(rt, INTERVAL '30' SECOND ) ,
TUMBLE_END(rt, INTERVAL '30' SECOND)
FROM kafka_source_car_speed_info
GROUP BY CONCAT(areaId,'',roadId,'',monitorId) , TUMBLE(rt, INTERVAL '30' SECOND)

SELECT
CONCAT(areaId,'',roadId,'',monitorId) ckey,
COUNT(1) cars,
SUM(speed) sumed,
SUM(speed) / COUNT(1) ,
HOP_START(rt, interval '30' second , interval '1' minute ) ,
HOP_END(rt, interval '30' second , interval '1' minute)
FROM kafka_source_car_speed_info
GROUP BY CONCAT(areaId,'',roadId,'',monitorId) , HOP(rt, interval '30' second , interval '1' minute)

Anything else

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!
@dafei1288 dafei1288 added the bug Something isn't working label Aug 8, 2023
@Alexkun
Copy link
Collaborator

Alexkun commented Aug 11, 2023

任务日志还是yarn日志无法查看,streamis linkis版本是多少

@dafei1288
Copy link
Author

是任务日志,streamis 版本0.2.0 , linkis 1.3.2

@Alexkun
Copy link
Collaborator

Alexkun commented Aug 15, 2023

linkis 1.3.2有个bug会导致无法获取到本地ec日志,在1.4.0已经修复了哈

@dafei1288
Copy link
Author

请问 apache/linkis#4686 是这个fix的么?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants