Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FEAT: online anomaly detection #546

Open
wants to merge 52 commits into
base: main
Choose a base branch
from
Open

Conversation

marcopeix
Copy link
Contributor

Add new method for real-time anomaly detection

Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

Copy link
Contributor

github-actions bot commented Nov 26, 2024

Experiment Results

Experiment 1: air-passengers

Description:

variable experiment
h 12
season_length 12
freq MS
level None
n_windows 1

Results:

metric timegpt-1 timegpt-1-long-horizon SeasonalNaive Naive
mae 12.6793 11.0623 47.8333 76
mape 0.027 0.0232 0.0999 0.1425
mse 213.936 199.132 2571.33 10604.2
total_time 0.7556 0.3949 0.0046 0.0034

Plot:

Experiment 2: air-passengers

Description:

variable experiment
h 24
season_length 12
freq MS
level None
n_windows 1

Results:

metric timegpt-1 timegpt-1-long-horizon SeasonalNaive Naive
mae 58.1031 58.4587 71.25 115.25
mape 0.1257 0.1267 0.1552 0.2358
mse 4040.21 4110.79 5928.17 18859.2
total_time 1.6889 0.7182 0.0043 0.0037

Plot:

Experiment 3: electricity-multiple-series

Description:

variable experiment
h 24
season_length 24
freq H
level None
n_windows 1

Results:

metric timegpt-1 timegpt-1-long-horizon SeasonalNaive Naive
mae 178.293 268.13 269.23 1331.02
mape 0.0234 0.0311 0.0304 0.1692
mse 121589 219485 213677 4.68961e+06
total_time 1.0595 0.9062 0.0055 0.0056

Plot:

Experiment 4: electricity-multiple-series

Description:

variable experiment
h 168
season_length 24
freq H
level None
n_windows 1

Results:

metric timegpt-1 timegpt-1-long-horizon SeasonalNaive Naive
mae 465.497 346.972 398.956 1119.26
mape 0.062 0.0436 0.0512 0.1583
mse 835021 403760 656723 3.17316e+06
total_time 0.9549 0.9017 0.0087 0.0072

Plot:

Experiment 5: electricity-multiple-series

Description:

variable experiment
h 336
season_length 24
freq H
level None
n_windows 1

Results:

metric timegpt-1 timegpt-1-long-horizon SeasonalNaive Naive
mae 558.673 459.757 602.926 1340.95
mape 0.0697 0.0565 0.0787 0.17
mse 1.22723e+06 739114 1.61572e+06 6.04619e+06
total_time 0.7953 1.0757 0.0065 0.0069

Plot:

Copy link
Member

@jmoralez jmoralez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The endpoint is called online anomaly detection, so we should probably name the method the same, e.g. detect_anomalies_online or online_anomaly_detection

nixtla/nixtla_client.py Outdated Show resolved Hide resolved
nixtla/nixtla_client.py Show resolved Hide resolved
nixtla/nixtla_client.py Outdated Show resolved Hide resolved
nixtla/nixtla_client.py Outdated Show resolved Hide resolved
nixtla/nixtla_client.py Outdated Show resolved Hide resolved
nixtla/nixtla_client.py Outdated Show resolved Hide resolved
nixtla/nixtla_client.py Outdated Show resolved Hide resolved
nixtla/nixtla_client.py Outdated Show resolved Hide resolved
nixtla/nixtla_client.py Show resolved Hide resolved
@marcopeix marcopeix requested a review from jmoralez December 17, 2024 19:46
Copy link
Member

@jmoralez jmoralez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice! Just some minor comments, apart from that the implementation looks ok, I didn't look at the docs.

nixtla/nixtla_client.py Outdated Show resolved Hide resolved
nixtla/nixtla_client.py Outdated Show resolved Hide resolved
nixtla/nixtla_client.py Outdated Show resolved Hide resolved
@jmoralez jmoralez changed the title FEAT: real-time anomaly detection FEAT: online anomaly detection Dec 19, 2024
@marcopeix marcopeix requested a review from cchallu December 20, 2024 18:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants