Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regular HTTP Bans #1182

Open
Rand-Random opened this issue Oct 10, 2024 · 8 comments
Open

Regular HTTP Bans #1182

Rand-Random opened this issue Oct 10, 2024 · 8 comments

Comments

@Rand-Random
Copy link

Basically running into a ban almost immediatly after a ban is lifted, and this over and over again.
I have no clue what shoko is actually currently doing at all, it seems trying to fetch rather random series.

Shoko seems to queue more series to update, than it is able to fetch, already tried to cleared the queue only for a new file of the current season to again trigger this update cycle.

Current queue is:

Get AniDB Anime Data
  Anime: Ranma 1/2: Chuugoku Nekonron Daikessen! Okite Yaburi no Gekitou Hen!!
  Anime: Ranma 1/2: Kessen Tougenkyou! Hanayome o Torimodose!!
  Anime: Ranma 1/2: Akumu! Shunmin Kou
  Anime: Ranma 1/2: Nettou Uta Gassen
  Anime: Inuyasha
  Anime: Urusei Yatsura
  Anime: Party kara Tsuihou Sareta Sono Chiyushi, Jitsu wa Saikyou ni Tsuki
  Anime: Hoshi Furu Oukoku no Nina
  Anime: Seirei Gensouki 2
  Anime: Houkago Shounen Hanako-kun (2024)
  Anime: Natsume Yuujinchou Shichi
  Anime: Kamierabi (2024)
  Anime: Futoku no Guild
  Anime: Shin Tennis no Ouji-sama: U-17 World Cup Semifinal
  Anime: The Peak of True Martial Arts 3rd Season
  Anime: Chi. Chikyuu no Undou ni Tsuite
  Anime: Arifureta Shokugyou de Sekai Saikyou Season 3
  Anime: Kidou Senshi Gundam: Fukushuu no Requiem
  Anime: Chi. Chikyuu no Undou ni Tsuite
  Anime: Ooi! Tonbo (2024)
  Anime: Touhai: Ura Rate Mahjong Touhai Roku
  Anime: Kimi wa Meido-sama.
  Anime: Punirunes: Puni 2
  Anime: Youkai Gakkou no Sensei Hajimemashita!
  Anime: Trillion Game
  Anime: Ranma 1/2 (2024)
  Anime: Shounen ga Otona ni Natta Natsu
  Anime: Shinkansen Henkei Robo Shinkalion: Change the World
  Anime: Dungeon ni Deai o Motomeru no wa Machigatte Iru Darouka: Familia Myth V
  Anime: Kinoko Inu
  Anime: NegaPosi Angler
  Anime: Hitoribocchi no Isekai Kouryaku
  Anime: Kekkon Surutte, Hontou Desuka
  Anime: Ao no Hako
  Anime: Dan Da Dan
  Anime: Tono to Inu
  Anime: Mecha-ude (2024)
  Anime: Sayounara Ryuusei, Konnichiwa Jinsei

No idea why it tries to update eg. "Inuyasha" or "Shin Tennis no Ouji-sama: U-17 World Cup Semifinal."
Didn't recently add anything to Inuyasha, why is it fetching data?
And the series "Shin Tennis no Ouji-sama: U-17 World Cup Semifinal" never heard about it and I don't have it in my library, so why?

As I said, I already once cleared the queue, but it again filled up, so I currently don't know what to do?

20:17 (8:17 pm) ban was lifted, 20:21 (8:21 pm) again banned.
Full log: log.txt

[2024-10-10 20:17:30:512] Info|Shoko.Server.Providers.AniDB.HTTP.AniDBHttpConnectionHandler > AniDB HTTP ban (12h) is over

[had to move the log into a attached file because it exceeded the limit of 65536 characters an github post can have)

[2024-10-10 20:21:49:286] Info|GetAniDBAnimeJob_AnimeID:405_ForceRefresh:true_DownloadRelations:true_RelDepth:3 > Processing GetAniDBAnimeJob: 405
[2024-10-10 20:21:51:203] Warn|Shoko.Server.Providers.AniDB.HTTP.AniDBHttpConnectionHandler > AniDB HTTP Banned!
[2024-10-10 20:21:51:203] Error|Quartz.Core.JobRunShell > Job AniDB.GetAniDBAnimeJob_AnimeID:405_ForceRefresh:true_DownloadRelations:true_RelDepth:3 threw a JobExecutionException: : Parameters: refire = False, unscheduleFiringT
rigger = False, unscheduleAllTriggers = False 
 Quartz.JobExecutionException: One or more errors occurred. (Exception of type 'Shoko.Server.Providers.AniDB.AniDBBannedException' was thrown.)
 ---> System.AggregateException: One or more errors occurred. (Exception of type 'Shoko.Server.Providers.AniDB.AniDBBannedException' was thrown.)
 ---> Shoko.Server.Providers.AniDB.AniDBBannedException: Exception of type 'Shoko.Server.Providers.AniDB.AniDBBannedException' was thrown.
   at Shoko.Server.Providers.AniDB.HTTP.AniDBHttpConnectionHandler.<>c__DisplayClass11_0.<<GetHttpDirectly>b__0>d.MoveNext() in D:\a\ShokoServer\ShokoServer\Shoko.Server\Providers\AniDB\HTTP\AniDBHttpConnectionHandler.cs:line 64
--- End of stack trace from previous location ---
   at Shoko.Server.Providers.AniDB.HTTP.AniDBHttpConnectionHandler.GetHttpDirectly(String url) in D:\a\ShokoServer\ShokoServer\Shoko.Server\Providers\AniDB\HTTP\AniDBHttpConnectionHandler.cs:line 55
   at Shoko.Server.Providers.AniDB.HTTP.AniDBHttpConnectionHandler.GetHttp(String url) in D:\a\ShokoServer\ShokoServer\Shoko.Server\Providers\AniDB\HTTP\AniDBHttpConnectionHandler.cs:line 40
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at Shoko.Server.Scheduling.Jobs.AniDB.GetAniDBAnimeJob.GetResponse(SVR_AniDB_Anime anime)
   at Shoko.Server.Scheduling.Jobs.AniDB.GetAniDBAnimeJob.Process() in D:\a\ShokoServer\ShokoServer\Shoko.Server\Scheduling\Jobs\AniDB\GetAniDBAnimeJob.cs:line 102
   at Shoko.Server.Scheduling.Jobs.BaseJob.Execute(IJobExecutionContext context) in D:\a\ShokoServer\ShokoServer\Shoko.Server\Scheduling\Jobs\BaseJob.cs:line 33
   --- End of inner exception stack trace ---
   at Shoko.Server.Scheduling.Jobs.BaseJob.Execute(IJobExecutionContext context) in D:\a\ShokoServer\ShokoServer\Shoko.Server\Scheduling\Jobs\BaseJob.cs:line 50
   at Quartz.Core.JobRunShell.Run(CancellationToken cancellationToken) [See nested exception: System.AggregateException: One or more errors occurred. (Exception of type 'Shoko.Server.Providers.AniDB.AniDBBannedException' was thrown.)
 ---> Shoko.Server.Providers.AniDB.AniDBBannedException: Exception of type 'Shoko.Server.Providers.AniDB.AniDBBannedException' was thrown.
   at Shoko.Server.Providers.AniDB.HTTP.AniDBHttpConnectionHandler.<>c__DisplayClass11_0.<<GetHttpDirectly>b__0>d.MoveNext() in D:\a\ShokoServer\ShokoServer\Shoko.Server\Providers\AniDB\HTTP\AniDBHttpConnectionHandler.cs:line 64
--- End of stack trace from previous location ---
   at Shoko.Server.Providers.AniDB.HTTP.AniDBHttpConnectionHandler.GetHttpDirectly(String url) in D:\a\ShokoServer\ShokoServer\Shoko.Server\Providers\AniDB\HTTP\AniDBHttpConnectionHandler.cs:line 55
   at Shoko.Server.Providers.AniDB.HTTP.AniDBHttpConnectionHandler.GetHttp(String url) in D:\a\ShokoServer\ShokoServer\Shoko.Server\Providers\AniDB\HTTP\AniDBHttpConnectionHandler.cs:line 40
   --- End of inner exception stack trace ---
   at System.Threading.Tasks.Task.ThrowIfExceptional(Boolean includeTaskCanceledExceptions)
   at System.Threading.Tasks.Task`1.GetResultCore(Boolean waitCompletionNotification)
   at Shoko.Server.Scheduling.Jobs.AniDB.GetAniDBAnimeJob.GetResponse(SVR_AniDB_Anime anime)
   at Shoko.Server.Scheduling.Jobs.AniDB.GetAniDBAnimeJob.Process() in D:\a\ShokoServer\ShokoServer\Shoko.Server\Scheduling\Jobs\AniDB\GetAniDBAnimeJob.cs:line 102
   at Shoko.Server.Scheduling.Jobs.BaseJob.Execute(IJobExecutionContext context) in D:\a\ShokoServer\ShokoServer\Shoko.Server\Scheduling\Jobs\BaseJob.cs:line 33]
@Rand-Random
Copy link
Author

Rand-Random commented Oct 10, 2024

As I said

And the series "Shin Tennis no Ouji-sama: U-17 World Cup Semifinal" never heard about it and I don't have it in my library, so why (does it try to update the series)?

So I went and looked into my logs to find the series "Shin Tennis no..." and found the following log.
GetAniDBCalendarJob seems to add it to my queue, if I am reading the logs correctly? why?

[2024-10-10 06:44:45:591] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Checking LAN Connectivity…
[2024-10-10 06:44:45:622] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Found a local gateway to use
[2024-10-10 06:44:45:622] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Checking WAN Connectivity…
[2024-10-10 06:44:45:622] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Successfully connected to 3/4 internet service endpoints
[2024-10-10 07:09:48:833] Info|GetAniDBCalendarJob > Processing GetAniDBCalendarJob
[2024-10-10 07:14:44:181] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Checking LAN Connectivity…
[2024-10-10 07:14:44:212] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Found a local gateway to use
[2024-10-10 07:14:44:212] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Checking WAN Connectivity…
[2024-10-10 07:14:44:212] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Successfully connected to 3/4 internet service endpoints
[2024-10-10 07:14:48:831] Info|GetUpdatedAniDBAnimeJob_ForceRefresh:true > Processing GetUpdatedAniDBAnimeJob
[2024-10-10 07:14:48:831] Info|GetUpdatedAniDBAnimeJob_ForceRefresh:true > 12:08:34.8323973 since last UPDATED command
[2024-10-10 07:14:48:917] Info|GetUpdatedAniDBAnimeJob_ForceRefresh:true > Scheduling update for anime: Kamierabi (2024) (18334)
[2024-10-10 07:14:48:953] Info|GetUpdatedAniDBAnimeJob_ForceRefresh:true > Scheduling update for anime: Futoku no Guild (17244)
[2024-10-10 07:14:48:987] Info|GetUpdatedAniDBAnimeJob_ForceRefresh:true > Scheduling update for anime: Shin Tennis no Ouji-sama: U-17 World Cup Semifinal (18054)
[2024-10-10 07:14:49:209] Info|GetUpdatedAniDBAnimeJob_ForceRefresh:true > Scheduling update for anime: Zhen Wu Dianfeng 3rd Season (18342)
[2024-10-10 07:14:49:225] Info|GetUpdatedAniDBAnimeJob_ForceRefresh:true > Scheduling update for anime: Chi. Chikyuu no Undou ni Tsuite (17480)
[2024-10-10 07:14:49:258] Info|GetUpdatedAniDBAnimeJob_ForceRefresh:true > Updating 5 anime records, and 3 group status records
[2024-10-10 07:14:49:303] Info|GetAniDBReleaseGroupStatusJob_AnimeID:18334_ForceRefresh:true > Processing GetAniDBReleaseGroupJob: 18334
[2024-10-10 07:14:50:990] Info|RefreshAnimeStatsJob_AnimeID:18334 > Processing RefreshAnimeStatsJob for Kamierabi (2024)
[2024-10-10 07:14:50:998] Info|Shoko.Server.Services.AnimeSeriesService > Starting Updating STATS for SERIES Kamierabi (2024) - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:51:006] Info|Shoko.Server.Services.AnimeSeriesService > Finished updating stats for SERIES Kamierabi (2024) in 8.3715ms
[2024-10-10 07:14:51:006] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Kamierabi from Top Level (recursively) - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:51:006] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Kamierabi - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:51:085] Info|RefreshAnimeStatsJob_AnimeID:18334 > Processing RefreshAnimeStatsJob for Kamierabi (2024)
[2024-10-10 07:14:51:100] Info|Shoko.Server.Services.AnimeSeriesService > Starting Updating STATS for SERIES Kamierabi (2024) - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:51:100] Info|Shoko.Server.Services.AnimeSeriesService > Finished updating stats for SERIES Kamierabi (2024) in 7.3267ms
[2024-10-10 07:14:51:100] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Kamierabi from Top Level (recursively) - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:51:100] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Kamierabi - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:51:239] Info|GetAniDBReleaseGroupStatusJob_AnimeID:17244_ForceRefresh:true > Processing GetAniDBReleaseGroupJob: 17244
[2024-10-10 07:14:53:023] Info|RefreshAnimeStatsJob_AnimeID:17244 > Processing RefreshAnimeStatsJob for Futoku no Guild
[2024-10-10 07:14:53:023] Info|Shoko.Server.Services.AnimeSeriesService > Starting Updating STATS for SERIES Futoku no Guild - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:53:040] Info|Shoko.Server.Services.AnimeSeriesService > Finished updating stats for SERIES Futoku no Guild in 7.8986ms
[2024-10-10 07:14:53:040] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Futoku no Guild from Top Level (recursively) - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:53:040] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Futoku no Guild - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:53:101] Info|RefreshAnimeStatsJob_AnimeID:17244 > Processing RefreshAnimeStatsJob for Futoku no Guild
[2024-10-10 07:14:53:116] Info|Shoko.Server.Services.AnimeSeriesService > Starting Updating STATS for SERIES Futoku no Guild - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:53:116] Info|Shoko.Server.Services.AnimeSeriesService > Finished updating stats for SERIES Futoku no Guild in 7.413ms
[2024-10-10 07:14:53:116] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Futoku no Guild from Top Level (recursively) - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:53:116] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Futoku no Guild - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:53:572] Info|GetAniDBReleaseGroupStatusJob_AnimeID:17480_ForceRefresh:true > Processing GetAniDBReleaseGroupJob: 17480
[2024-10-10 07:14:55:101] Info|RefreshAnimeStatsJob_AnimeID:17480 > Processing RefreshAnimeStatsJob for Chi. Chikyuu no Undou ni Tsuite
[2024-10-10 07:14:55:101] Info|Shoko.Server.Services.AnimeSeriesService > Starting Updating STATS for SERIES Chi. Chikyuu no Undou ni Tsuite - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:55:119] Info|Shoko.Server.Services.AnimeSeriesService > Finished updating stats for SERIES Chi. Chikyuu no Undou ni Tsuite in 7.4781ms
[2024-10-10 07:14:55:119] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Chi. Chikyuu no Undou ni Tsuite from Top Level (recursively) - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:55:119] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Chi. Chikyuu no Undou ni Tsuite - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:55:178] Info|RefreshAnimeStatsJob_AnimeID:17480 > Processing RefreshAnimeStatsJob for Chi. Chikyuu no Undou ni Tsuite
[2024-10-10 07:14:55:195] Info|Shoko.Server.Services.AnimeSeriesService > Starting Updating STATS for SERIES Chi. Chikyuu no Undou ni Tsuite - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:55:195] Info|Shoko.Server.Services.AnimeSeriesService > Finished updating stats for SERIES Chi. Chikyuu no Undou ni Tsuite in 8.6017ms
[2024-10-10 07:14:55:195] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Chi. Chikyuu no Undou ni Tsuite from Top Level (recursively) - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:55:195] Info|Shoko.Server.Services.AnimeGroupService > Starting Updating STATS for GROUP Chi. Chikyuu no Undou ni Tsuite - Watched Stats: True, Missing Episodes: True
[2024-10-10 07:14:55:270] Info|GetAniDBReleaseGroupJob_GroupID:14642 > Processing GetAniDBReleaseGroupJob: 14642
[2024-10-10 07:14:55:316] Info|GetAniDBReleaseGroupJob_GroupID:16312 > Processing GetAniDBReleaseGroupJob: 16312
[2024-10-10 07:14:55:362] Info|GetAniDBReleaseGroupJob_GroupID:16325 > Processing GetAniDBReleaseGroupJob: 16325
[2024-10-10 07:14:55:408] Info|GetAniDBReleaseGroupJob_GroupID:17144 > Processing GetAniDBReleaseGroupJob: 17144
[2024-10-10 07:14:55:455] Info|GetAniDBReleaseGroupJob_GroupID:17713 > Processing GetAniDBReleaseGroupJob: 17713
[2024-10-10 07:14:55:501] Info|GetAniDBReleaseGroupJob_GroupID:4960 > Processing GetAniDBReleaseGroupJob: 4960
[2024-10-10 07:14:55:546] Info|GetAniDBReleaseGroupJob_GroupID:7587 > Processing GetAniDBReleaseGroupJob: 7587
[2024-10-10 07:14:55:591] Info|GetAniDBReleaseGroupJob_GroupID:9909 > Processing GetAniDBReleaseGroupJob: 9909
[2024-10-10 07:14:55:636] Info|GetAniDBReleaseGroupJob_GroupID:11111 > Processing GetAniDBReleaseGroupJob: 11111
[2024-10-10 07:14:55:683] Info|GetAniDBReleaseGroupJob_GroupID:11276 > Processing GetAniDBReleaseGroupJob: 11276
[2024-10-10 07:14:55:729] Info|GetAniDBReleaseGroupJob_GroupID:12574 > Processing GetAniDBReleaseGroupJob: 12574
[2024-10-10 07:14:55:775] Info|GetAniDBReleaseGroupJob_GroupID:12675 > Processing GetAniDBReleaseGroupJob: 12675
[2024-10-10 07:14:55:820] Info|GetAniDBReleaseGroupJob_GroupID:13075 > Processing GetAniDBReleaseGroupJob: 13075
[2024-10-10 07:14:55:865] Info|GetAniDBReleaseGroupJob_GroupID:13816 > Processing GetAniDBReleaseGroupJob: 13816
[2024-10-10 07:14:55:910] Info|GetAniDBReleaseGroupJob_GroupID:14969 > Processing GetAniDBReleaseGroupJob: 14969
[2024-10-10 07:14:55:955] Info|GetAniDBReleaseGroupJob_GroupID:15975 > Processing GetAniDBReleaseGroupJob: 15975
[2024-10-10 07:14:55:999] Info|GetAniDBReleaseGroupJob_GroupID:16021 > Processing GetAniDBReleaseGroupJob: 16021
[2024-10-10 07:14:56:045] Info|GetAniDBReleaseGroupJob_GroupID:16037 > Processing GetAniDBReleaseGroupJob: 16037
[2024-10-10 07:14:56:089] Info|GetAniDBReleaseGroupJob_GroupID:16172 > Processing GetAniDBReleaseGroupJob: 16172
[2024-10-10 07:14:56:134] Info|GetAniDBReleaseGroupJob_GroupID:16193 > Processing GetAniDBReleaseGroupJob: 16193
[2024-10-10 07:14:56:179] Info|GetAniDBReleaseGroupJob_GroupID:16209 > Processing GetAniDBReleaseGroupJob: 16209
[2024-10-10 07:14:56:223] Info|GetAniDBReleaseGroupJob_GroupID:16619 > Processing GetAniDBReleaseGroupJob: 16619
[2024-10-10 07:14:56:267] Info|GetAniDBReleaseGroupJob_GroupID:17042 > Processing GetAniDBReleaseGroupJob: 17042
[2024-10-10 07:14:56:310] Info|GetAniDBReleaseGroupJob_GroupID:17361 > Processing GetAniDBReleaseGroupJob: 17361
[2024-10-10 07:14:56:354] Info|GetAniDBReleaseGroupJob_GroupID:17504 > Processing GetAniDBReleaseGroupJob: 17504
[2024-10-10 07:14:56:399] Info|GetAniDBReleaseGroupJob_GroupID:17907 > Processing GetAniDBReleaseGroupJob: 17907
[2024-10-10 07:14:56:442] Info|GetAniDBReleaseGroupJob_GroupID:18285 > Processing GetAniDBReleaseGroupJob: 18285
[2024-10-10 07:14:57:177] Info|GetAniDBReleaseGroupJob_GroupID:16740 > Processing GetAniDBReleaseGroupJob: 16740
[2024-10-10 07:44:34:838] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Checking LAN Connectivity…
[2024-10-10 07:44:34:869] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Found a local gateway to use
[2024-10-10 07:44:34:869] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Checking WAN Connectivity…
[2024-10-10 07:44:34:869] Info|Shoko.Server.Services.Connectivity.ConnectivityService > Successfully connected to 3/4 internet service endpoints

@revam
Copy link
Member

revam commented Oct 11, 2024

The point of using the calendar is to add/update the seasonal anime entries. Also it seems like you have enabled fetching related anime entries with a depth above 0 (where 0 means disabled), so it will fetch all the entries currently in the calendar in addition to any related anime entries.

This seems to me like a misconfiguration on your part if you don't want it to update seasonal data, but do correct me if I'm assuming wrong here.

@Rand-Random
Copy link
Author

Rand-Random commented Oct 11, 2024

Didn't touch those settings in the last couple of years, so I couldn't even say, if I did those settings.
"By Design" seems odd, cause it could be interpreted as its by design to get banned.

Even if, shouldn't there be a sanity check for updating "related" items eg. don't update items that are completed series. eg. Inuyasha.

Inuyasha is long over and the chances it has new data is slim if not 0, and how would it be related to the current season?
Is it maybe jumping from relation to relation and it basically ends up fetching all of anidb?

What I did now,

  1. I set Related Depth to 0, though isn't it better to uncheck "Related Anime"?
    {78E11949-C54A-40DF-85B2-F2D90A9E0A6D}

  2. cleared the queue (which again increased instead of decreased)

  3. added new files of the current season and let shoko scan the files (udp isn't banned so it can add those files)

  4. current queue is

Get AniDB Anime Data
  Anime: Ao no Hako
  Anime: Delico's Nursery
  Anime: Dan Da Dan
  Anime: Hitoribocchi no Isekai Kouryaku
  Anime: Dungeon ni Deai o Motomeru no wa Machigatte Iru Darouka: Familia Myth V
  Anime: Kekkon Surutte, Hontou Desuka
  Anime: Mecha-ude (2024)
  Anime: NegaPosi Angler
  Anime: Sayounara Ryuusei, Konnichiwa Jinsei
  1. will report back when the current ban is lifed

@harshithmohan
Copy link
Member

I'll just put a screenshot here because I don't want to copy-paste 😔
image

@revam
Copy link
Member

revam commented Oct 11, 2024

@Rand-Random you can also disable the related anime checkbox if you want. It will disable the depth setting when you do.

@bigretromike
Copy link
Contributor

this is same issue as the existence of JMM/Shoko. Until there is system defaults/built-in system to mitigate this issue new people with bigger collection will auto-ban them-self, over and over again.
Sadly that is not 100% fault of shoko, as anidb wont release information about leeching-ratio until they ban to mitigate people from "cloning" their database even when there are multiply copies already in wild.

The "best strategy" was/will be adding single small series to import folder, and process it manually. or in batch-of-10.

@tamodolo
Copy link

tamodolo commented Oct 13, 2024

I'll share my log.

server restarted at line 9560 to force anidb check and started to update only to get banned some minutes later.
shoko.log

I think something may have changed on anidb side. Or shoko is updating faster than before.

@bigretromike
Copy link
Contributor

From the logs its seams that you leeched off anidb with requests and 3 minute later got ban. As it always been (more or less). That is sadly the "first" experience with bigger collections.

Also it looks like HttpRateLimiter did fire just before ban, but then luck weren't on your side.

But for real, @ElementalCrisis from this log it looks like he been asking anidb for 2 series per 1second. (00:31:40, 00:31:38, 00:31:34), 3series per 1 second (00:31:36, 00:31:28), 4 series per 1 second (00:31:20) - I wont 100% put my life for that log as its verbose if not clutter, but there is something there that can help with ban issue.

I'm maybe old and rusty, but I don't recall being able to leech that fast from anidb in the best years of my life ;-)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

6 participants