You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I ran into a problem where the data returned by the Jikan API was too large, which unfortunately made some endpoints unusable on the project I'm working on, involving LLM. I have getAnimeReviews, getAnimeCharacters, getAnimeRecommendations in mind, but there are others and their "Manga" counterparts.
In my particular use case, a simple additional query parameter limit as already present in the /anime or /manga endpoints will solve the issue, but it would be even nicer to have full pagination. Actually, getAnimeReviews does implement pagination, but the page size cannot be controlled.
Thanks for the great work !
The text was updated successfully, but these errors were encountered:
The reason there is no pagination for these endpoints is a technical limitation.
All of these endpoints are just scraping the relevant pages from MAL, then they are caching the scrape result in the database for a certain period of time.
If there is no pagination on these MAL pages, we can't add any pagination to these endpoints. (One request to Jikan API is exactly one request to MAL if the page is not cached yet)
A few examples to just make it easy to visualise it:
which unfortunately made some endpoints unusable on the project I'm working on, involving LLM
This statement raises some eyebrows for me. In case of an LLM related project the size of the data should not be a problem, it might be a problem the way you try to parameterise the LLM, or you might want to use a different model which doesn't limit the token count that much. I can give you better hints if you could elaborate on that part of your problem.
I ran into a problem where the data returned by the Jikan API was too large, which unfortunately made some endpoints unusable on the project I'm working on, involving LLM. I have
getAnimeReviews
,getAnimeCharacters
,getAnimeRecommendations
in mind, but there are others and their "Manga" counterparts.In my particular use case, a simple additional query parameter
limit
as already present in the/anime
or/manga
endpoints will solve the issue, but it would be even nicer to have full pagination. Actually,getAnimeReviews
does implement pagination, but the page size cannot be controlled.Thanks for the great work !
The text was updated successfully, but these errors were encountered: