Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/type search #47

Merged
merged 10 commits into from
Aug 16, 2024
Merged

Feature/type search #47

merged 10 commits into from
Aug 16, 2024

Conversation

XanderVertegaal
Copy link
Contributor

@XanderVertegaal XanderVertegaal commented Aug 13, 2024

This PR closes #37, implementing type-based searches in Aethel. It also implements #39 in a basic way for testing purposes. The styling of the buttons could use some work, but at least the functionality is there.


response_object = AethelListResponse()

# First we select all relevant samples from the dataset that contain the query string.
query_result = search(
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It turns out that this pre-filtering loop is not necessary, and we can improve performance slightly by removing it. I compared word and type searches with and without this step using a bigger dataset (3000 samples). Word searches performed slightly better without the pre-filtering (0.04s) step than with it (0.05s), and the same is true for type searches (0.52s with pre-filtering => 0.42s without).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As an added benefit, we can drop a lot of code taken from aethel in search.py.

@XanderVertegaal XanderVertegaal requested a review from bbonf August 13, 2024 10:12
@XanderVertegaal
Copy link
Contributor Author

XanderVertegaal commented Aug 15, 2024

Performance is still an issue when the full dataset is used. The last commit provides some improvements regarding the retrieval of existing results in the response object, but further optimisations are needed.

Two possible optimisations in the frontend will be taken up in separate PRs for these issues:

@XanderVertegaal XanderVertegaal merged commit 67770b3 into develop Aug 16, 2024
1 check passed
@XanderVertegaal XanderVertegaal deleted the feature/type-search branch August 16, 2024 06:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Search for types
2 participants