Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use multiple threads to insert stats in couchdb #2963

Merged
merged 2 commits into from
Aug 23, 2024
Merged

Conversation

amCap1712
Copy link
Member

@amCap1712 amCap1712 commented Aug 15, 2024

Use a threadpool to split and insert stats in couchdb. 25% improvement in processing time.

Use a threadpool to split and insert stats in couchdb.
@pep8speaks
Copy link

pep8speaks commented Aug 15, 2024

Hello @amCap1712! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

Line 127:5: E303 too many blank lines (2)

Line 173:1: E305 expected 2 blank lines after class or function definition, found 1
Line 193:1: E305 expected 2 blank lines after class or function definition, found 1

Comment last updated at 2024-08-23 20:31:13 UTC

@amCap1712 amCap1712 requested a review from mayhem August 20, 2024 17:10
listenbrainz/spark/spark_dataset.py Show resolved Hide resolved
@amCap1712 amCap1712 merged commit f0334de into master Aug 23, 2024
2 checks passed
@amCap1712 amCap1712 deleted the couchdb-fast branch August 23, 2024 20:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants