Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Synchronize optimization into parallel processing, and replace the calculation of ghost data with validation methods during synchronization to improve efficiency #4192

Merged
merged 32 commits into from
Sep 18, 2024
Merged

Synchronize optimization into parallel processing, and replace the calculation of ghost data with validation methods during synchronization to improve efficiency #4192

merged 32 commits into from
Sep 18, 2024

Commits on Sep 5, 2024

  1. add parallel code

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    ee7104f View commit details
    Browse the repository at this point in the history

  2. use try recv to avoid blocking

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    85b9b45 View commit details
    Browse the repository at this point in the history

  3. parallel execution

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    2d672b4 View commit details
    Browse the repository at this point in the history

  4. create chain when the parents are ready in parallel execution

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    e575d6d View commit details
    Browse the repository at this point in the history

  5. set executing state in sender

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    959995e View commit details
    Browse the repository at this point in the history

  6. check the parents when dispatching

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    8e1744a View commit details
    Browse the repository at this point in the history

  7. add 10000 buffer for parallel execution

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    03f8b8d View commit details
    Browse the repository at this point in the history

  8. save the block in local store to buffer the block

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    b9e34d0 View commit details
    Browse the repository at this point in the history

  9. add log for saving time

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    689a478 View commit details
    Browse the repository at this point in the history

  10. check local store for the absent block

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    b086d13 View commit details
    Browse the repository at this point in the history

  11. add test case

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    1fa8f94 View commit details
    Browse the repository at this point in the history

  12. add some fix

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    4f26278 View commit details
    Browse the repository at this point in the history

  13. add some test

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    cb4abfe View commit details
    Browse the repository at this point in the history

  14. add false testing case

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    bcac3fa View commit details
    Browse the repository at this point in the history

  15. add more testing code

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    ccfe95d View commit details
    Browse the repository at this point in the history

  16. add check data

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    4e50d66 View commit details
    Browse the repository at this point in the history

  17. add verify blue block in verifier

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    30ecb99 View commit details
    Browse the repository at this point in the history

  18. add some code

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    a2f64bc View commit details
    Browse the repository at this point in the history

  19. add verification

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    763f1d3 View commit details
    Browse the repository at this point in the history

  20. fix some bugs

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    be34e3b View commit details
    Browse the repository at this point in the history

  21. add yeilding after execution for processing the main chain in other s… 

    …ervice
    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    4299894 View commit details
    Browse the repository at this point in the history

  22. finish debug, it works

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    8437fe8 View commit details
    Browse the repository at this point in the history

  23. fmt and clippy

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    ef84a9b View commit details
    Browse the repository at this point in the history

  24. rebase master 

    set the number 4500000 for vega updating
    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    d1edfb7 View commit details
    Browse the repository at this point in the history

  25. remove some commented code

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    532d9b6 View commit details
    Browse the repository at this point in the history

  26. fix: return continue if the dag block is ready

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    d46c9ad View commit details
    Browse the repository at this point in the history

  27. add loop if the connection of the workers are not closed

    @jackzhhuang
    jackzhhuang committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    7d535d6 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2024

  1. 3300000 will be version 1 in vega

    @jackzhhuang
    jackzhhuang committed Sep 6, 2024
    Configuration menu
    Copy the full SHA
    58fa314 View commit details
    Browse the repository at this point in the history

Commits on Sep 7, 2024

  1. use selected parent to get he parent

    @jackzhhuang
    jackzhhuang committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    03981e3 View commit details
    Browse the repository at this point in the history

  2. remove comments

    @jackzhhuang
    jackzhhuang committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    c5a4093 View commit details
    Browse the repository at this point in the history

  3. remove bracket

    @jackzhhuang
    jackzhhuang committed Sep 7, 2024
    Configuration menu
    Copy the full SHA
    6d27f2c View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2024

  1. fix fmt

    @jackzhhuang
    jackzhhuang committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    96df6fc View commit details
    Browse the repository at this point in the history