Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(task db): implement a task DB #208

Merged
merged 52 commits into from
Jul 2, 2024
Merged

feat(task db): implement a task DB #208

merged 52 commits into from
Jul 2, 2024

Commits on May 16, 2024

  1. task-manager: dump fight vs sqlite

    @mratsim
    mratsim committed May 16, 2024
    Configuration menu
    Copy the full SHA
    34e0946 View commit details
    Browse the repository at this point in the history

  2. task-manager: SQL tables+views+triggers success - but arguments passe… 

    …d in execute are 'NULL'
    @mratsim
    mratsim committed May 16, 2024
    Configuration menu
    Copy the full SHA
    b418922 View commit details
    Browse the repository at this point in the history

  3. task-manager: passing enqueue_task tests

    @mratsim
    mratsim committed May 16, 2024
    Configuration menu
    Copy the full SHA
    0928796 View commit details
    Browse the repository at this point in the history

  4. task-manager: cleanup - ease copy pasting to SQL script, Registered s… 

    …tatus, persistent views, remove debug print
    @mratsim
    mratsim committed May 16, 2024
    Configuration menu
    Copy the full SHA
    bd06c13 View commit details
    Browse the repository at this point in the history

  5. task-manager: add DB size query

    @mratsim
    mratsim committed May 16, 2024
    Configuration menu
    Copy the full SHA
    bf63839 View commit details
    Browse the repository at this point in the history

  6. task-manager: id_proof is unneeded + prettify queries

    @mratsim
    mratsim committed May 16, 2024
    Configuration menu
    Copy the full SHA
    b7ce7a1 View commit details
    Browse the repository at this point in the history

  7. task-manager: change DB schema - allow multiple provers and status fo… 

    …r same task in case of failures-retry
    @mratsim
    mratsim committed May 16, 2024
    Configuration menu
    Copy the full SHA
    e707bc7 View commit details
    Browse the repository at this point in the history

  8. task-manager: allow task updates

    @mratsim
    mratsim committed May 16, 2024
    Configuration menu
    Copy the full SHA
    0402e6a View commit details
    Browse the repository at this point in the history

  9. task-manager: retrieve cached proofs from DB

    @mratsim
    mratsim committed May 16, 2024
    Configuration menu
    Copy the full SHA
    a1302ec View commit details
    Browse the repository at this point in the history

  10. task-manager: add status check

    @mratsim
    mratsim committed May 16, 2024
    Configuration menu
    Copy the full SHA
    881f174 View commit details
    Browse the repository at this point in the history

  11. task-manager: add progress reports

    @mratsim
    mratsim committed May 16, 2024
    Configuration menu
    Copy the full SHA
    f0362da View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. Merge branch 'main' into tasks_db

    @petarvujovic98
    petarvujovic98 authored May 20, 2024
    Configuration menu
    Copy the full SHA
    6709048 View commit details
    Browse the repository at this point in the history

  2. chore(task_manager): Run cargo fmt

    @petarvujovic98
    petarvujovic98 committed May 20, 2024
    Configuration menu
    Copy the full SHA
    2099196 View commit details
    Browse the repository at this point in the history

Commits on Jun 13, 2024

  1. Merge branch 'main' into tasks_db

    @petarvujovic98
    petarvujovic98 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    6567615 View commit details
    Browse the repository at this point in the history

  2. feat: address small lints

    @petarvujovic98
    petarvujovic98 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    2c4add1 View commit details
    Browse the repository at this point in the history

  3. feat(task-manager): use result type with thiserror

    @petarvujovic98
    petarvujovic98 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    9390f0b View commit details
    Browse the repository at this point in the history

  4. chore(task-db): fix typos

    @petarvujovic98
    petarvujovic98 committed Jun 13, 2024
    Configuration menu
    Copy the full SHA
    f1f492d View commit details
    Browse the repository at this point in the history

Commits on Jun 14, 2024

  1. refactor(task-manager): clean up tests

    @petarvujovic98
    petarvujovic98 committed Jun 14, 2024
    Configuration menu
    Copy the full SHA
    fed8e82 View commit details
    Browse the repository at this point in the history

Commits on Jun 17, 2024

  1. Merge branch 'main' into tasks_db

    @petarvujovic98
    petarvujovic98 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    4433772 View commit details
    Browse the repository at this point in the history

  2. fix(docker): unignore task manager

    @petarvujovic98
    petarvujovic98 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    544763a View commit details
    Browse the repository at this point in the history

  3. [WIP](task_manager): write initial task handler stubs

    @petarvujovic98
    petarvujovic98 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    ee1fb8c View commit details
    Browse the repository at this point in the history

  4. chore(task_manager): run cargo fmt

    @petarvujovic98
    petarvujovic98 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    26f6010 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into tasks_db

    @petarvujovic98
    petarvujovic98 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    3b402e8 View commit details
    Browse the repository at this point in the history

  6. [WIP](task_manager): write status and proof get handlers

    @petarvujovic98
    petarvujovic98 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    e127031 View commit details
    Browse the repository at this point in the history

  7. refactor(host): use merge instead of nest

    @petarvujovic98
    petarvujovic98 committed Jun 17, 2024
    Configuration menu
    Copy the full SHA
    4279519 View commit details
    Browse the repository at this point in the history

Commits on Jun 18, 2024

  1. chore(format): format workflow files

    @petarvujovic98
    petarvujovic98 committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    24f23e2 View commit details
    Browse the repository at this point in the history

  2. chore(deps): use consistent dependency style

    @petarvujovic98
    petarvujovic98 committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    caa4714 View commit details
    Browse the repository at this point in the history

  3. chore(host): rename tx to task_channel

    @petarvujovic98
    petarvujovic98 committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    291a299 View commit details
    Browse the repository at this point in the history

  4. [WIP](task_manager): add initial submit logic

    @petarvujovic98
    petarvujovic98 committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    5d41651 View commit details
    Browse the repository at this point in the history

  5. chore(clippy): remove unused parameter

    @petarvujovic98
    petarvujovic98 committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    5e53b2b View commit details
    Browse the repository at this point in the history

  6. chore(clippy): remove unused imports

    @petarvujovic98
    petarvujovic98 committed Jun 18, 2024
    Configuration menu
    Copy the full SHA
    405459e View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2024

  1. Merge branch 'main' into tasks_db

    @petarvujovic98
    petarvujovic98 committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    e37ee75 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. refactor(core): add copy trait to proof types

    @petarvujovic98
    petarvujovic98 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    3e5fc6d View commit details
    Browse the repository at this point in the history

  2. feat(task_manager): simplify db and adapt tests

    @petarvujovic98
    petarvujovic98 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    d4326cb View commit details
    Browse the repository at this point in the history

  3. fix(clippy): fix dereference issue

    @petarvujovic98
    petarvujovic98 committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    4be8774 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. [WIP]: handle proof request by worker and update task status

    @petarvujovic98
    petarvujovic98 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    5a38b0a View commit details
    Browse the repository at this point in the history

  2. [WIP]: add block fetching and initial blockhash getting for submit

    @petarvujovic98
    petarvujovic98 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    0c01e59 View commit details
    Browse the repository at this point in the history

  3. [WIP]: handle task creation, status and proof retrieval

    @petarvujovic98
    petarvujovic98 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    dc0d2c4 View commit details
    Browse the repository at this point in the history

  4. fix(host): fix route sub-path

    @petarvujovic98
    petarvujovic98 committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    7f91887 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2024

  1. Merge branch 'main' into tasks_db

    @petarvujovic98
    petarvujovic98 committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    33d7173 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Merge branch 'main' into tasks_db

    @petarvujovic98
    petarvujovic98 committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    1101421 View commit details
    Browse the repository at this point in the history

  2. feat(raiko): abstract task manager and impl a mem db for easy integra… 

    …tion (#296)

* impl a mem db for easy integration

Signed-off-by: smtmfft <[email protected]>

* fix clippy and unit test

Signed-off-by: smtmfft <[email protected]>

* fix fmt

Signed-off-by: smtmfft <[email protected]>

---------

Signed-off-by: smtmfft <[email protected]>
    @smtmfft
    smtmfft authored Jun 27, 2024
    Configuration menu
    Copy the full SHA
    ca1c7b0 View commit details
    Browse the repository at this point in the history

  3. fix: throw error instead of panicing on runtime checks

    @petarvujovic98
    petarvujovic98 committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    7e48839 View commit details
    Browse the repository at this point in the history

  4. fix(core,task_manager): add custom ensure and require fns

    @petarvujovic98
    petarvujovic98 committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    15044af View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. feat(task_db): sqlite and in memory abstraction (#301) 

    * enable sqlite db by feature

Signed-off-by: smtmfft <[email protected]>

* debug lifetime

Signed-off-by: smtmfft <[email protected]>

* resolve lifetime issue and make all tests pass

Signed-off-by: smtmfft <[email protected]>

* refactor(task_db): simplify structure for sqlite and use cached statements

* feat(task_db): abstract task db implementation into wrapper

* fix(task_db): add await to test call

* fix(task_db): fix import declaration

* fix(task_db): add async and mutable variables

* fix(host): fix task manager usage

* fix(task_db): fix test for async

* Update Cargo.toml

use in-mem as default.

---------

Signed-off-by: smtmfft <[email protected]>
Co-authored-by: smtmfft <[email protected]>
Co-authored-by: smtmfft <[email protected]>
    @petarvujovic98 @smtmfft
    3 people authored Jul 2, 2024
    Configuration menu
    Copy the full SHA
    9e905ed View commit details
    Browse the repository at this point in the history

  2. feat(task_manager): return empty list on key not found

    @petarvujovic98
    petarvujovic98 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    bb57b50 View commit details
    Browse the repository at this point in the history

  3. feat(host,task_manager): add tracing and handle workers

    @petarvujovic98
    petarvujovic98 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    ec40dfc View commit details
    Browse the repository at this point in the history

  4. feat(host): fix response structure

    @petarvujovic98
    petarvujovic98 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    ff7edf6 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'main' into tasks_db

    @petarvujovic98
    petarvujovic98 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    5817837 View commit details
    Browse the repository at this point in the history

  6. chore(clippy): remove unused imports

    @petarvujovic98
    petarvujovic98 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    5d31091 View commit details
    Browse the repository at this point in the history

  7. fix(ci): remove git merge added lines

    @petarvujovic98
    petarvujovic98 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    867cc55 View commit details
    Browse the repository at this point in the history

  8. fix(task_manager): add blob proof type field

    @petarvujovic98
    petarvujovic98 committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    52b767d View commit details
    Browse the repository at this point in the history