Moved presets to the testnet runtimes #5327

bkontur · 2024-08-12T14:56:47Z

It is a first step for switching to the frame-omni-bencher for CI.

This PR includes several changes related to generating chain specs plus:

pallet assigned_slots fix missing #[serde(skip)] for phantom
pallet paras_inherent benchmark fix - cherry-picked from fix rococo-dev bench #5688
migrates get_preset to the relevant runtimes
fixes Rococo genesis presets - does not work https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7317249
fixes Rococo benchmarks for CI
migrate westend genesis
remove wococo stuff

Closes: #5680

Follow-ups

Fix for frame-omni-bencher [benchmarking] Reset to genesis storage after each run #5655
Enable new short-benchmarking CI - Enable GHA short benchmarks with frame-omni-bencher #5706
Remove gitlab pipelines for short benchmarking
refactor all Cumulus runtimes to use get_preset - Refactor polkadot-parachain-bin chain-specs for cumulus runtimes and move genesis presets to the runtimes get_preset #5704
Refactor get_account_id_from_seed / get_from_seed to one common place #5705
Only customized fields in preset json blob? #5700
Backport to the stable

bkontur · 2024-08-30T13:37:37Z

@michalkucharczyk I just saw your branch origin/mku-asset-hub-rococo-preset and your PR, I think you are doing the same as I here, but in this PR I've already refactored some of the testnet AssetHubs/BridgeHubs.

What if I update this branch to actual master and then we could merge your PR's changes here and then you could also continue with other runtimes here? wdyt?

michalkucharczyk · 2024-08-30T14:14:37Z

@michalkucharczyk I just saw your branch origin/mku-asset-hub-rococo-preset and your PR, I think you are doing the same as I here, but in this PR I've already refactored some of the testnet AssetHubs/BridgeHubs.

What if I update this branch to actual master and then we could merge your PR's changes here and then you could also continue with other runtimes here? wdyt?

Can we just merge my PR to master (as it is ready to be merged) and then you can merge master to this PR?
I am not sure who will work on reworking rest of runtimes as I am still invoved in #4639 .

michalkucharczyk · 2024-08-30T14:17:19Z

cumulus/polkadot-parachain/src/chain_spec/asset_hubs.rs

-		testnet_parachains_constants::westend::currency::UNITS * 1_000_000,
-		1000.into(),
-	))
+	.with_genesis_config_patch(asset_hub_westend_development_genesis(para_id.into()))


You shall use: with_genesis_config_preset_name.

This would allow to fetch the preset from the wasm blob, w/o necessity to natively compile the runtime.

I noticed the same in polkadot-fellows/runtimes#379 (review)

yes, I saw that fellows comment, it is still in my TODOs :)

bkontur · 2024-08-30T14:25:56Z

@michalkucharczyk I just saw your branch origin/mku-asset-hub-rococo-preset and your PR, I think you are doing the same as I here, but in this PR I've already refactored some of the testnet AssetHubs/BridgeHubs.
What if I update this branch to actual master and then we could merge your PR's changes here and then you could also continue with other runtimes here? wdyt?

Can we just merge my PR to master (as it is ready to be merged) and then you can merge master to this PR? I am not sure who will work on reworking rest of runtimes as I am still invoved in #4639 .

ok, let's merge your and I will adjust and continue here with other testnets

michalkucharczyk · 2024-08-30T14:26:43Z

@michalkucharczyk I just saw your branch origin/mku-asset-hub-rococo-preset and your PR, I think you are doing the same as I here, but in this PR I've already refactored some of the testnet AssetHubs/BridgeHubs.
What if I update this branch to actual master and then we could merge your PR's changes here and then you could also continue with other runtimes here? wdyt?

Can we just merge my PR to master (as it is ready to be merged) and then you can merge master to this PR? I am not sure who will work on reworking rest of runtimes as I am still invoved in #4639 .

ok, let's merge your and I will adjust and continue here with other testnets

Thank you

michalkucharczyk · 2024-08-30T14:27:59Z

Not sure if you are interested - there is one more I plan to merge soon: #4739

paritytech-cicd-pr · 2024-09-01T21:12:22Z

The CI pipeline was cancelled due to failure one of the required jobs.
Job name: test-linux-stable 1/3
Logs: https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7209375

paritytech-cicd-pr · 2024-09-01T21:12:22Z

The CI pipeline was cancelled due to failure one of the required jobs.
Job name: test-linux-stable 3/3
Logs: https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7209377

bkontur · 2024-09-02T11:11:56Z

bot fmt

command-bot · 2024-09-02T11:12:02Z

@bkontur https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7214774 was started for your command "$PIPELINE_SCRIPTS_DIR/commands/fmt/fmt.sh". Check out https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/pipelines?page=1&scope=all&username=group_605_bot to know what else is being executed currently.

Comment bot cancel 2-3568b7dd-c695-4ae7-a3d4-30e9d1fb4ca3 to cancel this command or bot cancel to cancel all commands in this pull request.

command-bot · 2024-09-02T11:13:51Z

@bkontur Command "$PIPELINE_SCRIPTS_DIR/commands/fmt/fmt.sh" has finished. Result: https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7214774 has finished. If any artifacts were generated, you can download them from https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7214774/artifacts/download.

cumulus/parachains/runtimes/assets/asset-hub-westend/src/genesis_config_presets.rs

michalkucharczyk

LGTM.

Would be nice to add some tests verifying that presets are actually convertible to genesis storage - sample approach given here:

polkadot-sdk/substrate/test-utils/runtime/src/lib.rs

Line 1363 in 9307d99

fn build_config_from_json_works() {

But this could be done in follow-up, especially in context of #5700.

prdoc/pr_5327.prdoc

…testnets

substrate/primitives/genesis-builder/src/lib.rs

…testnets

paritytech-cmd-bot-polkadot-sdk · 2024-09-22T17:50:02Z

Created backport PR for stable2407:

[stable2407] Backport #5327 #5797 with remaining conflicts!

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin backport-5327-to-stable2407
git worktree add --checkout .worktree/backport-5327-to-stable2407 backport-5327-to-stable2407
cd .worktree/backport-5327-to-stable2407
git reset --hard HEAD^
git cherry-pick -x 8735c66393978fec6fd811ef7832b08355a2885a
git push --force-with-lease

paritytech-cmd-bot-polkadot-sdk · 2024-09-22T17:50:06Z

Created backport PR for stable2409:

[stable2409] Backport #5327 #5798 with remaining conflicts!

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin backport-5327-to-stable2409
git worktree add --checkout .worktree/backport-5327-to-stable2409 backport-5327-to-stable2409
cd .worktree/backport-5327-to-stable2409
git reset --hard HEAD^
git cherry-pick -x 8735c66393978fec6fd811ef7832b08355a2885a
git push --force-with-lease

It is a first step for switching to the `frame-omni-bencher` for CI. This PR includes several changes related to generating chain specs plus: - [x] pallet `assigned_slots` fix missing `#[serde(skip)]` for phantom - [x] pallet `paras_inherent` benchmark fix - cherry-picked from #5688 - [x] migrates `get_preset` to the relevant runtimes - [x] fixes Rococo genesis presets - does not work https://gitlab.parity.io/parity/mirrors/polkadot-sdk/-/jobs/7317249 - [x] fixes Rococo benchmarks for CI - [x] migrate westend genesis - [x] remove wococo stuff Closes: #5680 - Fix for frame-omni-bencher #5655 - Enable new short-benchmarking CI - #5706 - Remove gitlab pipelines for short benchmarking - refactor all Cumulus runtimes to use `get_preset` - #5704 - #5705 - #5700 - [ ] Backport to the stable --------- Co-authored-by: command-bot <> Co-authored-by: ordian <[email protected]> (cherry picked from commit 8735c66)

Backport #5327 into `stable2409` from bkontur. See the [documentation](https://github.com/paritytech/polkadot-sdk/blob/master/docs/BACKPORT.md) on how to use this bot.  Co-authored-by: Branislav Kontur <[email protected]>

bkontur added T12-benchmarks This PR/Issue is related to benchmarking and weights. T14-system_parachains This PR/Issue is related to system parachains. R0-silent Changes should not be mentioned in any release notes labels Aug 12, 2024

bkontur force-pushed the bko-get_preset-for-testnets branch from 63d05be to 932e369 Compare August 13, 2024 08:54

This was referenced Aug 13, 2024

CI short benchmarking with frame-omni-bencher #4405

Closed

frame-omni-bencher fix for --repeat > 1 #5083

Draft

bkontur force-pushed the bko-get_preset-for-testnets branch from 932e369 to 80475ff Compare August 30, 2024 13:56

michalkucharczyk reviewed Aug 30, 2024

View reviewed changes

bkontur mentioned this pull request Aug 30, 2024

asset-hub-rococo: genesis config presets added #3996

Merged

bkontur force-pushed the bko-get_preset-for-testnets branch 2 times, most recently from 89133a0 to 493ad6b Compare September 1, 2024 21:00

bkontur force-pushed the bko-get_preset-for-testnets branch from 493ad6b to 4ae31df Compare September 2, 2024 11:09

michalkucharczyk reviewed Sep 2, 2024

View reviewed changes

cumulus/parachains/runtimes/assets/asset-hub-westend/src/genesis_config_presets.rs Outdated Show resolved Hide resolved

bkontur force-pushed the bko-get_preset-for-testnets branch from e96f540 to 24d28ae Compare September 2, 2024 19:36

bkontur mentioned this pull request Sep 3, 2024

polkadot-omni-node: Fully remove benchmark sub-command #5564

Open

bkontur force-pushed the bko-get_preset-for-testnets branch 2 times, most recently from bc435cd to 8238baf Compare September 9, 2024 17:58

bkontur mentioned this pull request Sep 9, 2024

[benchmarking] Reset to genesis storage after each run #5655

Merged

bkontur force-pushed the bko-get_preset-for-testnets branch 2 times, most recently from b95e603 to c35a621 Compare September 11, 2024 09:26

Merge branch 'master' into bko-get_preset-for-testnets

8f33808

franciscoaguirre approved these changes Sep 16, 2024

View reviewed changes

michalkucharczyk approved these changes Sep 16, 2024

View reviewed changes

michalkucharczyk reviewed Sep 16, 2024

View reviewed changes

prdoc/pr_5327.prdoc Outdated Show resolved Hide resolved

bkontur added 2 commits September 18, 2024 00:17

Merge remote-tracking branch 'origin/master' into bko-get_preset-for-…

e28bf03

…testnets

Merge remote-tracking branch 'origin/master' into bko-get_preset-for-…

faab276

…testnets

bkontur changed the title ~~Add get_preset to the testnet runtimes~~ Moved presets to the testnet runtimes Sep 18, 2024

bkontur added 2 commits September 18, 2024 09:15

prdoc

e8f3bbb

Refactor presets for LOCAL_TESTNET_RUNTIME_PRESET

beded8e

bkontur requested a review from kianenigma September 18, 2024 08:19

michalkucharczyk reviewed Sep 18, 2024

View reviewed changes

substrate/primitives/genesis-builder/src/lib.rs Show resolved Hide resolved

bkontur commented Sep 18, 2024

View reviewed changes

substrate/primitives/genesis-builder/src/lib.rs Outdated Show resolved Hide resolved

bkontur added 6 commits September 18, 2024 11:06

Update substrate/primitives/genesis-builder/src/lib.rs

b60c89a

prdoc

5308200

Merge remote-tracking branch 'origin/master' into bko-get_preset-for-…

992af98

…testnets

Merge remote-tracking branch 'origin/master' into bko-get_preset-for-…

8a499e0

…testnets

Nits

87ac7ad

Merge remote-tracking branch 'origin/master' into bko-get_preset-for-…

1724235

…testnets

bkontur added this pull request to the merge queue Sep 22, 2024

Merged via the queue into master with commit 8735c66 Sep 22, 2024
203 of 209 checks passed

bkontur deleted the bko-get_preset-for-testnets branch September 22, 2024 17:04

bkontur added the A4-needs-backport Pull request must be backported to all maintained releases. label Sep 22, 2024

paritytech-cmd-bot-polkadot-sdk bot mentioned this pull request Sep 22, 2024

[stable2407] Backport #5327 #5797

Closed

paritytech-cmd-bot-polkadot-sdk bot mentioned this pull request Sep 22, 2024

[stable2409] Backport #5327 #5798

Merged

bkontur had a problem deploying to subsystem-benchmarks September 22, 2024 18:11 — with GitHub Actions Failure

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Moved presets to the testnet runtimes #5327

Moved presets to the testnet runtimes #5327

bkontur commented Aug 12, 2024 •

edited

Loading

bkontur commented Aug 30, 2024 •

edited

Loading

michalkucharczyk commented Aug 30, 2024

michalkucharczyk Aug 30, 2024 •

edited

Loading

bkontur Aug 30, 2024

bkontur commented Aug 30, 2024

michalkucharczyk commented Aug 30, 2024

michalkucharczyk commented Aug 30, 2024

paritytech-cicd-pr commented Sep 1, 2024

paritytech-cicd-pr commented Sep 1, 2024

bkontur commented Sep 2, 2024

command-bot bot commented Sep 2, 2024 •

edited

Loading

command-bot bot commented Sep 2, 2024

michalkucharczyk left a comment •

edited

Loading

paritytech-cmd-bot-polkadot-sdk bot commented Sep 22, 2024

paritytech-cmd-bot-polkadot-sdk bot commented Sep 22, 2024

Moved presets to the testnet runtimes #5327

Moved presets to the testnet runtimes #5327

Conversation

bkontur commented Aug 12, 2024 • edited Loading

Follow-ups

bkontur commented Aug 30, 2024 • edited Loading

michalkucharczyk commented Aug 30, 2024

michalkucharczyk Aug 30, 2024 • edited Loading

Choose a reason for hiding this comment

bkontur Aug 30, 2024

Choose a reason for hiding this comment

bkontur commented Aug 30, 2024

michalkucharczyk commented Aug 30, 2024

michalkucharczyk commented Aug 30, 2024

paritytech-cicd-pr commented Sep 1, 2024

paritytech-cicd-pr commented Sep 1, 2024

bkontur commented Sep 2, 2024

command-bot bot commented Sep 2, 2024 • edited Loading

command-bot bot commented Sep 2, 2024

michalkucharczyk left a comment • edited Loading

Choose a reason for hiding this comment

paritytech-cmd-bot-polkadot-sdk bot commented Sep 22, 2024

paritytech-cmd-bot-polkadot-sdk bot commented Sep 22, 2024

bkontur commented Aug 12, 2024 •

edited

Loading

bkontur commented Aug 30, 2024 •

edited

Loading

michalkucharczyk Aug 30, 2024 •

edited

Loading

command-bot bot commented Sep 2, 2024 •

edited

Loading

michalkucharczyk left a comment •

edited

Loading