Code

Release 1.0.2#50

Code

Merged

dylanuys merged 124 commits intomainBitMind-AI/bitmind-subnet:mainfrom testnetBitMind-AI/bitmind-subnet:testnetCopy head branch name to clipboardAug 19, 2024

+1,236-1,560

Commits

Commits on Jul 31, 2024

• Updated synthetic image mirror generation script, created helper function for generating images iin SyntheticImageGenerator class, moved notebooks to new notebooks dir.

  benliang99

  committed
  8e3169d

  Copy full SHA for 8e3169d

• Restored ensure_save_path func back to annotation_utils.py

  benliang99

  committed
  f939cbb

  Copy full SHA for f939cbb

• Added latency tracking, max images generated field for synthetic image mirror pipeline.

  benliang99

  committed
  26f695e

  Copy full SHA for 26f695e

• Added mean synthetic image gen latency print statement

  benliang99

  committed
  810211a

  Copy full SHA for 810211a

• Update example arg inputs

  benliang99

  committed
  8aa47c8

  Copy full SHA for 8aa47c8

• Fix imports

  benliang99

  committed
  37b1bdd

  Copy full SHA for 37b1bdd

• Fixed and reformatted args

  benliang99

  committed
  1b9f657

  Copy full SHA for 1b9f657

• Suppressed TensorFlow warnings, fixed image gen from annotation

  benliang99

  committed
  8927abf

  Copy full SHA for 8927abf

• Index and loop bugfixes

  benliang99

  committed
  48456ce

  Copy full SHA for 48456ce

• Index, looping, args logic fixes.

  benliang99

  committed
  6fc7bba

  Copy full SHA for 6fc7bba

• Add load diffuser function call

  benliang99

  committed
  c7e4045

  Copy full SHA for c7e4045

• Clear gpu after using synthetic image generator

  benliang99

  committed
  23d467d

  Copy full SHA for 23d467d

• Always load from Hugging Face.

  benliang99

  committed
  249cab8

  Copy full SHA for 249cab8

• Batch processing for memory optimization. Added optional name field to generate_image in SyntheticImageGenerato for future customization.

  benliang99

  committed
  1d0565e

  Copy full SHA for 1d0565e

• Memory optimizations (saving annotation .jsons to disk), added args for chunking, pm2 examples

  benliang99

  committed
  39bc7d4

  Copy full SHA for 39bc7d4

• Fix save as json on disk, ensure no hanging reference when gpu is cleared in SyntheticImageGenerator

  benliang99

  committed
  8f25209

  Copy full SHA for 8f25209

• Replaced generic DiffusionPipeline with StableDiffusionPipeline that inherits from it. Specified generated image dimensions in diffuser call params.

  benliang99

  committed
  8b09c07

  Copy full SHA for 8b09c07

Commits on Aug 1, 2024

• convert diffuser to float32 before moving onto cpu, fixed duplicate image count logs

  aliang322

  committed
  420513f

  Copy full SHA for 420513f

• Merge branch 'synthetic_image_gen_updates' of https://github.com/bitmind-ai/bitmind-subnet into synthetic_image_gen_updates

  aliang322

  committed
  4f2d671

  Copy full SHA for 4f2d671

• Added a testing function to save images from real image dataset, changed annotations 'index' field to 'id' for consistency, various data loading and parameter fixes

  benliang99

  committed
  9e7e829

  Copy full SHA for 9e7e829

• Added pipeline for diffusion models to constants.py, and dynamic pipeline loading and image size customization to generation.

  benliang99

  committed
  9255df4

  Copy full SHA for 9255df4

• Fixed Hugging Face authentication errors. Added instruction to authenticate with huggingface-cli login

  benliang99

  committed
  ebd3171

  Copy full SHA for ebd3171

• Fixed all annotations being used to generate mirrors regardless of start and end indices

  benliang99

  committed
  3f29b83

  Copy full SHA for 3f29b83

Commits on Aug 2, 2024

• Added a new load_and_sort_dataset function to handle Hugging Face dataset rows being ordered by filename string-wise instead of numerically. Added generate_synthetic_images arg and updated dataset …

  Show description for 65d04f7
  benliang99

  committed
  65d04f7

  Copy full SHA for 65d04f7

• Removed extra disable progress bar call. Added ceil import for progress calculation.

  benliang99

  committed
  1a435ef

  Copy full SHA for 1a435ef

Commits on Aug 3, 2024

• Adjust Hugging Face annotations dataset name

  benliang99

  committed
  d986842

  Copy full SHA for d986842

• Reverted annotations dataset name to have data range, now requiring start_index and end_index args.

  benliang99

  committed
  b59e513

  Copy full SHA for b59e513

• Re-removed data range from annotations

  benliang99

  committed
  2d0851c

  Copy full SHA for 2d0851c

• Update 'index' to 'id'

  benliang99

  committed
  6af5b61

  Copy full SHA for 6af5b61

• Fixed loading annotations from Hugging Face and savng specified indices to disk.

  benliang99

  committed
  98da219

  Copy full SHA for 98da219

Commits on Aug 4, 2024

• Utils refactored, smaller functions. Added resize arg. Added combine_datasets script to put together all generated splits into one Hugging Face dataset.

  benliang99

  committed
  70ae0ed

  Copy full SHA for 70ae0ed

• Replace hardcoded name

  benliang99

  committed
  e14fb04

  Copy full SHA for e14fb04

• Fix fstring

  benliang99

  committed
  69440d6

  Copy full SHA for 69440d6

• Fix args

  benliang99

  committed
  8df88a0

  Copy full SHA for 8df88a0

• Fixed typos

  benliang99

  committed
  cf530ef

  Copy full SHA for cf530ef

Commits on Aug 5, 2024

• Updated combine_datasets.py to match Hugging Face dataset nomenclature.

  benliang99

  committed
  6fe022a

  Copy full SHA for 6fe022a

Commits on Aug 8, 2024

• removing unused files

  dylanuys

  committed
  a813a55

  Copy full SHA for a813a55

• initial validator forward pytest

  dylanuys

  committed
  8b01977

  Copy full SHA for 8b01977

• initial ci.yml

  dylanuys

  committed
  7aacd76

  Copy full SHA for 7aacd76

• new mock classes for ci workflow

  dylanuys

  committed
  30cf41b

  Copy full SHA for 30cf41b

• temporarily removing old version of generate_synthetic_data.py

  dylanuys

  committed
  7ffa028

  Copy full SHA for 7ffa028

• rename get_mock_image() -> create_random_image()

  dylanuys

  committed
  176fe3c

  Copy full SHA for 176fe3c

• adding test_mock.py

  dylanuys

  committed
  5736d47

  Copy full SHA for 5736d47

• renaming build -> test step in ci.yml

  dylanuys

  committed
  12b75cf

  Copy full SHA for 12b75cf

• test_rewards.py

  dylanuys

  committed
  4bc5b2a

  Copy full SHA for 4bc5b2a

Commits on Aug 9, 2024

• parameterizing fake_prob to allow intentionally testing real/synth image flows in vali fwd

  dylanuys

  committed
  92a9ae8

  Copy full SHA for 92a9ae8

• forcing vali fwd through real and synth image flows

  dylanuys

  committed
  3a0d940

  Copy full SHA for 3a0d940

• fake_prob -> _fake_prob

  dylanuys

  committed
  cd2763d

  Copy full SHA for cd2763d

• using dot operator to read config in mock vali until I replace namespace cfg with bt.config

  dylanuys

  committed
  4d2964f

  Copy full SHA for 4d2964f

• allowing mock code to skip force_register_neuron in the case that the neuron was already registered in previous test instance

  dylanuys

  committed
  6e27356

  Copy full SHA for 6e27356

• removing unused circleci dir from template repo

  dylanuys

  committed
  3ce4ccb

  Copy full SHA for 3ce4ccb

Commits on Aug 10, 2024

• image transforms tests

  dylanuys

  committed
  8e38e45

  Copy full SHA for 8e38e45

• fixing setting of mock dentrite process_time

  dylanuys

  committed
  29fe632

  Copy full SHA for 29fe632

• adding test_mock.py

  dylanuys

  committed
  9b3aacf

  Copy full SHA for 9b3aacf

• reset mock chain state in between test cases

  dylanuys

  committed
  22aec1d

  Copy full SHA for 22aec1d

• cleaning up state management for MockSubtensor

  dylanuys

  committed
  9e50a92

  Copy full SHA for 9e50a92

• __init__.py

  dylanuys

  committed
  22ecfc9

  Copy full SHA for 22ecfc9

• replacing hardcoded string with random image b64

  dylanuys

  committed
  c40aad9

  Copy full SHA for c40aad9

Commits on Aug 11, 2024

• Fixed saving synthetic images after resizing.

  benliang99

  committed
  04d96a8

  Copy full SHA for 04d96a8

Commits on Aug 12, 2024

• Merge pull request #43 from BitMind-AI/initial-pytest-test

  Show description for 2a96f27
  dylanuys

  authored
  2a96f27

  Copy full SHA for 2a96f27

Commits on Aug 15, 2024

• new auto update implementation from sn19

  dylanuys

  committed
  49aaa89

  Copy full SHA for 49aaa89

• inital self heal script from sn19

  dylanuys

  committed
  9928fea

  Copy full SHA for 9928fea

• Flag for downloading annotations from HuggingFace

  aliang322

  committed
  1244f3d

  Copy full SHA for 1244f3d

• fixing reference to self.config

  dylanuys

  committed
  07f31e5

  Copy full SHA for 07f31e5

• Enforcing no watermarking in all cases

  aliang322

  committed
  0ab534b

  Copy full SHA for 0ab534b

• self heal in autoupdate script

  dylanuys

  committed
  4b32e19

  Copy full SHA for 4b32e19

• making autoupdate scripts executable

  dylanuys

  committed
  913a6d7

  Copy full SHA for 913a6d7

• self heal restart 6 -> 6.5

  dylanuys

  committed
  2925e1f

  Copy full SHA for 2925e1f

• Merge branch 'qol-improvements' of github.com:BitMind-AI/bitmind-subnet into qol-improvements

  dylanuys

  committed
  b02a60f

  Copy full SHA for b02a60f

• typo

  dylanuys

  committed
  2e0cf8a

  Copy full SHA for 2e0cf8a

• Merge branch 'qol-improvements' of github.com:BitMind-AI/bitmind-subnet into qol-improvements

  dylanuys

  committed
  3d75478

  Copy full SHA for 3d75478

Commits on Aug 16, 2024

• allowing --no-auto-update and --no-self-heal for validators

  dylanuys

  committed
  a98abec

  Copy full SHA for a98abec

• combining run scripts into run_neuron.py

  dylanuys

  committed
  14dd4d8

  Copy full SHA for 14dd4d8

• replacing neuron type with --validator and --miner

  dylanuys

  committed
  6a373db

  Copy full SHA for 6a373db

• documentation updates for new run script

  dylanuys

  committed
  3e2913a

  Copy full SHA for 3e2913a

• docs update

  dylanuys

  committed
  2616c59

  Copy full SHA for 2616c59

• adding wandb to docs

  dylanuys

  committed
  e721e15

  Copy full SHA for e721e15

• Arg for skipping annotation generation

  aliang322

  committed
  2cd32bd

  Copy full SHA for 2cd32bd

• Prompt truncation for annotations longer than max token length

  aliang322

  committed
  041d139

  Copy full SHA for 041d139

• Suppress token max exceeded warning, cleaned up error logging

  aliang322

  committed
  ad78c36

  Copy full SHA for ad78c36

• Removed all tqdm loading bars, cleaned imports, updated fake dataset paths to parquet versions.

  benliang99

  committed
  adc77af

  Copy full SHA for adc77af

• Merge

  benliang99

  committed
  cd343b8

  Copy full SHA for cd343b8

• Improved annotation cleanliness with inter-prompt spacing and stripped endings.

  aliang322

  committed
  0f298cd

  Copy full SHA for 0f298cd

• Merge branch 'synthetic_image_gen_updates' of https://github.com/BitMind-AI/bitmind-subnet into synthetic_image_gen_updates

  aliang322

  committed
  f813e15

  Copy full SHA for f813e15

• removing fixtures reference from mock.py

  dylanuys

  committed
  ef7df05

  Copy full SHA for ef7df05

• read btcli args from .env

  dylanuys

  committed
  56d37a8

  Copy full SHA for 56d37a8

• docs update

  dylanuys

  committed
  4c914c3

  Copy full SHA for 4c914c3

• Formatting

  dylanuys

  committed
  5a4e9e8

  Copy full SHA for 5a4e9e8

• fixing fixtures import

  dylanuys

  committed
  9f2e02f

  Copy full SHA for 9f2e02f

• adding .env file creation to install script

  dylanuys

  committed
  4320780

  Copy full SHA for 4320780

• moving network (test/finney) into .env, reducing script redundancy

  dylanuys

  committed
  2e4fed1

  Copy full SHA for 2e4fed1

• missing netuid arg for MockSubtensor/MockMetagraph inits in test

  dylanuys

  committed
  7ebcf77

  Copy full SHA for 7ebcf77

• adding .env to .gitignore

  dylanuys

  committed
  2843489

  Copy full SHA for 2843489

• AXON_PORT -> MINER_AXON_PORT env var rename

  dylanuys

  committed
  dd918d8

  Copy full SHA for dd918d8

• docs updates to reflect latest run_neuron.py updates

  dylanuys

  committed
  c02b562

  Copy full SHA for c02b562

• updating .env paths

  dylanuys

  committed
  5282cdd

  Copy full SHA for 5282cdd

• small docs update

  dylanuys

  committed
  05a7ae0

  Copy full SHA for 05a7ae0

• Fixed annotation json filenames not starting with start_idx arg

  aliang322

  committed
  628f040

  Copy full SHA for 628f040

• Merge pull request #44 from BitMind-AI/qol-improvements

  Show description for 0bc4e01
  dylanuys

  authored
  0bc4e01

  Copy full SHA for 0bc4e01

• locking down version numbers

  dylanuys

  committed
  9d93ffa

  Copy full SHA for 9d93ffa

• Added docstrings and comments

  aliang322

  committed
  3c54e64

  Copy full SHA for 3c54e64

Commits on Aug 17, 2024

• fixing image_index field for wanbd logging

  dylanuys

  committed
  7ca62eb

  Copy full SHA for 7ca62eb

• try except for wandb init

  dylanuys

  committed
  3161a97

  Copy full SHA for 3161a97

• adding retries for nan images

  dylanuys

  committed
  46c572e

  Copy full SHA for 46c572e

Commits on Aug 18, 2024

• fixing image isnan check by adding np.any

  dylanuys

  committed
  3eb7ad6

  Copy full SHA for 3eb7ad6

Commits on Aug 19, 2024

• Merged synthetic image gen updates with testnet

  benliang99

  committed
  6429e39

  Copy full SHA for 6429e39

• rename wandb fields *image_id -> *image_name

  dylanuys

  committed
  981bb16

  Copy full SHA for 981bb16

• Merge pull request #46 from BitMind-AI/requirements-updates

  Show description for 3dcf25d
  dylanuys

  authored
  3dcf25d

  Copy full SHA for 3dcf25d

• Merge pull request #47 from BitMind-AI/vali-fwd-resampling

  Show description for edf05fa
  dylanuys

  authored
  edf05fa

  Copy full SHA for edf05fa

• Updated failure case for generating annotations.

  benliang99

  committed
  3a0fedf

  Copy full SHA for 3a0fedf

• Adjusted TF logging level to include error messages. Cleaned up unnecessary imports. Simplified clear_gpu to not moving tensor to CPU.

  benliang99

  committed
  55a659f

  Copy full SHA for 55a659f

• Reverted deletion of necessary diffusion pipeline imports. Adjusted TF logging level in dataset generation script to be consistent with synthetic generation classes.

  benliang99

  committed
  80c3f83

  Copy full SHA for 80c3f83

• Merge pull request #45 from BitMind-AI/synthetic_image_gen_updates

  Show description for c5ee3aa
  benliang99

  authored
  c5ee3aa

  Copy full SHA for c5ee3aa

• adding a sleep to reduce metagraph resync freq

  dylanuys

  committed
  e75c0b5

  Copy full SHA for e75c0b5

• fixing edge case that occurs when only 1 miner has nonzero weight

  dylanuys

  committed
  445e822

  Copy full SHA for 445e822

• Merge pull request #49 from BitMind-AI/fix-weight-setting-edgecase

  Show description for dde6556
  dylanuys

  authored
  dde6556

  Copy full SHA for dde6556

• bump version to 1.0.2

  dylanuys

  authored
  079e461

  Copy full SHA for 079e461

• fixing download_data extension

  dylanuys

  committed
  deca46a

  Copy full SHA for deca46a

• Merge pull request #51 from BitMind-AI/script-extension-fix

  Show description for ae68510
  dylanuys

  authored
  ae68510

  Copy full SHA for ae68510

• Update fake dataset paths

  benliang99

  authored
  27bf00b

  Copy full SHA for 27bf00b

• Merge pull request #52 from BitMind-AI/update-dataset-paths

  Show description for 5d7669c
  dylanuys

  authored
  5d7669c

  Copy full SHA for 5d7669c

• replacing conda activate with /home/user/mambaforge/envs/tensorml

  dylanuys

  committed
  bb60523

  Copy full SHA for bb60523

• Merge pull request #53 from BitMind-AI/autoupdate-conda-prefix

  Show description for e4b2f5b
  benliang99

  authored
  e4b2f5b

  Copy full SHA for e4b2f5b

• resolving merge conflicts

  dylanuys

  committed
  828e59f

  Copy full SHA for 828e59f