Repositories list

• AP5

  Public
  Shell

  •0•2•0•0•Updated Oct 10, 2024Oct 10, 2024

• lm-evaluation-harness

  Public
  A framework for few-shot evaluation of autoregressive language models.

  Python

  •

  MIT License

  •1.8k•9•29•8•Updated Oct 8, 2024Oct 8, 2024

• adult_content_classifier

  Public
  Python

  •0•0•0•0•Updated Oct 7, 2024Oct 7, 2024

• Megatron-LM

  Public
  Ongoing research training transformer models at scale

  Python

  •

  Other

  •2.3k•4•0•1•Updated Aug 29, 2024Aug 29, 2024

• aqua

  Public
  viz framework for data quality introspection

  Jupyter Notebook

  •1•1•0•0•Updated Apr 14, 2024Apr 14, 2024

• illuminer

  Public
  Python

  •

  Apache License 2.0

  •1•6•0•0•Updated Mar 28, 2024Mar 28, 2024

• docs

  Public
  Documentation for platform users

  Jupyter Notebook

  •0•0•0•1•Updated Oct 5, 2023Oct 5, 2023

• DeepSpeed

  Public
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Python

  •

  MIT License

  •4.1k•0•0•2•Updated Jul 13, 2023Jul 13, 2023

• llama

  Public
  Inference code for LLaMA models

  Python

  •

  GNU General Public License v3.0

  •9.5k•0•0•0•Updated Apr 20, 2023Apr 20, 2023

• olm-datasets

  Public
  Pipeline for pulling and processing online language model pretraining data from the web

  Python

  •

  Apache License 2.0

  •23•0•7•1•Updated Feb 23, 2023Feb 23, 2023

• data-preparation

  Public
  Code used for sourcing and cleaning data within the olm-datasets repo

  Jupyter Notebook

  •

  Apache License 2.0

  •40•0•0•0•Updated Feb 23, 2023Feb 23, 2023

• data-pipeline-testing

  Public
  For testing executing existing data pipelines

  0•0•0•0•Updated Jan 15, 2023Jan 15, 2023

• docker-images

  Public
  Dockerfile

  •0•0•0•1•Updated Dec 6, 2022Dec 6, 2022

• spark-history-server-controller

  Public
  Go

  •0•0•0•0•Updated Sep 12, 2022Sep 12, 2022

• spark-history-server

  Public
  Mustache

  •0•0•0•0•Updated Jun 14, 2022Jun 14, 2022