Skip to content

@stanford-crfm Stanford Center for Research on Foundation Models

Change the repository type filter

All

    Repositories list

    19 repositories

    • helm

      Public
      Holistic Evaluation of Language Models (HELM), a framework to increase the transparency of language models (https://arxiv.org/abs/2211.09110). This framework is also used to evaluate text-to-image models in HEIM (https://arxiv.org/abs/2311.04287) and vision-language models in VHELM (https://arxiv.org/abs/2410.07112).
      Python
      •
      Apache License 2.0
      •248•1.9k•108•14•Updated Nov 12, 2024Nov 12, 2024

    • levanter

      Public
      Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
      Python
      •
      Apache License 2.0
      •81•516•81•10•Updated Nov 12, 2024Nov 12, 2024

    • haliax

      Public
      Named Tensors for Legible Deep Learning in JAX
      Python
      •
      Apache License 2.0
      •11•153•21•3•Updated Nov 6, 2024Nov 6, 2024

    • ecosystem-graphs

      Public
      JavaScript
      •35•258•21•18•Updated Oct 10, 2024Oct 10, 2024

    • air-bench-2024

      Public
      AIR-Bench 2024 is a safety benchmark that aligns with emerging government regulations and company policies
      Jupyter Notebook
      •
      Apache License 2.0
      •1•7•0•0•Updated Aug 14, 2024Aug 14, 2024

    • image2struct

      Public
      A Benchmark for Evaluating Vision-Language Models in extracting Structured Information from Images
      Python
      •
      Apache License 2.0
      •0•2•0•0•Updated Aug 2, 2024Aug 2, 2024

    • fmti

      Public
      The Foundation Model Transparency Index
      Creative Commons Attribution 4.0 International
      •8•71•0•1•Updated May 23, 2024May 23, 2024

    • data-overlap

      Public
      Python
      •0•5•0•0•Updated Mar 27, 2024Mar 27, 2024

    • helm-efficiency

      Public
      Jupyter Notebook
      •0•9•0•0•Updated Dec 12, 2023Dec 12, 2023

    • halie

      Public
      HTML
      •
      Apache License 2.0
      •2•13•0•0•Updated Dec 11, 2023Dec 11, 2023

    • mistral

      Public
      Mistral: A strong, northwesterly wind: Framework for transparent and accessible large-scale language model training, built with Hugging Face 🤗 Transformers.
      Python
      •
      Apache License 2.0
      •49•562•18•3•Updated Nov 10, 2023Nov 10, 2023

    • mosaicml-benchmarks

      Public
      Fast and flexible reference benchmarks
      Python
      •
      Apache License 2.0
      •124•0•0•1•Updated Oct 27, 2023Oct 27, 2023

    • EUAIActJune15

      Public
      Stanford CRFM's initiative to assess potential compliance with the draft EU AI Act
      MIT License
      •7•92•1•0•Updated Oct 18, 2023Oct 18, 2023

    • BioMedLM

      Public
      Python
      •64•607•21•2•Updated Aug 20, 2023Aug 20, 2023

    • transformers_fsdp_checkpoint_fix

      Public
      🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      •
      Apache License 2.0
      •27k•1•0•0•Updated Jul 31, 2023Jul 31, 2023

    • composer

      Public
      Composing methods for ML training efficiency
      Python
      •
      Apache License 2.0
      •419•1•0•0•Updated Sep 23, 2022Sep 23, 2022

    • sprucfluo

      Public
      Data streaming for LMs. WIP
      Python
      •
      Apache License 2.0
      •1•3•0•0•Updated May 10, 2022May 10, 2022

    • transformers

      Public
      🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
      Python
      •
      Apache License 2.0
      •27k•5•1•0•Updated Sep 28, 2021Sep 28, 2021

    • janus

      Public
      A Streamlit interface that's a doorway into GPT-X.
      Python
      •1•2•0•1•Updated May 23, 2021May 23, 2021