Skip to content
@TsinghuaC3I

TsinghuaC3I

Center for Collaborative & Conversational Intelligence at Tsinghua University

The Center for Collaborative & Conversational Intelligence (C3I) is affiliated with the Department of Electronic Engineering at Tsinghua University and is led by Professor Bowen Zhou.

Our research objectives are as follows:

  1. Specialization and Alignment of Foundation Models: This involves in-depth research on the architecture design, training, and alignment of foundation models, exploring specialization in reasoning.
  2. Multi-Dimensional Collaborative Research: Based on a cognitive collaboration framework incorporating both System 1 and System 2, this area explores collaboration between large and small models, multimodal collaboration, and human-machine collaboration. It also investigates the interpretable mechanisms of neurodynamics and theories of sustainable hybrid human-machine intelligence.
  3. Application Development for Scientific Discovery: Focused on the biomedical field, this research utilizes collaborative interaction technologies to drive knowledge innovation and promote scientific discoveries and technological advancements.

Popular repositories Loading

  1. SoRA SoRA Public

    The source code of the EMNLP 2023 main conference paper: Sparse Low-rank Adaptation of Pre-trained Language Models.

    Python 69 9

  2. UltraMedical UltraMedical Public

    [NeurIPS 2024 D&B Track, Spotlight] UltraMedical: Building Specialized Generalists in Biomedicine

    Python 58 1

  3. Intuitive-Fine-Tuning Intuitive-Fine-Tuning Public

    Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process

    Python 22

  4. LLM4BioHypoGen LLM4BioHypoGen Public

    [COLM 2024] Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation

    Python 11

  5. FS-GEN FS-GEN Public

    Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding.

    Python 10 2

  6. CRaSh CRaSh Public

    The source code of the EMNLP 2023 main conference paper: "CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model."

    Python 4

Repositories

Showing 9 of 9 repositories
  • LPA Public

    [EMNLP 2024, Main Confernece] Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention

    TsinghuaC3I/LPA’s past year of commit activity
    Python 4 0 0 0 Updated Nov 5, 2024
  • UltraMedical Public

    [NeurIPS 2024 D&B Track, Spotlight] UltraMedical: Building Specialized Generalists in Biomedicine

    TsinghuaC3I/UltraMedical’s past year of commit activity
    Python 58 1 0 0 Updated Sep 26, 2024
  • CRaSh Public

    The source code of the EMNLP 2023 main conference paper: "CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model."

    TsinghuaC3I/CRaSh’s past year of commit activity
    Python 4 0 1 0 Updated Aug 26, 2024
  • CoGenesis Public

    CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following. ACL@2024 Main Conference

    TsinghuaC3I/CoGenesis’s past year of commit activity
    Python 4 0 1 0 Updated Aug 7, 2024
  • Intuitive-Fine-Tuning Public

    Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process

    TsinghuaC3I/Intuitive-Fine-Tuning’s past year of commit activity
    Python 22 0 2 0 Updated Aug 2, 2024
  • LLM4BioHypoGen Public

    [COLM 2024] Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation

    TsinghuaC3I/LLM4BioHypoGen’s past year of commit activity
    Python 11 0 1 0 Updated Jul 15, 2024
  • FS-GEN Public

    Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding.

    TsinghuaC3I/FS-GEN’s past year of commit activity
    Python 10 2 1 0 Updated Jun 19, 2024
  • .github Public
    TsinghuaC3I/.github’s past year of commit activity
    0 0 0 0 Updated Apr 27, 2024
  • SoRA Public

    The source code of the EMNLP 2023 main conference paper: Sparse Low-rank Adaptation of Pre-trained Language Models.

    TsinghuaC3I/SoRA’s past year of commit activity
    Python 69 9 8 0 Updated Mar 5, 2024

Top languages

Loading…

Most used topics

Loading…