Repositories list

• LPA

  Public
  [EMNLP 2024, Main Confernece] Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention

  Python

  •0•4•0•0•Updated Nov 5, 2024Nov 5, 2024

• UltraMedical

  Public
  [NeurIPS 2024 D&B Track, Spotlight] UltraMedical: Building Specialized Generalists in Biomedicine

  Python

  •1•59•0•0•Updated Sep 26, 2024Sep 26, 2024

• CRaSh

  Public
  The source code of the EMNLP 2023 main conference paper: "CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model."

  Python

  •0•4•1•0•Updated Aug 26, 2024Aug 26, 2024

• CoGenesis

  Public
  CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following. ACL@2024 Main Conference

  Python

  •0•4•1•0•Updated Aug 7, 2024Aug 7, 2024

• Intuitive-Fine-Tuning

  Public
  Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process

  Python

  •0•22•2•0•Updated Aug 2, 2024Aug 2, 2024

• LLM4BioHypoGen

  Public
  [COLM 2024] Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation

  Python

  •0•11•1•0•Updated Jul 15, 2024Jul 15, 2024

• FS-GEN

  Public
  Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding.

  Python

  •2•10•1•0•Updated Jun 19, 2024Jun 19, 2024

• .github

  Public
  0•0•0•0•Updated Apr 27, 2024Apr 27, 2024

• SoRA

  Public
  The source code of the EMNLP 2023 main conference paper: Sparse Low-rank Adaptation of Pre-trained Language Models.

  Python

  •9•69•8•0•Updated Mar 5, 2024Mar 5, 2024