LoRAShear: Efficient Large Language Model Structured Pruning and Knowledge Recovery
Paper
•
2310.18356
•
Published
•
24
Papers: PEFT
Papers related to parameter efficient finetuning methods.
-
-
LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Models
Paper • 2310.08659 • Published • 27 -
ModuLoRA: Finetuning 3-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers
Paper • 2309.16119 • Published • 1 -
QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models
Paper • 2309.14717 • Published • 45 -
LongLoRA: Efficient Fine-tuning of Long-Context Large Language Models
Paper • 2309.12307 • Published • 89 -
LoRA-FA: Memory-efficient Low-rank Adaptation for Large Language Models Fine-tuning
Paper • 2308.03303 • Published • 3 -
LoRAPrune: Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning
Paper • 2305.18403 • Published • 2 -
QLoRA: Efficient Finetuning of Quantized LLMs
Paper • 2305.14314 • Published • 58 -
Parameter-Efficient Fine-Tuning with Layer Pruning on Free-Text Sequence-to-Sequence Modeling
Paper • 2305.08285 • Published • 1 -
Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning
Paper • 2303.15647 • Published • 4 -
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning
Paper • 2205.05638 • Published • 6 -
LoRA: Low-Rank Adaptation of Large Language Models
Paper • 2106.09685 • Published • 56 -
DEFT: Data Efficient Fine-Tuning for Large Language Models via Unsupervised Core-Set Selection
Paper • 2310.16776 • Published -
S-LoRA: Serving Thousands of Concurrent LoRA Adapters
Paper • 2311.03285 • Published • 31 -
Punica: Multi-Tenant LoRA Serving
Paper • 2310.18547 • Published • 2 -
LoRA ensembles for large language model fine-tuning
Paper • 2310.00035 • Published • 2 -
A Rank Stabilization Scaling Factor for Fine-Tuning with LoRA
Paper • 2312.03732 • Published • 12 -
MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Models
Paper • 2402.12851 • Published • 2