Understanding LLMs: A Comprehensive Overview from Training to Inference
Paper
•
2401.02038
•
Published
•
66
LLM Related
💫 Glossary https://osanseviero.github.io/hackerllama/blog/posts/hitchhiker_guide/
Note 📰 Two-stage LLM Fine-tuning with Less Specialization and More Generalization https://arxiv.org/abs/2211.00635
-
Learning To Teach Large Language Models Logical Reasoning
Paper • 2310.09158 • Published • 1 -
ChipNeMo: Domain-Adapted LLMs for Chip Design
Paper • 2311.00176 • Published • 9 -
WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct
Paper • 2308.09583 • Published • 7 -
WizardCoder: Empowering Code Large Language Models with Evol-Instruct
Paper • 2306.08568 • Published • 28
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
Paper • 2201.11903 • Published • 14Note 🔥🔥🔥
-
Ensemble-Instruct: Generating Instruction-Tuning Data with a Heterogeneous Mixture of LMs
Paper • 2310.13961 • Published • 5
In-context Continual Learning Assisted by an External Continual Learner
Paper • 2412.15563 • PublishedNote In-context class-incremental learning (CIL): A simple method to apply in-context learning to CIL is to incrementally add few-shot training examples for each new class to the in-context prompt. Query ➡️ (tag generation) | (summaries of similar tags/classes) | (add summaries as few-shot examples to prompt) | (llm) ➡️ Predicted class Shorter prompts , fast inference
-
Skeleton-of-Thought: Large Language Models Can Do Parallel Decoding
Paper • 2307.15337 • Published • 38 -
Cost-Effective Hyperparameter Optimization for Large Language Model Generation Inference
Paper • 2303.04673 • Published -
Magicoder: Source Code Is All You Need
Paper • 2312.02120 • Published • 82 -
Scaling Data-Constrained Language Models
Paper • 2305.16264 • Published • 17 -
Adapting Large Language Models via Reading Comprehension
Paper • 2309.09530 • Published • 80 -
LLM360: Towards Fully Transparent Open-Source LLMs
Paper • 2312.06550 • Published • 57 -
Context Tuning for Retrieval Augmented Generation
Paper • 2312.05708 • Published • 16 -
MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models
Paper • 2309.12284 • Published • 18 -
OpenChat: Advancing Open-source Language Models with Mixed-Quality Data
Paper • 2309.11235 • Published • 15 -
A Challenger to GPT-4V? Early Explorations of Gemini in Visual Expertise
Paper • 2312.12436 • Published • 15 -
A Vision Check-up for Language Models
Paper • 2401.01862 • Published • 11 -
WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on Wikipedia
Paper • 2305.14292 • Published -
Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffolding
Paper • 2401.12954 • Published • 34 -
MM-LLMs: Recent Advances in MultiModal Large Language Models
Paper • 2401.13601 • Published • 49 -
DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence
Paper • 2401.14196 • Published • 66 -
Sketch-Guided Constrained Decoding for Boosting Blackbox Large Language Models without Logit Access
Paper • 2401.09967 • Published • 1 -
The FinBen: An Holistic Financial Benchmark for Large Language Models
Paper • 2402.12659 • Published • 22 -
Evaluating Very Long-Term Conversational Memory of LLM Agents
Paper • 2402.17753 • Published • 20 -
Design2Code: How Far Are We From Automating Front-End Engineering?
Paper • 2403.03163 • Published • 99 -
RAFT: Adapting Language Model to Domain Specific RAG
Paper • 2403.10131 • Published • 73 -
Large Language Models as Markov Chains
Paper • 2410.02724 • Published • 34