MiniLLM/MiniLLM-gpt2-340M
Text Generation • Updated • 2.11k • 6
AI & ML interests
Training efficient language models (MiniLLM, MiniPLM)
MiniLLM/SFT-gpt2-120M
Text Generation • 0.1B • Updated • 2.32k
MiniLLM/SFT-gpt2-760M
Text Generation • 0.8B • Updated • 22
MiniLLM/MiniPLM-Qwen-500M
Text Generation • 0.5B • Updated • 84 • 7
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • 0.2B • Updated • 9 • 6
MiniLLM/MiniPLM-Mamba-130M
Text Generation • 0.1B • Updated • 17 • 3
MiniLLM/MiniPLM-Qwen-1.2B
Text Generation • 1B • Updated • 209 • 4
MiniLLM/Ref-Pretrain-Qwen-104M
Text Generation • 0.1B • Updated • 15 • 2
MiniLLM/Pretrain-Qwen-1.2B
Text Generation • 1B • Updated • 7
MiniLLM/Pretrain-Qwen-500M
Text Generation • 0.5B • Updated • 13
MiniLLM/Pretrain-Qwen-200M
Text Generation • 0.2B • Updated • 27
MiniLLM/VanillaKD-Pretrain-Qwen-200M
Text Generation • 0.2B • Updated • 5
MiniLLM/VanillaKD-Pretrain-Qwen-500M
Text Generation • 0.5B • Updated • 16
MiniLLM/VanillaKD-Pretrain-Qwen-1.2B
Text Generation • 1B • Updated • 10
MiniLLM/init-gpt2-120M
Text Generation • 0.1B • Updated • 587 • 1
MiniLLM/teacher-Llama-13B
Text Generation • Updated • 9
MiniLLM/MiniLLM-Llama-7B
Text Generation • Updated • 23 • 3
MiniLLM/MiniPLM-Qwen-200M
Text Generation • 0.2B • Updated • 289 • 9
MiniLLM/init-Llama-7B
Text Generation • Updated • 15
MiniLLM/teacher-OPT-13B
Text Generation • Updated • 16
MiniLLM/SeqKD-Llama-7B
Text Generation • Updated • 8
MiniLLM/KD-Llama-7B
Text Generation • Updated • 9
MiniLLM/SFT-Llama-7B
Text Generation • Updated • 10
MiniLLM/init-OPT-6.7B
Text Generation • Updated • 19
MiniLLM/init-OPT-2.7B
Text Generation • Updated • 24
MiniLLM/init-OPT-1.3B
Text Generation • Updated • 24
MiniLLM/SeqKD-OPT-6.7B
Text Generation • Updated • 17
MiniLLM/SeqKD-OPT-2.7B
Text Generation • Updated • 16
MiniLLM/SeqKD-OPT-1.3B
Text Generation • Updated • 16
MiniLLM/KD-OPT-6.7B
Text Generation • Updated • 15