CoPE is a drop-in enhancement of RoPE that delivers consistent gains within the training context and during long-context extrapoaltion.
Haoran Li PRO
haoranli-ml
·
AI & ML interests
ML, RL, Foundation Models
Recent Activity
updated
a dataset about 8 hours ago
haoranli-ml/genvf-prefixes-v1-qwen35-only-suffixes_final published
a dataset about 8 hours ago
haoranli-ml/genvf-prefixes-v1-qwen35-only-suffixes_final updated
a dataset about 21 hours ago
haoranli-ml/genvf-prefixes-v1-qwen35-only Organizations
models 30
haoranli-ml/genvf-v3
Updated
• 134
haoranli-ml/Llama-3-8B-HardClip-64k-Instruct
8B • Updated
• 2
haoranli-ml/Llama-3-8B-HardClip-64k-Base
8B • Updated
• 4
haoranli-ml/Llama-3-8B-RoPE-64k-Base
8B • Updated
• 1
haoranli-ml/Llama-3-8B-CoPE-64k-Base
8B • Updated
• 2
haoranli-ml/Llama-3-8B-CoPE-64k-Instruct
Text Generation • 8B • Updated
• 5
haoranli-ml/Llama-3-8B-RoPE-64k-Instruct
Text Generation • 8B • Updated
• 8
haoranli-ml/VF_future_prompts_hl_gauss_corrected_cdf_bin_012sigma_future_condition_1_18
Updated
haoranli-ml/VF_old_prompt_hl_gauss_corrected_cdf_bin_012sigma_reverse_kl_no_entropy
Updated
haoranli-ml/VF_future_prompts_hl_gauss_corrected_cdf_bin_012sigma_future_condition
Updated
datasets 103
haoranli-ml/genvf-prefixes-v1-qwen35-only-suffixes_final
Viewer
• Updated
• 24k
haoranli-ml/genvf-prefixes-v1-qwen35-only
Viewer
• Updated
• 6k • 3
haoranli-ml/genvf-prefixes-v1
Viewer
• Updated
• 12k • 6
haoranli-ml/genvf-train-mp-summarized
Viewer
• Updated
• 4.79k • 10
haoranli-ml/genvf-train-v0
Viewer
• Updated
• 8.1k • 20
haoranli-ml/genvf-prefixes-filtered
Viewer
• Updated
• 13.4k • 30
haoranli-ml/genvf_td_data
Viewer
• Updated
• 6.79k • 8
haoranli-ml/GVF-3k
Viewer
• Updated
• 3k • 39
haoranli-ml/genvf-v3-difficulty
Viewer
• Updated
• 13.8k • 20
haoranli-ml/genvf-v3-train-holdout-60-both_prefix
Viewer
• Updated
• 60 • 60