Qwen3.6-27B Zero
ðŸ§
2
Chat with a high‑capability AI assistant in real time
specimba
specimba
AI & ML interests
None yet
Recent Activity
liked a Space about 15 hours ago
artificialguybr/Qwen3.6-27B-zero liked a model about 15 hours ago
mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-GGUF liked a model about 15 hours ago
pthinc/Cicikus-v3-1.4B-Opus4.6-PoweredOrganizations
liked a
Space about 15 hours ago
liked 6
models about 15 hours ago
mradermacher/Cicikus-v3-1.4B-Opus4.6-Powered-GGUF
1B • Updated • 459 • 1
pthinc/Cicikus-v3-1.4B-Opus4.6-Powered
Text Generation • 1B • Updated • 37 • 3
pthinc/cicikus_v4_tombis
Text Generation • 8B • Updated • 552 • 1
morikomorizz/GRM-2.6-Primal-GGUF
Image-Text-to-Text • 27B • Updated • 772 • 1
morikomorizz/GRM-2.6-Plus-Primal
Image-Text-to-Text • 27B • Updated • 728 • 4
mradermacher/Darwin-35B-A3B-Opus-GGUF
35B • Updated • 1.39k • 16
liked 3
models about 17 hours ago
liked a
Space about 17 hours ago
upvoted a paper about 17 hours ago
reacted to qgallouedec's post with 🤗 about 19 hours ago
Post
274
**TRL v1.4 is out 🚀** Chunked NLL loss for SFT and a first-class **OpenReward** integration.
**Chunked NLL loss for SFT — drops peak VRAM by up to 14×**
Standard SFT materializes a full
Peak GPU memory, AdamW fp32:
- Qwen3-14B, 8×H100 FSDP2, 16k seq: 58.9 GB → 38.9 GB
- Qwen3-4B, 1×H100 80GB, 16k seq: OOM → 63.8 GB
- Qwen3-32B, 8×H100 FSDP2, 8k seq: OOM → 71.2 GB
End-to-end it's consistently as fast or faster than
Works with PEFT and VLMs out of the box.
**Open Reward Standard environment adapter**
The new
v1.4 also brings MFU helpers for dense + MoE models, GRPO support for Liger 0.8.0 (delta clipping + VESPO + KL bias correction), Tülu 3's length-normalized DPO loss, four more training chat templates (Cohere, Cohere2, Gemma 3, Qwen3-2507), and a 5+ GB CUDA memory leak fix in activation offloading.
Full release notes: https://github.com/huggingface/trl/releases/tag/v1.4.0
**Chunked NLL loss for SFT — drops peak VRAM by up to 14×**
Standard SFT materializes a full
[batch × seq × vocab] logits tensor before computing cross-entropy, which dominates peak memory at long context lengths. The new loss_type="chunked_nll" path drops ignored-label tokens before the lm_head matmul and computes cross-entropy in checkpointed chunks of 256.Peak GPU memory, AdamW fp32:
- Qwen3-14B, 8×H100 FSDP2, 16k seq: 58.9 GB → 38.9 GB
- Qwen3-4B, 1×H100 80GB, 16k seq: OOM → 63.8 GB
- Qwen3-32B, 8×H100 FSDP2, 8k seq: OOM → 71.2 GB
End-to-end it's consistently as fast or faster than
nll, and unlocks sequence lengths that don't fit at all under the standard path.SFTConfig(loss_type="chunked_nll")Works with PEFT and VLMs out of the box.
**Open Reward Standard environment adapter**
The new
trl.experimental.openreward adapter plugs any environment speaking the [Open Reward Standard](https://openrewardstandard.io) protocol into any TRL trainer that takes an environment_factory. One string — a catalog name or a URL — wires the dataset, factory, and reward_func slots; tools are bound dynamically from JSON Schema, no per-env wrapper code:from trl import GRPOTrainer
from trl.experimental.openreward import OpenRewardSpec
spec = OpenRewardSpec("Eigent/SETA", num_tasks=64)
trainer = GRPOTrainer(
...,
train_dataset=spec.train_dataset,
environment_factory=spec.environment_factory,
reward_funcs=spec.reward_funcs,
)v1.4 also brings MFU helpers for dense + MoE models, GRPO support for Liger 0.8.0 (delta clipping + VESPO + KL bias correction), Tülu 3's length-normalized DPO loss, four more training chat templates (Cohere, Cohere2, Gemma 3, Qwen3-2507), and a 5+ GB CUDA memory leak fix in activation offloading.
Full release notes: https://github.com/huggingface/trl/releases/tag/v1.4.0
liked a
Space about 19 hours ago
liked 4
models about 19 hours ago
liked a
Space 1 day ago
updated a
Space 1 day ago