multi-token
/

shiftedattn-9-21-qwen25coder-instr-from-scratch-n64w8-lr1-e6

Model card Files Files and versions

shiftedattn-9-21-qwen25coder-instr-from-scratch-n64w8-lr1-e6 / global_step43000

91.4 GB

1 contributor

History: 1 commit

This model has 1 file scanned as unsafe.

Snyhlxde's picture

upload model

d4fafc4 3 months ago

.gitattributes

644 Bytes

upload model 3 months ago
bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.Tensor",
- "torch._tensor._rebuild_from_type_v2",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
22.8 GB
xet

upload model 3 months ago
bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "torch.FloatStorage",
- "torch.Tensor",
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum",
- "torch._tensor._rebuild_from_type_v2",
- "collections.OrderedDict"
How to fix it?
22.8 GB
xet

upload model 3 months ago
bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.Tensor",
- "torch._tensor._rebuild_from_type_v2",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
22.8 GB
xet

upload model 3 months ago
bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt
Detected Pickle imports (7)
- "deepspeed.runtime.fp16.loss_scaler.LossScaler",
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch.Tensor",
- "torch._tensor._rebuild_from_type_v2",
- "torch._utils._rebuild_tensor_v2",
- "deepspeed.runtime.zero.config.ZeroStageEnum"
How to fix it?
22.8 GB
xet

upload model 3 months ago
zero_pp_rank_0_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "torch.Size",
- "collections.OrderedDict",
- "__builtin__.set"
How to fix it?
174 kB
xet

upload model 3 months ago
zero_pp_rank_1_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "torch.Size",
- "collections.OrderedDict",
- "__builtin__.set"
How to fix it?
174 kB
xet

upload model 3 months ago
zero_pp_rank_2_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "torch.Size",
- "collections.OrderedDict",
- "__builtin__.set"
How to fix it?
174 kB
xet

upload model 3 months ago
zero_pp_rank_3_mp_rank_00_model_states.pt
Detected Pickle imports (5)
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "torch.Size",
- "collections.OrderedDict",
- "__builtin__.set"
How to fix it?
174 kB
xet

upload model 3 months ago