baidu
/

ERNIE-4.5-VL-424B-A47B-Base-PT

Image-Text-to-Text

ernie4_5_moe_vl

feature-extraction

Model card Files Files and versions

liaojc commited on Jul 10

Commit

6030ee1

·

verified ·

1 Parent(s): 741bf15

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -37,7 +37,7 @@
   "freq_allocation": 20,
   "spatial_conv_size": 2,
   "temporal_conv_size": 2,
-  "moe_use_aux_free": false,
   "moe_num_experts": [64, 64],
   "moe_intermediate_size": [3584, 1536],
   "torch_dtype": "bfloat16",

   "freq_allocation": 20,
   "spatial_conv_size": 2,
   "temporal_conv_size": 2,
+  "moe_use_aux_free": true,
   "moe_num_experts": [64, 64],
   "moe_intermediate_size": [3584, 1536],
   "torch_dtype": "bfloat16",