Phi-4-mini-moe-conversion / conversion_info.json

Initial upload of Phi-4-mini converted to MoE

6bea994 verified about 1 year ago

174 Bytes

{
  "conversion_info": {
    "source_model": "microsoft/Phi-4-mini-instruct",
    "num_experts": 8,
    "num_experts_per_token": 2,
    "expert_intermediate_size": 1024
  }
}

	{
	"conversion_info": {
	"source_model": "microsoft/Phi-4-mini-instruct",
	"num_experts": 8,
	"num_experts_per_token": 2,
	"expert_intermediate_size": 1024
	}
	}