[Not Issue] Will you try MOE like Mixtral-8X7B? #25

Open

Open

[Not Issue] Will you try MOE like Mixtral-8X7B?#25

Since there are 4 experts adaptors using lora SFT in the paper, the next question is why not try MOE like Mixtral-8X7B?

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests