🤏 TinyMoE Playground

Chat with three flavours of the TinyMoE-100m (2×8 experts) model, hosted on ZeroGPU.

The Chat variant was actually chat-tuned — talk to it normally. The two base models were only pretrained, so they will just continue whatever text they see (they won't follow instructions reliably).

Settings

Model

Chat-tuned. Use the chat UI normally.

16 1024
0 2
0.05 1
0.8 1.5

Chat


Models: chat-stage1 · retrained (base) · original (base) · Runs on 🤗 ZeroGPU.