cloudyu
/

4bit_quant_TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO

Text Generation

Mixture of Experts

text-generation-inference

4-bit precision

Model card Files Files and versions

cloudyu commited on Feb 4, 2024

Commit

3172852

·

verified ·

1 Parent(s): 9c76421

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -15,5 +15,5 @@ DPO Trainer
 TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
    ```
 Metrics
-![Metrics](https://huggingface.co/cloudyu/4bit_quant_TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO/blob/main/4bit.vs.16.jpg)

 TRL supports the DPO Trainer for training language models from preference data, as described in the paper Direct Preference Optimization: Your Language Model is Secretly a Reward Model by Rafailov et al., 2023.
    ```
 Metrics
+![Metrics](4bit.vs.16.jpg)