Sampling during fine-tuning

[minqukanq]

Thank you for sharing such valuable papers and projects. I have learned that DRS and RPT are key drivers of strong performance.

Are DRS and RPT being applied during fine-tuning? I noticed that freq is being used, but I'm uncertain whether DRS is actually being applied. If there are any specific guidelines or code regarding sampling during fine-tuning, could you please point me to them?

I would like to apply DRS & RPT in fine-tuning as well.

I appreciate your help.