Can I use AutoModelForSequenceClassification?

[cristobalmackenzie]

Hi ! I've been looking at examples and I'm not sure if I can use AutoModelForSequenceClassification, and if so, how exactly to format the dataset. I'm assuming I can use a "text" and "label" dataset like in HuggingFace examples, but I'm not sure if this is supported.

Only mention of SequenceClassification I've found so far is this.

Thanks!

[NanoCode012]

Hey, I apologize for the late message. I'm answering this for any future readers.

The current code base is written around AutoModelForCausalLM. Unfortunately, we still don't have support for AutoModelForSequenceClassification.