Intel
/

distilbert-base-uncased-squadv1.1-sparse-80-1X4-block

Question Answering

Model card Files Files and versions

Sparse DISTILBERT model (uncased)

Finetuned model pruned to 1:4 structured sparsity.

Intended Use

The model can be used for inference with sparsity optimization. For further details on the model and its usage will be soon available.

Evaluation Results

We get the following results on the SQuADv1.1 tasks development set:

Task	SQuADv1.1 (F1)
	87.00

Downloads last month: 13

Collection including Intel/distilbert-base-uncased-squadv1.1-sparse-80-1X4-block

DistilBERT

Smaller BERT models for question answering and text classification • 10 items • Updated Apr 16