TL;DR A strong validation score settles part of the BERT vs RoBERTa decision. Before you ship an encoder, you also need to know whether its tokenizer handles the application’s inputs correctly and whether the model meets your latency and throughput targets. BERT and RoBERTa support many of the same NLP tasks, including sentence classification and […]