from transformers import BertTokenizer model = BertForSeq2Seq.from_pretrained("bert-base") outputs = model.generate(input_ids, max_length=128) bleu = corpus_bleu(refs, hyps) # ~85
BERTlingo
English-to-German translation using fine-tuned Transformer models with multi-head attention. Evaluated with BLEU score ~85.
View on GitHub →