points by roryirvine 3 days ago | 0 comments
Am I the only one to feel sad that the name means "Enhanced Representation through kNowledge IntEgration", rather than being a homage to a very famous 1950s random number generator?
[–] jojogeo 3 days ago
[–] cubefox 3 days ago
It's a homage to BERT (Bidirectional Encoder Representations from Transformers), Google's influential 2018 Transformer model that wasn't autoregressive. https://arxiv.org/abs/1810.04805v2
How do I look Ernie? ... with your eyes, Bert.