BERT is a 2018 language model from Google AI based on the company ... 100 million and 340 million total parameters. The LLM uses masked language modeling (MLM), in which ~15% of tokens are ...