Cyber Security Glossary

A form of  AI  that utilizes  deep learning  algorithms to create models (see  machine learning model ) pre-trained on massive text datasets for the general purpose of language learning to analyze and learn patterns and relationships among characters, words and phrases. There are generally two types of LLMs: generative models that make text predictions based on the probabilities of word sequences learned from its training data (see  generative AI ) and discriminative models that make classification predictions based on probabilities of data features and weights learned from its training data (see  discriminative model ). The term "large" generally refers to the model's capacity measured by the number of  parameters  and to the enormous datasets that it is trained on.