Syntax. Linguists like to argue. Phrase-structure grammars, transformational syntax, X-bar theory, principles and parameters, government and binding, GPSG, HPSG, LFG ...
Perplexity. Perplexity is the probability of the test set (assigned by the language model), normalized by the number of words: Chain rule: For bigrams: