shipslides
Languages31 slides0 views

Computational Linguistics

Computational linguistics is the discipline of making language tractable for machines — and, almost accidentally, of making machines that have changed what...

Standalone
Sandboxed deck
Open raw

About this deck

Computational linguistics is the discipline of making language tractable for machines — and, almost accidentally, of making machines that have changed what language is. Key sections include: Comp · Ling.; Opening What language is, to a computer.; Chapter I Shannon, 1948.; Chapter II The Chomsky hierarchy.; Chapter III The Georgetown experiment, ALPAC, the winter.; Chapter IV The Penn Treebank and the data turn.; Chapter V Hidden Markov models and the speech bridge.; Chapter VI Distributional semantics — the word as company.; Chapter VII Recurrent networks and the long-distance problem.; Chapter VIII "Attention is all you need.".

languagescomputationallinguistics
Slide outline
  1. 01Comp · Ling.
  2. 02Opening What language is, to a computer.
  3. 03Chapter I Shannon, 1948.
  4. 04Chapter II The Chomsky hierarchy.
  5. 05Chapter III The Georgetown experiment, ALPAC, the winter.
  6. 06Chapter IV The Penn Treebank and the data turn.
  7. 07Chapter V Hidden Markov models and the speech bridge.
  8. 08Chapter VI Distributional semantics — the word as company.
  9. 09Chapter VII Recurrent networks and the long-distance problem.
  10. 10Chapter VIII "Attention is all you need."
  11. 11Chapter IX The pre-training paradigm.
  12. 12Chapter X Tokens, subwords, and the unit problem.
  13. 13Chapter XI Kaplan, Chinchilla, and the laws of scale.
  14. 14Chapter XII Emergent capabilities.
  15. 15Chapter XIII What does the model know?
  16. 16Chapter XIV The multilingual question.
  17. 17Chapter XV Machine translation, finally.
  18. 18Chapter XVI Speech, voice, and audio language models.
  19. 19Chapter XVII Chain of thought, and reasoning as inference-time scaling.
  20. 20Chapter XVIII RLHF, instruction-tuning, and the alignment loop.
  21. 21Chapter XIX Agents and tool use.
  22. 22Chapter XX Programming languages as natural languages.
  23. 23Chapter XXI The LLM as a linguistic object.
  24. 24Chapter XXII The benchmark treadmill.
  25. 25Chapter XXIII Closed and open frontiers.
  26. 26Chapter XXIV What LLMs still can't do.
  27. 27Chapter XXV People worth knowing.
  28. 28Chapter XXVI Twenty-five works.
  29. 29Chapter XXVII Watch & read.
  30. 30Chapter XXVIII Where the field goes.
  31. 31The end of the deck.
Page data
Canonical
https://shipslides.com/d/languages-computational-linguistics
Category
Languages
Size
5.9 MB
Updated
2026-05-15
LLM text
https://shipslides.com/d/languages-computational-linguistics/llms.txt
Remove this deck