The 7 best arXiv papers to learn how LLMs work

The collection highlights influential papers that establish the theoretical and practical foundations of large language models, spanning Transformer architecture, pre-training, fine-tuning, transfer learning, scaling behavior, few-shot learning, reasoning, and evaluation. Foundational surveys provide broad overviews of the LLM lifecycle and compare model families such as GPT, LLaMA, and PaLM while addressing development techniques, limitations, resource demands, bias, and ethical concerns. Other papers explain how scaling model parameters and training data can improve downstream performance, though with diminishing returns and computational trade-offs, while research on few-shot and unified text-to-text learning demonstrates that models can adapt to diverse tasks from limited examples or fine-tuning. The selection also covers the Hypotheses-to-Theories framework for inducing and applying rules in reasoning tasks, and emphasizes that the Transformer’s self-attention mechanism remains central to the efficiency, scalability, and capabilities of modern LLMs.

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.