# LLM Foundations Hub
> [!Note]
> Sub-hub for the building blocks of Large Language Models: architecture,
> training, inference, alignment, and the broader generative-AI surfaces
> that LLMs sit within.
## 1. The model itself
- [[Large Language Model]]
- [[Foundation Model]]
- [[Transformer Architecture]]
- [[Attention Mechanism]]
- [[Scaling Laws]]
---
## 2. Inputs and representations
- [[Tokenization]]
- [[Embedding]]
---
## 3. Training and post-training
- [[Pretraining]]
- [[Fine-Tuning]]
- [[RLHF]]
- [[Constitutional AI]]
- [[Alignment]]
---
## 4. Inference
- [[Sampling]]
- [[Temperature]]
- [[Hallucination]]
- [[Speculative Decoding]]
- [[Draft Model]]
- [[Acceptance Rate]]
- [[Modified Rejection Sampling]]
- [[Self-Drafting]]
---
## 5. Generative AI more broadly
- [[Generative AI]]
- [[Diffusion Model]]
- [[Multimodal Model]]
---
## 6. Anchor sources
- [[Attention Is All You Need (Vaswani et al.)]]
- [[Constitutional AI (Bai et al.)]]
---
## Up
- [[0 - Modern AI Software Engineering Hub]]