Artificial Intelligence

This section covers foundational concepts and advanced techniques in artificial intelligence, including attention mechanisms, popular models, and tokenizers.

Table of Contents

• Preface
• Attention Mechanism
  • Additive Attention
  • Dot Product Attention
  • Scaled-Dot Product Attention
  • Multi-Head Attention
  • Multi-Query Attention
  • Grouped Query Attention
• Models
  • Large Language Models
    • JPEG-LM
    • LLAMA-2
  • Computer Vision
    • U-Net
    • U2-Net
• Tokenizers
  • Byte-Pair Encoding
• SpinalNet