Skip to content
Notes on Anything
Multi Head Attention
Initializing search
Home
Mathematics
Artificial Intelligences
Robotics
Notes on Anything
Home
Mathematics
Mathematics
Preface
Probability
Probability
Intro to Probability
Set Theory
Binomial and Multinomial Distribution
Conditional Distribution
Laws of Total Probability
Bayes' Theorem
Independence
Random Variabels
Bernouli Distribution
Binomial to Normal Distribution
Binomial to Poisson Distribution
Geometric Distribution
Exponential Distribution
Poisson Proccess
Gamma Distribution
Function of Random Variables
Joint Distribution
Theory of Expectation
Variance and Standart Deviation
Markov's Inequality
Chebyshev Inequality
Laws of Large Number
Moment Generating Function
Lebesgue Measure
Covariance and Correlation
Tail Sum
Central Limit Theorem
Optimization
Optimization
Least Squares
Non-Linear Least Squares
Approximation of Hessian
Optimization Procedure
Optimization Procedure
Gradient-Descent
Newton-Rapshon
Gauss-Newton
Levenberg Marquardt
Algebra
Algebra
Singular Value Decomposition
Frobenius Inner Product
Lie Theory
Lie Theory
Preface
Lie Groups
Lie Algebra
Adjoint
Artificial Intelligences
Artificial Intelligences
Preface
Attention Mechanism
Attention Mechanism
Additive Attention
Dot Product Attention
Scaled-Dot Product Attention
Multi Head Attention
Multi Query Attention
Grouped Query Attention
Models
Models
Large Language Models
Large Language Models
LLAMA-2
JPEG-LM
Computer Vision
Computer Vision
U-Net
U2-Net
Tokenizers
Tokenizers
Byte-Pair Encoding
SpinalNet
Robotics
Robotics
Preface
Equations of Motion
Equations of Motion
Quadcopter
Nonlinear Control
Nonlinear Control
Applied Nonlinear Control
Applied Nonlinear Control
Introduction to Nonlinear Systems
Phase Plane Analysis
Geometric Control on SE(3)
Sensor Fusion
Sensor Fusion
Kalman Filter
Extended Kalman Filter
SLAM
SLAM
Point to Point Iterative Closest Point
Point to Line Iterative Closest Point
Pose-Graph
System Identification
System Identification
WyNDA
Multi-Head Attention (MHA)
¶
Back to top