Skip to content

Notes on Anything

Gradient-Descent

Initializing search

Home
Mathematics
Artificial Intelligences
Robotics

Notes on Anything

Home
Mathematics
Mathematics
- Preface
- Probability
  Probability
- Optimization
  Optimization
  - Least Squares
  - Non-Linear Least Squares
  - Approximation of Hessian
  - Optimization Procedure
    Optimization Procedure
    
    Gradient-Descent Gradient-Descent
    Table of contents
    
    Gradient-Descent
    
    Newton-Rapshon
    
    Gauss-Newton
    
    Levenberg Marquardt
- Algebra
  Algebra
  - Singular Value Decomposition
  - Frobenius Inner Product
- Lie Theory
  Lie Theory
Artificial Intelligences
Artificial Intelligences
- Preface
- Attention Mechanism
  Attention Mechanism
- Models
  Models
  - Large Language Models
    Large Language Models
    
    LLAMA-2
    
    JPEG-LM
  - Computer Vision
    Computer Vision
    
    U-Net
    
    U2-Net
- Tokenizers
  Tokenizers
  - Byte-Pair Encoding
- SpinalNet
Robotics
Robotics
- Preface
- Equations of Motion
  Equations of Motion
  - Quadcopter
- Nonlinear Control
  Nonlinear Control
  - Applied Nonlinear Control
    Applied Nonlinear Control
    
    Introduction to Nonlinear Systems
    
    Phase Plane Analysis
  - Geometric Control on SE(3)
- Sensor Fusion
  Sensor Fusion
  - Kalman Filter
  - Extended Kalman Filter
- SLAM
  SLAM
- System Identification
  System Identification
  - WyNDA

Table of contents

Gradient-Descent

Gradient-Descent

Gradient-Descent¶

\[ x_{i+1} = x_i + \lambda\nabla_{f(x)} \]

Approximation of Hessian

Found any misexplanations? Report or PR on this repo