Control, dynamics and information theory: formulas
Pick a formula to see it explained with worked examples and a solver that shows every step.
About this topic
Control theory is about steering a system, like a thermostat. Information theory measures how much information a message holds. On this page you will find 9 pages, such as Controllability (Kalman rank), Algebraic Riccati equation (LQR) and Routh–Hurwitz (quadratic).
Every page has a solver that shows each step, examples to follow and the mistakes to avoid. Controllability (Kalman rank) is a good place to start.
Formulas in this topic
- Controllability (Kalman rank)The linear system dotmathbf x=Amathbf x+Bmathbf u is controllable (any state can be reached from any oth
- Algebraic Riccati equation (LQR)The linear quadratic regulator minimises ∫(mathbf x^(T)Qmathbf x+mathbf u^(T)Rmathbf u)dt for dotm
- Bellman equationThe Bellman equation V(x)=min_u\c(x,u)+γ V(f(x,u))\ says that the best total cost from a
- Lyapunov stabilityIf a function V is positive (except at the equilibrium) and dot V≤0 along solutions, the equilibrium is sta
- Routh–Hurwitz (quadratic)The polynomial s²+a_1s+a_0 has both roots with negative real part (a stable system) exactly when a_1>0 and
- Kraft inequalityA binary prefix code with codeword lengths ell_1,dots,ell_m exists if and only if Σ_i2^(-ell_i)≤1. Ea
- Channel capacityThe capacity of a channel is C=max_p(x)I(X;Y), the largest mutual information between input and output over
- Binary symmetric channelA binary symmetric channel flips each transmitted bit with probability p. Its capacity is C=1-H_2(p), where H_
- Singleton and Hamming boundsFor a binary code of length n, dimension k and minimum distance d: the Singleton bound is d≤ n-k+1, and a co
Control, dynamics and information theory questions
What is a feedback loop?
It is when a system uses its own output to adjust what it does next.
What if I get stuck?
Read the worked examples on the page first, then try the solver with your own numbers and compare each step.