📊 Engineering Mathematics 🔥 Day 1
0/8 topics mastered

Engineering Mathematics

🎯
Engineering Mathematics — Complete Study Notes
6 chapters · ESE (IES) Paper I · GATE · SSC JE
○ Not Started

Engineering Mathematics is a foundational, formula-dense section common to ESE Paper I, GATE, and SSC JE across all engineering branches. This module spans Linear Algebra (matrices, eigenvalues), Calculus (limits, differentiation, integration, multivariable calculus), Differential Equations (first-order and second-order ODEs, Laplace transforms), Complex Variables (analytic functions, Cauchy's theorems, residues), Probability & Statistics (distributions, hypothesis testing), and Numerical Methods (root finding, integration, ODEs) — with every formula, identity, and standard result carried over, plus worked examples and diagrams for each topic.

Learning Objectives

After studying this chapter you will be able to:

  • Apply matrix rank, determinant properties, and the Rouché–Capelli theorem to test system consistency
  • Compute eigenvalues/eigenvectors and apply L'Hôpital's rule, Euler's theorem, and the second-derivative test
  • Solve first- and second-order ODEs and apply Laplace transforms to initial value problems
  • Verify analyticity via Cauchy–Riemann equations and evaluate contour integrals using the residue theorem
  • Apply Bayes' theorem and identify the mean/variance of standard probability distributions
  • Apply Newton–Raphson, Simpson's rule, and RK4 for root-finding, integration, and solving ODEs numerically
  • Recall high-yield formulas (RK4 weights, Laplace pairs, GWP-style constants) that ESE/GATE repeatedly test

Exam Relevance

ESE Paper I★★★★★
GATE★★★★★
SSC JE★★★★☆
State PSC★★★☆☆
💡 Engineering Mathematics questions are almost always numerical — memorising a formula alone is not enough. Practice applying each formula (Rouché–Capelli, RK4, Laplace pairs) to a concrete numeric problem, since that is how ESE/GATE actually tests this section.

Concept Map

Linear Algebra → Calculus
↓
Differential Equations → Complex Variables
↓
Probability & Statistics
↓
Numerical Methods

Where This Fits

Engineering Mathematics underpins nearly every other technical subject — matrix methods feed into Theory of Structures, differential equations into Structural Dynamics, and numerical methods into virtually every design calculation. Once you've worked through the chapters below, head to the Engineering Mathematics hub page to generate practice tests, or explore Study Material for other subjects.

🔢
1. Linear Algebra
Matrices · Determinants · Systems of Equations · Eigenvalues
○ Not Started

1.1 Matrices — Key Definitions

TermDefinition / Property
Rank of a matrixNumber of linearly independent rows (or columns); = number of non-zero rows in row echelon form
Singular matrix\(\det(A) = 0\); rank < n; system \(Ax = b\) may have no or infinite solutions
Symmetric\(A = A^T\)
Skew-symmetric\(A = -A^T\); diagonal elements \(= 0\)
Orthogonal\(AA^T = I\); \(A^T = A^{-1}\); columns are orthonormal
Idempotent\(A^2 = A\)
Nilpotent\(A^k = 0\) for some integer \(k\)

1.2 Determinants

💡 \(\det(AB) = \det(A) \cdot \det(B)\); \(\det(A^T) = \det(A)\); \(\det(kA) = k^n \cdot \det(A)\) for an \(n\times n\) matrix; \(\det(A^{-1}) = \dfrac{1}{\det(A)}\). If two rows are identical or proportional, \(\det = 0\). A row/column swap changes the sign of the determinant.

1.3 System of Linear Equations

\(Ax = b\); augmented matrix \([A|b]\). \(\rho(A)\) = rank of \(A\); \(\rho([A|b])\) = rank of augmented matrix.

💡 Consistency (Rouché–Capelli theorem): \(\rho(A) \ne \rho([A|b])\) → No solution (inconsistent). \(\rho(A) = \rho([A|b]) = n\) → Unique solution. \(\rho(A) = \rho([A|b]) < n\) → Infinitely many solutions (\(n - \rho\) free variables).

1.4 Eigenvalues and Eigenvectors

\(Ax = \lambda x\); characteristic equation: \(\det(A - \lambda I) = 0\).

Properties of eigenvalues: Sum of eigenvalues \(= \text{trace}(A) = \Sigma a_{ii}\). Product of eigenvalues \(= \det(A)\). Eigenvalues of \(A^T\) \(=\) eigenvalues of \(A\). Eigenvalues of \(A^{-1} = \dfrac{1}{\lambda}\) (if \(A\) invertible). Eigenvalues of \(A^k = \lambda^k\). Symmetric matrix → all eigenvalues are real. Skew-symmetric → eigenvalues are zero or purely imaginary. Orthogonal matrix → \(|\lambda| = 1\).

💡 Rank-nullity theorem: \(\text{rank}(A) + \text{nullity}(A) = n\) (number of columns). Cayley–Hamilton theorem: every matrix satisfies its own characteristic equation — \(A^2 = (\text{trace})A - (\det)I\) for a \(2\times 2\) matrix.

Eigenvalue sum & product

\(\Sigma\lambda = \text{trace}(A)\); \(\Pi\lambda = \det(A)\)

Rouché–Capelli theorem

\(\rho(A) \ne \rho([A|b])\) → no solution; \(= n\) → unique; \(< n\) → infinite solutions

Rank-nullity theorem

\(\text{rank}(A) + \text{nullity}(A) = n\)

Cayley–Hamilton (2×2)

\(A^2 = (\text{trace})A - (\det)I\)

Example 1 — Determining Consistency via Rouché–Capelli

Given: A system \(Ax = b\) has a 3×3 coefficient matrix \(A\) with rank 2, and the augmented matrix \([A|b]\) also has rank 2. What can be said about the solution?

Solution: Since \(\rho(A) = \rho([A|b]) = 2 < n = 3\), the system is consistent but has infinitely many solutions, with \(n - \rho = 3 - 2 = 1\) free variable.

Answer: Infinitely many solutions, with 1 free variable.

Example 2 — Applying Eigenvalue Properties

Given: A 3×3 matrix has trace 9 and determinant 24. If two of its eigenvalues are 2 and 3, find the third.

Solution: Sum of eigenvalues = trace = \(9\), so \(\lambda_3 = 9 - 2 - 3 = 4\). Checking via the product: \(2 \times 3 \times 4 = 24 = \det(A)\) ✓, confirming consistency.

Answer: \(\lambda_3 = 4\).

Example 3 — Applying the Cayley–Hamilton Theorem

Given: A 2×2 matrix \(A\) has trace 5 and determinant 6. Express \(A^2\) in terms of \(A\) and \(I\) using the Cayley–Hamilton theorem.

Solution: By Cayley–Hamilton for a 2×2 matrix, \(A^2 = (\text{trace})A - (\det)I = 5A - 6I\).

Answer: \(A^2 = 5A - 6I\).

The three consistency cases of the Rouche-Capelli theorem for a linear system Inconsistent ρ(A) ≠ ρ([A|b]) No solution exists — the equations contradict each other Unique ρ(A) = ρ([A|b]) = n Exactly one solution — all variables fully determined Infinite ρ(A) = ρ([A|b]) < n Infinitely many solutions — with (n − ρ) free variables

Fig. 1.1 — The three consistency cases of the Rouché–Capelli theorem: inconsistent, unique, and infinite solutions.

Q1. If \(\rho(A) \ne \rho([A|b])\), the system \(Ax = b\) is:
When the rank of the coefficient matrix differs from the rank of the augmented matrix, the system is inconsistent and has no solution.
Q2. The product of the eigenvalues of a matrix A equals:
The product of all eigenvalues of a matrix equals its determinant, while the sum equals its trace.
Q3. According to the Cayley–Hamilton theorem, every square matrix:
The Cayley–Hamilton theorem states that every square matrix satisfies its own characteristic equation.
📈
2. Calculus
Limits · Differentiation · Integration · Multivariable Calculus
○ Not Started

2.1 Limits and Continuity

L'Hôpital's rule: if \(\lim f/g \to 0/0\) or \(\infty/\infty\), then \(\lim f/g = \lim f'/g'\). Continuity at \(x=a\): \(\lim_{x\to a^-} f = \lim_{x\to a^+} f = f(a)\). Differentiability \(\Longrightarrow\) Continuity (the converse is not true).

2.2 Differentiation

Chain rule: \(\dfrac{d}{dx}[f(g(x))] = f'(g(x))\cdot g'(x)\). Product rule: \((uv)' = u'v + uv'\). Quotient rule: \(\left(\dfrac{u}{v}\right)' = \dfrac{u'v - uv'}{v^2}\). Leibniz rule (nth derivative of product): \((uv)^{(n)} = \Sigma C(n,k)\,u^{(k)} v^{(n-k)}\).

2.3 Integration

Integration by parts: \(\int u\, dv = uv - \int v\, du\) (ILATE order: Inverse, Log, Algebraic, Trig, Exp).

💡 Definite integral properties: \(\int_{-a}^a f(x)dx = 0\) if \(f\) is odd; \(= 2\int_0^a f(x)dx\) if \(f\) is even. Gamma function: \(\Gamma(n) = (n-1)!\) for integer \(n\); \(\Gamma(\dfrac{1}{2}) = \sqrt\pi\). Beta function: \(B(m, n) = \Gamma(m)\dfrac{\Gamma(n)}{\Gamma(m+n)}\).

2.4 Partial Derivatives and Multivariable Calculus

Total differential: \(df = (\partial \dfrac{f}{\partial} x)dx + (\partial \dfrac{f}{\partial} y)dy\). Euler's theorem for homogeneous functions of degree \(n\): \(x(\partial \dfrac{f}{\partial} x) + y(\partial \dfrac{f}{\partial} y) = nf\).

Maxima/minima test (two variables): \(D = f_{xx}\cdot f_{yy} - f_{xy}^2\). \(D > 0, f_{xx} > 0\) → minimum; \(D > 0, f_{xx} < 0\) → maximum; \(D < 0\) → saddle point.

Jacobian: \(J = |\dfrac{\partial(u, v)}{\partial(x, y)}|\) (used in change of variables for double integrals).

💡 Euler's theorem for homogeneous functions appears every few years. Maxima–minima via the second-derivative test (\(D\) test) is a high-yield topic. Gamma/Beta function values to remember: \(\Gamma(\dfrac{1}{2}) = \sqrt\pi\), \(\Gamma(n+1) = n\Gamma(n)\).

L'Hôpital's rule

For \(0/0\) or \(\infty/\infty\): \(\lim f/g = \lim f'/g'\)

Second-derivative (D) test

\(D = f_{xx}f_{yy} - f_{xy}^2\); \(D>0,f_{xx}>0\)→min; \(D>0,f_{xx}<0\)→max; \(D<0\)→saddle

Gamma function values

\(\Gamma(n) = (n-1)!\) for integer \(n\); \(\Gamma(\dfrac{1}{2}) = \sqrt\pi\); \(\Gamma(n+1) = n\Gamma(n)\)

Euler's theorem

\(x\,\partial \dfrac{f}{\partial} x + y\,\partial \dfrac{f}{\partial} y = nf\) for degree-\(n\) homogeneous \(f\)

Example 1 — Applying the Second-Derivative Test

Given: At a critical point of \(f(x,y)\), \(f_{xx} = 4\), \(f_{yy} = 9\), and \(f_{xy} = 2\). Classify the point.

Solution: \(D = f_{xx}f_{yy} - f_{xy}^2 = (4)(9) - (2)^2 = 36 - 4 = 32 > 0\). Since \(D > 0\) and \(f_{xx} = 4 > 0\), this is a local minimum.

Answer: Local minimum.

Example 2 — Evaluating a Gamma Function

Given: Evaluate \(\Gamma(5)\) using the factorial relation for integers.

Solution: \(\Gamma(n) = (n-1)!\) for integer \(n\), so \(\Gamma(5) = 4! = 24\).

Answer: \(\Gamma(5) = 24\).

Example 3 — Verifying Euler's Theorem

Given: For \(f(x,y) = x^2y + xy^2\) (a homogeneous function of degree 3), verify Euler's theorem.

Solution: \(\partial \dfrac{f}{\partial} x = 2xy + y^2\), \(\partial \dfrac{f}{\partial} y = x^2 + 2xy\). Then \(x(2xy+y^2) + y(x^2+2xy) = 2x^2y + xy^2 + x^2y + 2xy^2 = 3x^2y + 3xy^2 = 3(x^2y+xy^2) = 3f\), confirming \(n=3\).

Answer: Verified — the result equals \(3f\), matching the degree \(n=3\).

The three outcomes of the second-derivative D-test for classifying critical points Minimum D > 0, f_xx > 0 Maximum D > 0, f_xx < 0 Saddle Point D < 0

Fig. 2.1 — The second-derivative (D) test: minimum, maximum, and saddle point classifications.

Q1. L'Hôpital's rule applies to limits of the indeterminate form:
L'Hôpital's rule specifically applies to indeterminate forms of type 0/0 or ∞/∞.
Q2. At a critical point, if \(D = f_{xx}f_{yy} - f_{xy}^2 < 0\), the point is classified as:
When D < 0, the critical point is a saddle point, regardless of the sign of f_xx.
Q3. The value of \(\Gamma(\dfrac{1}{2})\) is:
Γ(1/2) = √π is a standard result frequently used in Gamma/Beta function problems.
〰️
3. Differential Equations
First-Order ODEs · Second-Order ODEs · Laplace Transforms
○ Not Started

3.1 First-Order ODEs

Separable: \(f(y)\,dy = g(x)\,dx\) → integrate both sides. Linear: \(\dfrac{dy}{dx} + P(x)y = Q(x)\) → integrating factor \(\mu = e^{\int P\, dx}\) → solution: \(y\mu = \int Q\mu\, dx\).

Exact: \(M\,dx + N\,dy = 0\) is exact if \(\partial \dfrac{M}{\partial} y = \partial \dfrac{N}{\partial} x\) → solution \(F(x, y) = c\) where \(\partial \dfrac{F}{\partial} x = M, \partial \dfrac{F}{\partial} y = N\). Bernoulli: \(\dfrac{dy}{dx} + P(x)y = Q(x)y^n\) → substitute \(v = y^{1-n}\) → reduces to linear.

3.2 Second-Order Linear ODEs with Constant Coefficients

\(ay'' + by' + cy = f(x)\); auxiliary equation: \(am^2 + bm + c = 0\).

💡 Complementary solution \(y_c\) based on roots \(m_1, m_2\): Real distinct: \(y_c = C_1 e^{m_1 x} + C_2 e^{m_2 x}\). Real repeated: \(y_c = (C_1 + C_2 x)e^{mx}\). Complex conjugate \(m = \alpha \pm i\beta\): \(y_c = e^{\alpha x}[C_1\cos(\beta x) + C_2\sin(\beta x)]\). Particular solution \(y_p\) by method of undetermined coefficients or variation of parameters. General solution: \(y = y_c + y_p\).

3.3 Laplace Transforms

\(f(t)\)\(F(s) = \mathcal{L}\{f(t)\}\)
\(1\)\(\dfrac{1}{s}\)
\(t\)\(\dfrac{1}{s^2}\)
\(t^n\)\(n!/s^{n+1}\)
\(e^{at}\)\(\dfrac{1}{s-a}\)
\(\sin(at)\)\(\dfrac{a}{s^2+a^2}\)
\(\cos(at)\)\(s/(s^2+a^2)\)
\(e^{at}f(t)\)\(F(s-a)\) [First shifting theorem]
\(f(t-a)u(t-a)\)\(e^{-as}F(s)\) [Second shifting theorem]
\(f'(t)\)\(sF(s) - f(0)\)
\(f''(t)\)\(s^2 F(s) - sf(0) - f'(0)\)
💡 Laplace transform pairs and the derivative property are heavily tested. For IVP (initial value problems), take the Laplace transform, solve for \(F(s)\), then use inverse Laplace (partial fractions) to get \(y(t)\).

Integrating factor (linear ODE)

\(\mu = e^{\int P\, dx}\); solution \(y\mu = \int Q\mu\, dx\)

Auxiliary equation roots

Real distinct: \(C_1e^{m_1x}+C_2e^{m_2x}\). Repeated: \((C_1+C_2x)e^{mx}\). Complex: \(e^{\alpha x}[C_1\cos\beta x+C_2\sin\beta x]\)

Key Laplace pairs

\(e^{at}\to \dfrac{1}{s-a}\); \(\sin(at)\to \dfrac{a}{s^2+a^2}\); \(\cos(at)\to s/(s^2+a^2)\)

Laplace derivative property

\(\mathcal{L}\{f'(t)\} = sF(s)-f(0)\); \(\mathcal{L}\{f''(t)\} = s^2F(s)-sf(0)-f'(0)\)

Example 1 — Classifying the Complementary Solution

Given: Solve the auxiliary equation for \(y'' - 5y' + 6y = 0\) and write the complementary solution.

Solution: Auxiliary equation: \(m^2 - 5m + 6 = 0 \Rightarrow (m-2)(m-3) = 0 \Rightarrow m = 2, 3\) (real, distinct roots).

Answer: \(y_c = C_1e^{2x} + C_2e^{3x}\).

Example 2 — Finding a Laplace Transform

Given: Find the Laplace transform of \(f(t) = e^{3t}\sin(2t)\).

Solution: Using the first shifting theorem, \(\mathcal{L}\{e^{at}f(t)\} = F(s-a)\). Since \(\mathcal{L}\{\sin(2t)\} = \dfrac{2}{s^2+4}\), substituting \(s \to s-3\) gives \(\mathcal{L}\{e^{3t}\sin(2t)\} = \dfrac{2}{(s-3)^2+4}\).

Answer: \(\dfrac{2}{(s-3)^2+4}\).

Example 3 — Solving a Linear First-Order ODE

Given: Find the integrating factor for \(\dfrac{dy}{dx} + 2y = e^{-2x}\).

Solution: Here \(P(x) = 2\), so \(\mu = e^{\int 2\, dx} = e^{2x}\).

Answer: \(\mu = e^{2x}\).

Three types of complementary solution for second-order ODEs based on auxiliary equation roots Real Distinct m₁ ≠ m₂ C₁e^(m₁x)+C₂e^(m₂x) Real Repeated m₁ = m₂ = m (C₁+C₂x)e^(mx) Complex Conj. m = α ± iβ e^(αx)[C₁cos+C₂sin]

Fig. 3.1 — Complementary solution shapes for second-order ODEs: real distinct roots (sum of exponentials), real repeated roots, and complex conjugate roots (oscillating envelope).

Q1. The Laplace transform of \(e^{at}\) is:
The Laplace transform of \(e^{at}\) is \(\dfrac{1}{s-a}\), a fundamental transform pair.
Q2. If the auxiliary equation of a second-order ODE has repeated real roots \(m\), the complementary solution is:
Repeated real roots give the complementary solution \((C_1+C_2x)e^{mx}\).
Q3. An equation \(M\,dx + N\,dy = 0\) is exact when:
An ODE M dx + N dy = 0 is exact if and only if ∂M/∂y = ∂N/∂x.
🌀
4. Complex Variables
Analytic Functions · Cauchy's Theorems · Residues and Poles
○ Not Started

4.1 Analytic Functions

\(f(z) = u(x, y) + iv(x, y)\); \(z = x + iy\).

💡 Cauchy–Riemann equations (necessary for analyticity): \(\partial \dfrac{u}{\partial} x = \partial \dfrac{v}{\partial} y\) and \(\partial \dfrac{u}{\partial} y = -\partial \dfrac{v}{\partial} x\). If C–R equations hold AND partial derivatives are continuous, \(f\) is analytic. For an analytic function, both \(u\) and \(v\) are harmonic (\(\nabla^2 u = 0, \nabla^2 v = 0\)).

4.2 Cauchy's Integral Theorem and Formula

Cauchy's theorem: if \(f(z)\) is analytic inside and on closed contour \(C\), then \(\oint_C f(z)\, dz = 0\).

Cauchy's integral formula: \(f(a) = \dfrac{1}{2\pi i} \oint_C \dfrac{f(z)}{z-a}\, dz\) (\(a\) inside \(C\)); \(f^{(n)}(a) = \dfrac{n!}{2\pi i} \oint_C \dfrac{f(z)}{(z-a)^{n+1}}\, dz\).

4.3 Residues and Poles

Pole of order \(m\) at \(z = a\): \((z-a)^m f(z)\) remains finite and non-zero as \(z\to a\).

💡 Simple pole (\(m=1\)): \(\operatorname{Res}[f, a] = \lim_{z\to a}(z-a)f(z)\). Pole of order \(m\): \(\operatorname{Res}[f, a] = \dfrac{1}{(m-1)!}\lim_{z\to a}\dfrac{d^{m-1}}{dz^{m-1}}[(z-a)^m f(z)]\). Residue theorem: \(\oint_C f(z)\, dz = 2\pi i \times \Sigma(\text{residues inside } C)\). Cauchy–Riemann equations and the residue theorem for contour integrals are the two most-tested topics. Remember: simple pole residue \(= \lim_{z\to a}(z-a)f(z)\) — quick and clean.

Cauchy–Riemann equations

\(\partial \dfrac{u}{\partial} x = \partial \dfrac{v}{\partial} y\); \(\partial \dfrac{u}{\partial} y = -\partial \dfrac{v}{\partial} x\)

Cauchy's theorem

If \(f(z)\) analytic in/on \(C\): \(\oint_C f(z)\,dz = 0\)

Simple pole residue

\(\operatorname{Res}[f,a] = \lim_{z\to a}(z-a)f(z)\)

Residue theorem

\(\oint_C f(z)\,dz = 2\pi i \times \Sigma(\text{residues inside }C)\)

Example 1 — Verifying Analyticity via Cauchy–Riemann

Given: For \(f(z) = z^2 = (x+iy)^2\), verify the Cauchy–Riemann equations.

Solution: \(u = x^2-y^2\), \(v = 2xy\). Then \(\partial \dfrac{u}{\partial} x = 2x\), \(\partial \dfrac{v}{\partial} y = 2x\) ✓ (equal); \(\partial \dfrac{u}{\partial} y = -2y\), \(-\partial \dfrac{v}{\partial} x = -2y\) ✓ (equal). Both C–R equations hold.

Answer: C–R equations are satisfied, so \(f(z)=z^2\) is analytic everywhere.

Example 2 — Finding a Simple Pole Residue

Given: Find the residue of \(f(z) = \dfrac{1}{z-3}\) at \(z=3\).

Solution: This is a simple pole at \(z=3\). \(\operatorname{Res}[f,3] = \lim_{z\to 3}(z-3)\cdot\dfrac{1}{z-3} = 1\).

Answer: Residue \(= 1\).

Example 3 — Applying the Residue Theorem

Given: Evaluate \(\oint_C \dfrac{1}{z-3}\, dz\) where \(C\) is a contour enclosing \(z=3\).

Solution: By the residue theorem, \(\oint_C f(z)\,dz = 2\pi i \times \Sigma(\text{residues})\). With residue \(=1\) at the enclosed pole, the integral equals \(2\pi i \times 1 = 2\pi i\).

Answer: \(2\pi i\).

A closed contour enclosing a pole, illustrating the residue theorem Closed contour C Pole at z = a Res[f, a] ∮c f(z) dz = 2πi × (sum of residues enclosed by C)

Fig. 4.1 — A closed contour C enclosing a single pole at z = a; the contour integral equals 2πi times the residue at that pole.

Q1. The Cauchy–Riemann equations state that:
The Cauchy-Riemann equations are ∂u/∂x = ∂v/∂y and ∂u/∂y = -∂v/∂x, necessary conditions for analyticity.
Q2. The residue of a simple pole at z = a is computed as:
For a simple pole (order 1), the residue is lim(z→a) (z-a)f(z).
Q3. By Cauchy's theorem, if \(f(z)\) is analytic inside and on a closed contour C, then \(\oint_C f(z)\,dz\) equals:
Cauchy's theorem states that the contour integral of an analytic function over a closed contour (with no singularities inside) is zero.
🎲
5. Probability & Statistics
Bayes' Theorem · Standard Distributions · Hypothesis Testing
○ Not Started

5.1 Probability Fundamentals

Total probability theorem: if \(B_1, B_2, \ldots, B_n\) partition the sample space, \(P(A) = \sum_i P(A|B_i)P(B_i)\). Two events are independent if \(P(A \cap B) = P(A)P(B)\); mutually exclusive if \(P(A \cap B) = 0\).

💡 Bayes' theorem: \(P(A_i|B) = \dfrac{P(B|A_i)P(A_i)}{\sum_j P(B|A_j)P(A_j)}\). Conditional-probability numericals built on Bayes' theorem appear in most ESE papers — always identify the partition events \(A_i\) and the "evidence" event \(B\) first.

5.2 Standard Probability Distributions

DistributionPMF / PDFMeanVariance
Binomial \(B(n,p)\)\(P(X=k) = \binom{n}{k}p^k(1-p)^{n-k}\)\(np\)\(np(1-p)\)
Poisson \(P(\lambda)\)\(P(X=k) = \dfrac{e^{-\lambda}\lambda^k}{k!}\)\(\lambda\)\(\lambda\)
Normal \(N(\mu,\sigma^2)\)\(f(x) = \dfrac{1}{\sigma\sqrt{2\pi}}e^{-(x-\mu)^2/2\sigma^2}\)\(\mu\)\(\sigma^2\)
Exponential \(Exp(\lambda)\)\(f(x) = \lambda e^{-\lambda x},\ x\ge 0\)\(\dfrac{1}{\lambda}\)\(\dfrac{1}{\lambda^2}\)
Uniform \(U(a,b)\)\(f(x) = \dfrac{1}{b-a},\ a\le x\le b\)\(\dfrac{a+b}{2}\)\(\dfrac{(b-a)^2}{12}\)
💡 Poisson distribution is uniquely identified by mean = variance = \(\lambda\) — a common trick-question check. Normal distribution Z-score and confidence-interval questions are tested often.

5.3 Sample Statistics & Hypothesis Testing

Sample mean: \(\bar{x} = \dfrac{1}{n}\sum_i x_i\). Sample variance: \(s^2 = \dfrac{1}{n-1}\sum_i (x_i-\bar{x})^2\). Standard error: \(SE = \dfrac{\sigma}{\sqrt{n}}\).

Hypothesis testing: null hypothesis \(H_0\) vs. alternative \(H_1\). Type I error (\(\alpha\)) = rejecting \(H_0\) when true; Type II error (\(\beta\)) = failing to reject \(H_0\) when false; Power \(= 1-\beta\).

Z-test (large \(n\), known \(\sigma\)): \(Z = \dfrac{\bar{x}-\mu_0}{\sigma/\sqrt{n}}\). t-test (small \(n\), unknown \(\sigma\)): \(t = \dfrac{\bar{x}-\mu_0}{s/\sqrt{n}}\), with \(n-1\) degrees of freedom.

Bayes' theorem

\(P(A_i|B) = \dfrac{P(B|A_i)P(A_i)}{\sum_j P(B|A_j)P(A_j)}\)

Poisson PMF

\(P(X=k) = \dfrac{e^{-\lambda}\lambda^k}{k!}\); mean = variance = \(\lambda\)

Z-test statistic

\(Z = \dfrac{\bar{x}-\mu_0}{\sigma/\sqrt{n}}\)

t-test statistic

\(t = \dfrac{\bar{x}-\mu_0}{s/\sqrt{n}}\), df \(= n-1\)

Example 1 — Bayes' Theorem

Given: Machine A produces 60% of items with 2% defective; Machine B produces 40% with 5% defective. An item is found defective. Find \(P(\text{from A}|\text{defective})\).

Solution: \(P(D) = 0.6(0.02) + 0.4(0.05) = 0.012+0.020 = 0.032\). \(P(A|D) = \dfrac{0.6 \times 0.02}{0.032} = \dfrac{0.012}{0.032} = 0.375\).

Answer: \(P(A|D) = 0.375\) (37.5%).

Example 2 — Poisson Distribution

Given: A call center receives calls with mean rate \(\lambda = 3\) per minute. Find \(P(X=2)\).

Solution: \(P(X=2) = \dfrac{e^{-3}3^2}{2!} = \dfrac{e^{-3}\times 9}{2} \approx \dfrac{0.0498\times9}{2} \approx 0.224\).

Answer: \(P(X=2) \approx 0.224\).

Example 3 — Z-test

Given: Population mean \(\mu_0=50\), \(\sigma=10\), sample of \(n=25\) has \(\bar{x}=54\). Test \(H_0: \mu=50\).

Solution: \(Z = \dfrac{54-50}{10/\sqrt{25}} = \dfrac{4}{2} = 2\). Since \(|Z|=2 > 1.96\) (5% two-tailed critical value), reject \(H_0\).

Answer: \(Z=2\); reject \(H_0\) at 5% significance.

Bayes' theorem probability tree for the defective-item example Item P(A) = 0.6 P(B) = 0.4 Machine A Machine B Defective 0.02 OK 0.98 Defective 0.05 OK 0.95 P(A|D) = P(D|A)P(A) / P(D) = 0.012 / 0.032 = 0.375

Fig. 5.1 — Probability tree for the Bayes' theorem worked example: branching by machine, then by defect status.

Q1. For a Poisson distribution with parameter \(\lambda\):
A defining property of the Poisson distribution is that its mean equals its variance, both equal to λ.
Q2. Bayes' theorem is used to compute:
Bayes' theorem inverts conditional probabilities: given P(B|A) and priors, it finds P(A|B).
Q3. The t-test (rather than the Z-test) is used when:
The t-test replaces σ with the sample standard deviation s and is preferred for small samples with unknown population σ.
🧮
6. Numerical Methods
Root Finding · Numerical Integration · Numerical Solution of ODEs
○ Not Started

6.1 Root-Finding Methods

Bisection method: repeatedly halves an interval \([a,b]\) where \(f(a)\) and \(f(b)\) have opposite signs. Guaranteed to converge, but linear convergence (slow). Secant method: uses a linear approximation through two points; super-linear convergence, no derivative needed.

💡 Newton-Raphson: \(x_{n+1} = x_n - \dfrac{f(x_n)}{f'(x_n)}\). Quadratic convergence (fastest of the three), but fails or diverges when \(f'(x_n) \approx 0\) near the root. Newton-Raphson is the most-tested root-finding method — memorise the formula and its failure condition.

6.2 Numerical Integration

Trapezoidal rule: \(\int_a^b f(x)\,dx \approx \dfrac{h}{2}\big[f(x_0)+2\sum f(x_i)+f(x_n)\big]\); error \(O(h^2)\). Works with any number of intervals.

💡 Simpson's 1/3 rule: \(\int_a^b f(x)\,dx \approx \dfrac{h}{3}\big[f(x_0)+4\sum f(\text{odd})+2\sum f(\text{even})+f(x_n)\big]\); error \(O(h^4)\); requires an even number of intervals. Simpson's 3/8 rule needs intervals in multiples of 3. Simpson's 1/3 rule is the most-tested numerical integration method.

6.3 Numerical Solution of ODEs

Euler's method: \(y_{n+1} = y_n + h\,f(x_n,y_n)\); error \(O(h)\) — simple but low accuracy.

💡 Runge-Kutta 4th order (RK4): \(y_{n+1} = y_n + \dfrac{1}{6}(k_1+2k_2+2k_3+k_4)h\), where \(k_1=f(x_n,y_n)\), \(k_2=f(x_n+\dfrac{h}{2}, y_n+\dfrac{hk_1}{2})\), \(k_3=f(x_n+\dfrac{h}{2}, y_n+\dfrac{hk_2}{2})\), \(k_4=f(x_n+h, y_n+hk_3)\); error \(O(h^4)\). The weighted average (1:2:2:1)/6 must be memorised — it is heavily tested.

Newton-Raphson

\(x_{n+1} = x_n - \dfrac{f(x_n)}{f'(x_n)}\); \(O(h^2)\) quadratic

Simpson's 1/3 rule

\(\dfrac{h}{3}[f_0+4\Sigma f_{odd}+2\Sigma f_{even}+f_n]\); \(n\) even

Trapezoidal rule

\(\dfrac{h}{2}[f_0+2\Sigma f_i+f_n]\); error \(O(h^2)\)

RK4

\(y_{n+1}=y_n+\dfrac{h}{6}(k_1+2k_2+2k_3+k_4)\)

Example 1 — Newton-Raphson Iteration

Given: Find a root of \(f(x)=x^2-2\) starting from \(x_0=1.5\) (one iteration).

Solution: \(f'(x)=2x\). \(x_1 = 1.5 - \dfrac{1.5^2-2}{2(1.5)} = 1.5 - \dfrac{0.25}{3} = 1.5-0.0833 = 1.4167\).

Answer: \(x_1 \approx 1.4167\) (converging to \(\sqrt2 \approx 1.4142\)).

Example 2 — Simpson's 1/3 Rule

Given: Estimate \(\int_0^2 x^2\,dx\) using Simpson's 1/3 rule with \(n=2\) (\(h=1\)).

Solution: \(x_0=0,x_1=1,x_2=2\); \(f_0=0,f_1=1,f_2=4\). \(\int \approx \dfrac{1}{3}[0+4(1)+4] = \dfrac{8}{3} \approx 2.667\).

Answer: \(\approx 2.667\) (exact value \(=\dfrac{8}{3}\) — exact here since Simpson's rule is exact for cubics and below).

Example 3 — Euler's Method

Given: Solve \(\dfrac{dy}{dx} = x+y\), \(y(0)=1\), find \(y(0.1)\) using Euler's method with \(h=0.1\).

Solution: \(y_1 = y_0 + h\,f(x_0,y_0) = 1 + 0.1(0+1) = 1.1\).

Answer: \(y(0.1) \approx 1.1\).

Newton-Raphson tangent-line iteration geometry f(x) (xₙ, f(xₙ)) tangent at xₙ xₙ₊₁ xₙ xₙ₊₁ = xₙ − f(xₙ)/f′(xₙ)

Fig. 6.1 — Newton-Raphson geometry: the tangent line at (xₙ, f(xₙ)) crosses the x-axis at the next estimate xₙ₊₁, closer to the true root.

Q1. Newton-Raphson iteration fails or diverges when:
Newton-Raphson divides by f'(xₙ); if this derivative is near zero, the method fails or diverges.
Q2. Simpson's 1/3 rule requires:
Simpson's 1/3 rule pairs intervals, so it requires an even number of intervals (Simpson's 3/8 needs multiples of 3).
Q3. In RK4, the final update uses the weighted combination of k₁, k₂, k₃, k₄ in the ratio:
RK4's update is yₙ₊₁ = yₙ + h(k₁+2k₂+2k₃+k₄)/6 — a 1:2:2:1 weighted average.
📚
7. Quick Revision
Key Facts & Exam Essentials · Exam-Angle Summary · Practice
○ Not Started

A. Key Facts at a Glance

Eigenvalue properties

\(\Sigma\lambda_i = \operatorname{trace}(A)\); \(\Pi\lambda_i = \det(A)\)

System consistency

\(\rho(A) = \rho([A|b])\) — Rouché–Capelli

Cayley-Hamilton

Every matrix satisfies its own characteristic equation

Orthogonal matrix

\(A^{-1} = A^T\)

L'Hôpital's rule

\(0/0\) or \(\infty/\infty\) form: differentiate numerator & denominator

Gamma function

\(\Gamma(n) = (n-1)!\) for positive integers

D-test

\(D = f_{xx}f_{yy}-f_{xy}^2\): \(D>0,f_{xx}>0\) min; \(D>0,f_{xx}<0\) max; \(D<0\) saddle

Laplace of \(e^{at}\)

\(\mathcal{L}\{e^{at}\} = \dfrac{1}{s-a}\)

Laplace of \(\sin(at)\)

\(\mathcal{L}\{\sin at\} = \dfrac{a}{s^2+a^2}\)

Auxiliary equation (real repeated)

\(y = (c_1+c_2x)e^{mx}\)

Cauchy-Riemann equations

\(u_x = v_y\); \(u_y = -v_x\)

Residue theorem

\(\oint_C f(z)\,dz = 2\pi i \Sigma(\text{residues})\)

Poisson distribution

Mean = Variance = \(\lambda\)

Bayes' theorem

\(P(A_i|B) = \dfrac{P(B|A_i)P(A_i)}{\Sigma_j P(B|A_j)P(A_j)}\)

Normal distribution

Z-score: \(Z = \dfrac{x-\mu}{\sigma}\)

Newton-Raphson

\(x_{n+1} = x_n - \dfrac{f(x_n)}{f'(x_n)}\); quadratic convergence

Simpson's 1/3 rule

Requires even number of intervals; error \(O(h^4)\)

RK4 weights

\(\dfrac{k_1+2k_2+2k_3+k_4}{6}\) — the 1:2:2:1 ratio

B. Exam-Angle Summary

TopicPaper I Focus
Linear AlgebraRank/consistency numericals (Rouché–Capelli); eigenvalue property shortcuts; Cayley-Hamilton applications
CalculusL'Hôpital's rule limits; maxima/minima via D-test; Gamma/Beta function evaluations
Differential EquationsAuxiliary-equation root-case identification; Laplace transform pairs and shifting theorems
Complex VariablesCauchy-Riemann verification; residue and contour-integral numericals
Probability & StatisticsBayes' theorem conditional-probability problems; distribution mean/variance recall; Z-test/t-test selection
Numerical MethodsNewton-Raphson and Simpson's 1/3 rule numericals; RK4 weighted-average recall

C. Mnemonics & Memory Aids

💡 "Trace Sums, Det Multiplies": the sum of eigenvalues equals the trace; the product equals the determinant.
💡 "Same Rank, Consistent": ρ(A) = ρ([A|b]) means the system is consistent (Rouché–Capelli).
💡 "D Decides": in the D-test, D>0 with f_xx>0 is a minimum, D>0 with f_xx<0 is a maximum, and D<0 is always a saddle.
💡 "Poisson Twins": mean and variance of a Poisson distribution are always equal to λ — a defining, exam-favourite identity.
💡 "1-2-2-1 for RK4": the four slopes k₁, k₂, k₃, k₄ combine in the ratio 1:2:2:1, divided by 6.
💡 "Even for Simpson, Any for Trapezoidal": Simpson's 1/3 needs an even interval count; the trapezoidal rule works with any count.

Practice Questions

Q1. A 3×3 matrix has eigenvalues 2, 3, and 5. What are its trace and determinant?

Show Answer
Trace = 2+3+5 = 10; Determinant = 2×3×5 = 30

Q2. Using the D-test, if \(D = 25\) and \(f_{xx} = -4\) at a critical point, what type of point is it?

Show Answer
D>0 and f_xx<0 — local maximum

Q3. Find \(\mathcal{L}\{e^{2t}\}\) using the standard Laplace transform table.

Show Answer
1/(s−2), valid for s > 2

Q4. A Poisson process has a sample mean of 4.2 defects per batch. What is your estimate of the variance?

Show Answer
Poisson mean = variance, so variance ≈ 4.2

Q5. Using Simpson's 1/3 rule, can you directly use \(n=5\) intervals?

Show Answer
No — Simpson's 1/3 rule requires an even number of intervals; n=5 is odd, so it cannot be applied directly.

Mini Quiz — Full Chapter Recap

Q1. For any square matrix, the sum of its eigenvalues equals:
The sum of eigenvalues of a matrix always equals its trace (sum of diagonal entries).
Q2. Which distribution is uniquely defined by having its mean exactly equal to its variance?
The Poisson distribution has mean = variance = λ, a defining and frequently tested property.
Q3. In the RK4 method, the weighted average of the four slope estimates uses the ratio:
RK4 combines k₁, k₂, k₃, k₄ in the ratio 1:2:2:1, divided by 6, giving 4th-order accuracy.
🎉 All Engineering Mathematics topics mastered — great work! Back to Study Material →