MMETSummary
A Bernoulli Trial is an event that is either a success or a failure (true/false). The discrete random variable in this case with probability of success
For a sequence of
For a sequence of independent Bernoulli trials, each with probability of success
For a sequence of independent bernoulli trials with probability of success
The number of events occurring independently at a constant rate is modeled through the very important Poisson random variable. For a rate
For a rate
Consider a basket with
which for very large
and mean and variance
The probability theory studied so far only accounts for countable events, but in practice we deal with mostly uncountables. So we need some sort of continuity to account for uncountables.
A random variable
The cumulative distribution function (CDF) of a continuous random variable
From this, we understand that the probability density function is the derivative of the cumulative distribution function,
For a small interval of
The variance for a continuous random variable
Just like we had the variance for discrete random variables, it is the same for the continous case, with the alernative formula being
For some rate
For a rate
For the unit interval, that is from 0 to 1,
The CRV
For a mean
For a Gaussian Random Variable, with mean(expectation)
For two random variables
For two random variables
The marginal laws or marginal distribution of random variables
From this it becomes obvious that the cumulative distribution functions for
The joint probability mass function of the variables
The joint probability mass function of two discrete random variables is positive for at most a countable number of paired values, sums up to a total of 1 and is usually represented using tables.
Two random variables
The probability density functions of
Two random variables are independent if for each pair of subsets
Alternatively, we can re-define independence of random variables as for each pair of subsets
We can also re-define it as if
From this we can find that two random variables
Additionally, for discrete random variables, in terms of probability mass functions,
For some random variable
For discrete random variables,
For continuous random variables,
For two continuous independent uniform random variables
For discrete random variables:
A sequence of random variables
This concept is used to characterize the binomial and gamma random variables through i.i.d sequences of SIMPLER random variables:
The formula learned before for the mean(expectation)
For a sum of discrete variables
The variance of a random variable measures how much it changes around its expectation. So, how do we measure the joint variability of two random variables?
The covariance of random variables
For two discrete or continuous random variables
For an i.i.d sequence of random variables
For two random variables
and is a measure of how much these variables are related. The value of the covariance is a number between
Two random variables
This highlights that the squared correlation is a measure of how linearly dependent these two variables
A complex number is the number
Representing the complex number as a vector, we define the modulus or absolute value of the complex number
The complex conjugate of a complex number
The argument is not unique. Infinitely many complex numbers can have the same argument.
Similarly, a complex numbers can have infinite values for the argument because of periodicity of the sinusoidals. The principal argument is the only argument found in the first period of the function.
Let
For any complex number
A function of a complex number
The ordinary rules of limits and continuity hold for complex numbers, where we can treat a complex number as the sum of two real functions.
For any open set in the complex plane a function of a complex variable is differentiable at a point
The Cauchy-Riemann equations expess an unique approach to complex derivatives. For a function
If this is the case, we have that
A function is holomorphic or analytic if it is differentiable everywhere in a set or domain.
A function is entire if it is holomorphic over the entire complex plane
A function is harmonic if its laplacian
A curve is
Linearity also holds for integration in the complex plane, where we have that for
The length
For some continuous function
A domain is just an open and connected set of complex numbers and is regular if its boundary is a combination of many images of jordan curves pieced together. Then its integral is the length of all these jordan curves together:
For some regular domain
For some regular domain
The integral of a holomorphic function over a Jordan curve is zero
The winding number or index of a point
For some holomorphic function function
The above is useful because it extends to derivatives, and we have that for a function holomorphic over a regular domain
The Cauchy Integral Formula proves that a holomorphic function of complex variable is infinitely differentiable, and the functions of its real and imaginary parts composing it are also infinitely differentiable.
Liuovulle's Theorem is a direct consequence of the Cauchy Itnegral Formula and states that if a complex function is entire and bounded, then it is constant, i.e. its first drivative is zero
Every non-constant polynomial (polynomial of degree >1) has complex roots. Moreover, complex roots that involve an imaginary part come in conjugate pairs. If a polynomial has a complex root, then its conjugate must necessarily also be a root.
Sequences and Series of Complex Numbers are quite literally the same as those of real numbers, but for convergence we consider both their rael and imaginary parts
For some point in the complex plane
For any power series of complex variables
We can find the radius of convergence
Every complex series with radius of convergence
From the above we get the definition of the Taylor Series Expansion, where any holomorphic function can be approximated locally as a convergent power series of radius
Two holomorphic functions of complex variables that are equivalent for a given domain are also equivalent for some other domain they're defined in
An annulus is a ring. All complex numbers in a ring formed by circles of radii
For some point
If a function is holomorphic(differentiable) everywhere around some point
For some point
For some function
Similarly,
If a function
For some regular domain
A complex number
The support of a complex-valued signal is defined as all the conjugates of all values for which the signal isn't zero:
A signal
A signal
The supremum norm, also called the
A sequence of signals
A sequence of test functions
A set of test functions
Functionals are functions of signals. They are maps, and are denoted
For example,
We have then that a functional
A distribution
The functional
For some distribution
For some signal
The distribution denoted
For every test function
For a distribution
For some distribution
For some distribution
If a distribution has compact support then it is a linear continuous operator in that case.
The convolution of two locally integrable signals
For distributions
For an absolutely integrable signal
A signal
The Inverse Fourier Transform is defined
For a rapidly decreasing signal with Fourier Transform
A functional is a tempered distribution if it is linear and continuous. Moreover, the restriction of a tempered distribution
A distribution with compact support is tempered
The impulse train also known as Dirac's Comb is the distribution
The Fourier Transform of a tempered distribution
The Fourier transform of the distribution associated to an absolutely integrable signal
The inverse fourier transform of a tempered distribution
The Fourier Transform of a Convolution is the product of the individual transforms:
A distribution is:
Let
For a locally integrable signal
The set of absolute convergence of an integrable signal is the set of values of
It follows then that a function is Laplace-Transformable if its set of convergence is non-empty i.e.
Linearity | |
---|---|
Time Differentiation | |
Time Integration | |
Time Delay | |
Convolution | |
Final Value Theorem | For a function with roots of denominator polynomial of having strictly negative real part, |
Initial Value Theorem |
For a continuous, laplace-transformable signal
For some laplace transform
The space of rapidly decreasing functions is denoted
The space of tempered distributions is denoted
The Laplace Transform of a transformable distribution
For