Poisson Processes
Poisson processes are used to model natural phenomena and provide analytical results. They are mathematically simple and offer a relevant fundamental understanding.
The Poisson Distribution
The Poisson distribution with parameter μ>0 is given by:
pk=P[X=k]=e−μk!μk, for k=0,1,2,…
The mean and variance are:
E[X]=μ
Var[X]=μ
Sum of Poisson Variables
Theorem 4.1.1: If X and Y are independent random variables with Poisson distributions with parameters μ and ξ respectively, then X + Y has a Poisson distribution with parameter μ+ξ.
Proof:
P[X+Y=n]=∑k=0nP[X=k,Y=n−k] Since X and Y are independent: =∑k=0nP[X=k]P[Y=n−k]
=∑k=0nk!μke−μ(n−k)!ξn−ke−ξ =e−(μ+ξ)n!1∑k=0nk!(n−k)!n!μkξn−k
=e−(μ+ξ)n!(μ+ξ)n, for n=0,1,…
Composition of Poisson with Binomial
Theorem 4.1.2: Let N be a Poisson random variable with parameter μ, and conditional on N, let M have a binomial distribution with parameters N and p. Then the unconditional distribution of M is Poisson with parameter μp.
The Poisson Process
A Poisson process describes how the count X of rare events changes over time t.
Definition 1 (Poisson process): A Poisson process of intensity or rate η>0 is an integer-valued stochastic process X(t):t⊆0 for which:
For any sequence of instants t0=0<t1<t2<…<tn, the process increments X(t1)−X(t0),X(t2)−X(t1),…,X(tn)−X(tn−1) are independent and stationary random variables.
For s⊆0 and t>0, the random variables X(s+t)−X(s) have a Poisson distribution with rate ηt:
P[X(s+t)−X(s)=k]=k!(ηt)ke−ηt, for k=0,1,2…
X(0)=0.
If X(t) is a Poisson process of rate η>0, then its mean and variance are given by:
E[X(t)]=ηt
Var[X(t)]=ηt
Exercise 4.2.1
Defects occur along an undersea cable according to a Poisson process of rate η=0.1 per mile.
What is the probability that no defects appear in the first two miles of the cable?
X(2) has a Poisson distribution with parameter ηt=0.1⋅2=0.2, and so:
P[X(2)=0]=e−0.2=0.8187
Given that there are no defects in the first two miles of cable, what is the conditional probability of no defects between mile two and three?
Here we use the independence of X(3)−X(2) and X(2)−X(0)=X(2). So it follows that the conditional probability is the same as the unconditional probability:
P[X(3)−X(2)=0]=P[X(1)=0]=e−0.1=0.9048
Exercise 4.2.2
Customers arrive in a certain store according to a Poisson process of rate η=4 per hour.
Given that the store opens at 9.00 AM, what is the probability that exactly one customer has arrived by 9.30 and a total of five have arrived by 11.30 AM?
We are asked to determine P[X(1/2)=1,X(5/2)=5]. Using the independence of X(5/2)−X(1/2) and X(1/2), we reformulate the request as:
P[X(1/2)=1,X(5/2)=5]=P[X(1/2)=1,X(5/2)−X(1/2)=4]
=e−4(1/2)1!4(1/2)1⋅e−4(2)4!4(2)4=(2e−2)3512e−8=0.0155
Non-homogeneous processes
A generalization of the Poisson process definition is to relax the stationarity hypothesis, by letting the rate η be a function of time: η(t). The probability of a single event occurring in an infinitesimal interval h of time is proportional to η:
P[X(t+h)−X(t)=1]=1!(ηh)e−ηh=(ηh)(1−ηh+O(h2))=ηh+o(h)
The probability of k events happening in a time interval (s,s+t] would then be given by:
P[X(t+s)−X(s)=k]=k!1∫st+s(η(t)t)ke−α(t)t
The Law of Rare Events
The Poisson distribution is the “discrete analog” of the normal distribution. The Law of Rare Events states that the total number of these rare events that do happen follows (approximately) a Poisson distribution.
Law of Rare Events, fixed probability case
Consider an experiment with a low and fixed probability p << 1 of success, which is repeated a high number N of times. In this case, the total number of successes XN,p after N trials follows a binomial distribution: P[XN,p=k]=k!(N−k)!N!pk(1−p)N−k, for k=0,…,n In the limit of rare events p→0 and infinite trials N→+∞, with a fixed success rate Np=μ>0, XN,p will follow the Poisson distribution: P[Xμ=k]=e−μk!μk, for k=0,1,2,…
Law of Rare Events: general case
Theorem 4.3.1: Let ν1,ν2,… be independent Bernoulli random variables, where:
P[\nui = 1] = pi
P[\nui = 0] = 1 - pi
and let Sn = \nu1 + ··· + \nun. The distribution of Sn is given by:
P[Sn=k]=∑xi=±1,x1+⋯+xn=k∏i=1npixi(1−pi)1−xi
which differs from a Poisson distribution with rate μ=p<em>1+⋅⋅⋅+p</em>n by at most:
∣P[S<em>n=k]−k!μke−μ∣≤∑</em>i=1npi2
In particular, if all pi→p and Np=μ is kept fixed, in the limit N→+∞, p=μ/N→0, and so does the RHS of 4.4.
An analog of the Law of Rare Events holds for stochastic processes, stating that the total counts of events generated by many independent processes can be approximately described by a single Poisson process.
Properties of Poisson Processes
Sum of Poisson processes
Theorem 4.4.1: Let X<em>1(t) and X</em>2(t) be two independent Poisson Processes with rates η<em>1,η</em>2. Then, the variable that counts both of them X(t)=X<em>1(t)+X</em>2(t) is a Poisson process itself with rate η=η<em>1+η</em>2.
Proof:
To prove that X(t) is a Poisson process, we verify the requirements in definition 1:
At the starting time t = 0, the number of events counted for both processes will be zero (X<em>1(0)=X</em>2(0)=0), and so their sum: X(0)=0
Since X<em>1 and X</em>2 have stationary and independent increments separately, so does X that is their sum.
Given the fact that the random variables X<em>1(t) and X</em>2(t) are Poisson distributed with parameter η<em>1t and η</em>2t and are independent of each other, their sum X(t)=X<em>1(t)+X</em>2(t) is therefore a Poisson distribution with parameter (η<em>1t+η</em>2t) as a consequence of theorem 4.1.1.
Filtering a Poisson process
Theorem 4.4.2: Let X(t) be a Poisson Process with rate η and let each event be independently marked as either type 1 with probability p, or type 2 with probability 1−p. Then, the events of the type 1 and 2 follow two independent Poisson Processes with rates ηp and η(1−p).
Proof:
As before, we start by verifying the 3 requirements of definition 1:
When we start counting since there are no events at all, so X<em>1(0)=X</em>2(0)=0
Since X has stationary and independent increments and the marking of events occurs independently, then X<em>1 and X</em>2 inherit from X the stationarity and independence of their respective increments.
The joint distribution of the number of arrivals in the two sub-processes before a fixed time t is:
P[X<em>1(t)=n,X</em>2(t)=m]=P[X1(t)=n∣X(t)=n+m]P[X(t)=n+m]
=(nn+m)pn(1−p)m(n+m)!e−ηt(ηt)n+m
=n!m!(n+m)!pn(1−p)m(n+m)!e−ηpte−η(1−p)t(ηt)n+m
=n!(ηpt)ne−ηptm!(ηt(1−p))me−η(1−p)t
From the last point we know that X<em>1(t) and X</em>2(t) are independent random variables when they are evaluated at the same instant t.
Other distributions
Depending on which aspect of the process we focus on, different distributions emerge.
Inter-arrival times
Let’s consider the arrival times (or waiting times) W<em>i at which a new event occurs, and the count X goes up by 1. We define the inter-arrival times (or sojourn times) S</em>i as the difference between two consecutive arrival times:
S<em>i=W</em>i+1−Wi
Clearly:
W<em>i=∑</em>k=0i−1Sk
For the inter-arrival times, we already know the answer:
Theorem 4.5.1: Inter-arrival times Si are i.i.d. exponential random variables with rate η.
Waiting times
Theorem 4.5.2: The waiting time Wn, i.e. the time needed for the n-th event to occur, has the gamma distribution whose probability density function is:
f<em>W</em>n(t)=(n−1)!ηntn−1e−ηt
If we fix the number n of events occurring in the time interval (0,t), then the joint probability of the arrival times W<em>i</em>i=1,…,n is that of an ordered sequence of uniformly chosen points.
Uniform distribution
Suppose we choose independently n points Ui uniformly in the interval (0,t).
The joint distribution of U<em>i</em>i=1,…,n is given by the product of n uniform pdfs.
Let’s call W<em>i the sequence of ordered U</em>i, with 0<W<em>1<W</em>2<⋅⋅⋅<Wn<t. Note that the Wi are not independent of each other, since they must satisfy the ordering.
Let us consider the probability of W<em>1 and W</em>2 respectively being inside two small intervals [w<em>1,w</em>1+Ωw<em>1] and [w</em>2,w<em>2+Ωw</em>2].
f<em>W</em>1,W<em>2(w</em>1,w<em>2)Ωw</em>1Ωw<em>2=P[w</em>1<W<em>1<w</em>1+Ωw<em>1,w</em>2<W<em>2<w</em>2+Ωw2]
=P[w<em>1<U</em>1<w<em>1+Ωw</em>1,w<em>2<U</em>2<w<em>2+Ωw</em>2]+P[w<em>1<U</em>2<w<em>1+Ωw</em>1,w<em>2<U</em>1<w<em>2+Ωw</em>2]
P[w<em>1<U</em>1<w<em>1+Ωw</em>1,w<em>2<U</em>2<w<em>2+Ωw</em>2]=tΩw<em>1tΩw</em>2
f<em>W</em>1,W<em>2(w</em>1,w<em>2)Ωw</em>1Ωw<em>2=2tΩw</em>1tΩw<em>2=t22Ωw</em>1Ωw2
f<em>W</em>1,W<em>2(w</em>1,w2)=t22
Generalizing this argument up to n elements, the number of permutations of n elements U<em>1,U</em>2…U<em>n is n!, whereas the joint pdf will be proportional to t−n. So, the joint probability density function for W</em>1,W<em>2,…,W</em>n is given by:
f<em>W</em>1,W<em>2…W</em>n(w<em>1,w</em>2,…,w<em>n)=tnn!, for 0<w</em>1<w<em>2<…<w</em>n<t
Theorem 4.5.3: Let W<em>1,W</em>2,… be the ordered occurrence times in a Poisson process of rate η>0. Let us condition on X(t)=N(t)=n, that is the fact that in interval (0,t) we observe exactly n events. Given their number, the arrival times of n events W<em>1,W</em>2,…,Wn have the joint probability density function:
f<em>W</em>1,…,W<em>n∣X(t)=n(w</em>1,…,wn)=tnn!, for 0<w1<⋅⋅⋅<wn<t
Proof:
Let’s first assume that all wi’s are distinct.
P[w<em>i<W</em>i<w<em>i+Ωw</em>i,i=1,…,n∣X(t)=n]=f<em>W</em>1,…,W<em>n∣X(t)=n(w</em>1,…,wn)Ωw<em>1⋅⋅⋅Ωw</em>n+o(Ωw<em>1,…,Ωw</em>n)
P[w<em>i<W</em>i<w<em>i+Ωw</em>i,i=1,…,nandzeroarrivalseverywhereelsein[0,t]∣X(t)=n]
=n!e−ηt(ηt)nηΩw<em>1e−ηΩw</em>1ηΩw<em>2e−ηΩw</em>2…ηΩw<em>ne−ηΩw</em>ne−η(t−∑<em>i=1nΩw</em>i)
=tnn!Ωw<em>1…Ωw</em>n
Suppose now that n events have happened in (0,t). Then, the probability of k < n events happening in (0, u), with u < t, is given by a Binomial distribution:
Theorem 4.5.4: Let X(t) be a Poisson process with rate η. Given the fact we know that in the interval (0,t) we have n arrivals, that is X(t) = n, we want to find the probability that the number of arrivals in a subset 0 <u<t is 0 < k < n. Then, in formulas:
P[X(u)=k∣X(t)=n]=(kn)(tu)k(1−tu)n−k
Theorem 4.5.5: Let X<em>1(t),X</em>2(t) be two concurrent independent Poisson processes with rates η<em>1,η</em>2. Given the total number of arrivals in interval (0,t) i.e. X<em>1(t)+X</em>2(t)=n, the probability of having k arrivals in the first process is:
P[X<em>1(t)=k∣X</em>1(t)+X<em>2(t)=n]=(kn)(η<em>1+η</em>2η</em>1)k(η</em>1+η2η<em>2)n−k
This probability is given by a binomial distribution. In fact, the probability p1 of a generic event belonging to 1 is the ratio between the rate η<em>1 of 1, and the total rate η</em>1+η2 of both processes.
Theorem 4.5.6: Let X<em>1(t) and X</em>2(t) be two independent Poisson processes with rates η<em>1,η</em>2 in the interval (0,t). Let s be a subset of t s.t. 0 0}. Let X(t) be the total number of particles created up to time t, and let M(t) count the number of alpha particles existing at time t.
We want now to find the number of particles present at time t: so we want to compute M(t) given that at the beginning the timer was zero, i.e. M(0)=0. We moreover condition on the number n of particles emitted up to time t, that is X(t)=n, where W</s><em><s>1,…,W</s></em><s>n<t are the times when particles were created.
Then, for each particle emitted, we have that the particle k still exists if and only if W</s><em><s>k+Y</s></em><s>k>t: the sum of its arrival and service times must be greater that the actual time t. Let us introduce the indicator function such that indicates whether a particle still exists at time t:
1</s><em><s>W</s></em><s>k+Y</s><em><s>k>t={1if W</s></em><s>k+Y</s><em><s>k>t 0if W</s></em><s>k+Yk<t
Summing on all indicator functions corresponding to all particles, we then obtain the probability that the number of existing particles is equal to m, conditioned on the total number of particles created up to time t that is n.
P(M(t)=m∣X(t)=n)=P(∑</s><em><s>k=1n1</s></em><s>W</s><em><s>k+Y</s></em><s>k>t=m∣X(t)=n)
Note that P[X</s><em><s>1(t)=n∣X(t)=n+m] is the probability of accepting exactly n events from n + m trials, where the success probability of each trial is p, which is given by a Binomial distribution. W</s></em><s>1,…,Wn is the same statistics we would have by dealing with ordered version of i.i.d. random variables in (0,t).
W</s><em><s>k+Y</s></em><s>k>t does not depend on the order of W</s><em><s>k and we have the condition X(t)=n, the theorem (4.11) allows us to replace the Wi’s with the same number of i.i.d. uniform random variables U</s></em><s>i’s in the interval (0,t], not facing any issue.
P(∑</s><em><s>k=1n1</s></em><s>W</s><em><s>k+Y</s></em><s>k>t=m∣X(t)=n)=P(∑</s><em><s>k=1n1</s></em><s>U</s><em><s>k+Y</s></em><s>k>t=m)
∑</s><em><s>k=1n1</s></em><s>U</s><em><s>k+Y</s></em><s>k>t=m becomes now independent of the total number of arrivals X(t)=n, since we are already considering it by taking the sum. Moreover both U</s><em><s>k and Y</s></em><s>k are i.i.d., so each of indicator function is a binary random variable independent of all others. The sum of these n indicator function is thus binomial with parameters n and p that is computed as:
p=P(U</s><em><s>k+Y</s></em><s>k>t)=t1∫</s><em><s>0tP(Y</s></em><s>k>t−u)du=t1∫</s><em><s>0t(1−G(t−u))du=t1∫</s></em><s>0t(1−G(z))dz
Where in the last step we just introduced a new variable z=t−u.
Now that we have obtained the probability of the binomial distribution we can rewrite relation above as:
P(M(t)=m∣X(t)=n)=(mn)pm(1−p)n−m
In order to remove the condition X(t)=n we marginalize over the distribution of X that we know is Poisson. Given that we have a binomial distribution of parameters (n,p) and n is Poisson distributed itself, if we want to find the unconditional distribution of M(t) we obtain a new Poisson, where the new η is then scaled according to p of the binomial. Mathematically:
P(M(t)=m)=∑n=m∞P(M(t)=m∣X(t)=n)P(X(t)=n)
=∑</s><em><s>n=m∞(mn)pm(1−p)n−mn!(ηt)ne−ηt=m!e−ηt(ηpt)m∑</s></em><s>n=m∞(n−m)!(1−p)n−mηtn−m
∑</s><em><s>n=m∞(n−m)!(1−p)n−mηtn−m=∑</s></em><s>j=0∞j!(ηt(1−p))j=eηt(1−p)
P(M(t)=m)=m!e−ηpt(ηpt)m, for m=0,1,…
ηpt=η∫0t(1−G(y))dy
As t→∞ becomes the expected service time, since the integrand is [1−G(y)], that is the tail of the distribution G(y).
For a generic t, the value of the integral depends on the details of the specific distribution G(y), whereas in the long run it depends only on the mean μ.
This implies that in the long run two distributions will converge, despite they are different, if both have the same mean.
Let us re-write the equation above using inference terminology:
∫0∞[1−G(y)]dy=μ1
ηpt=η∫0∞[1−G(y)]dy=μη
Shot Noise process
A Shot Noise process models electrical effects that are produced by the random arrival of electrons to an anode.
Let assume electrons arrive to an anode according to a Poisson process X(t);t>0 of constant rate η
An arriving e− produces a current whose intensity per unit of time after arrival is given by the impulse response function h(x).
The intensity of the current I(t) will be the superposition of the impulse response functions, that are generated by electrons arrived up to time t:
I(t)=∑</s><em><s>k=1X(t)h(t−W</s></em><s>k)
P(I(t)<x)=P(∑</s><em><s>k=1X(t)h(t−W</s></em><s>k)<x)=∑</s><em><s>n=0∞P(∑</s></em><s>k=1X(t)h(t−Wk)<x∣X(t)=n)P(X(t)=n)
Given their number n:
∑</s><em><s>n=0∞P(∑</s></em><s>k=1nh(t−U</s><em><s>k)<x)P(X(t)=n)=∑</s></em><s>n=0∞P(∑</s><em><s>k=1nh(U</s></em><s>k)<x)P(X(t)=n)=P(∑</s><em><s>k=1∞h(U</s></em><s>k)<x)
The expected value of a random sum is the product of the expected value of the number of terms (Poisson distributed), times the common expected value for each term (uniformly distributed).
E[I(t)]=E[X(t)]E[h(U</s><em><s>k)]=ηtt1∫</s></em><s>0th(u)du=η∫0th(u)du
Var(I(t))=ηtVar(h(U</s><em><s>k))+ηtE[h(U</s></em><s>k)]2=ηtE[h(U</s><em><s>k)2]=ηtt1∫</s></em><s>0th2(u)du=η∫0th2(u)du
Binomial theorem
Theorem 4.6.1: Let [X(t)] be a Poisson process of rate η>0. Then for 0 <u<t and 0 < k < n,
P(X(u)=k∣X(t)=n)=k!(n−k)!n!(tu)k(1−tu)n−k
Proof:
P(X(u)=k∣X(t)=n)=P(X(t)=n)P(X(u)=k and X(t)=n)
=P(X(t)=n)P(X(u)=k and X(t)−X(u)=n−k)
=n!e−ηtηtnk!e−ηuηuk(n−k)!e−η(t−u)(η(t−u))n−k
=k!(n−k)!n!tnuk(t−u)n−k
Dual version
P(X(s) = k | X(t) = n) \text{ 0 < n < k, 0<t<s)
= P(X(s-t) = k-n) = \frac{ e^{-\eta (s-t)} {\eta (s-t)}^{k-n} }{ (k-n)! }</s></p><p><s>AfinitestateregularMarkovchainhastransitionprobabilitymatrixP=∣Pij∣andlimitingdistribution\sigma = |\sigma i|.Inthelongrun,whatfractionofthetransitionsarefromaprescribedstatektoaprescribedstatem?</s></p><p><s>\sigma kPkm = \lim_{n\rightarrow} P(Xn = k , Xn+1 = m)</s></p><h5id="5ab5a5df−271e−4665−9c3c−459431cc162a"data−toc−id="5ab5a5df−271e−4665−9c3c−459431cc162a"collapsed="false"seolevelmigrated="true"><s>Exercise4.6.5</s></h5><p><s>Heretheprecisestepisn′timportant,beingeithernorn+1,webasicallyneedtocompute:</s></p><p><s>\lim_{n\rightarrow} P(Xn+1 = j|X0 = i) = \sigma j</s></p><ul><li><p><s>Thethirdone,inthelimitasn \rightarrow \inftyisthetimeshiftedversionoftheprobabilitywehadtofindinthepoint2),namely:<br>\lim{n\rightarrow} P(Xn = k , Xn+1 = j|X0 = i) = \lim{n\rightarrow} P(Xn-1 = k , Xn = j|X0 = i) = \sigma kP_{kj}</s></p></li><li><p><s>ComputeP(X1(2) = 1|X1(3) = 2)andP(X1(3) = 2|X1(2) = 1)</s></p><ul><li><p><s>ComputeP(X1(1) = 1|X1(2) + X2(2) = 3)andP(X1(2) + X2(2) = 3|X1(1) = 1)$$
Note that in both cases the chain is regular and it does not depend on the initial state.
P.A.S.T.A. property
How can we be sure that times sampled according to some specific rules, no matter they were upon arrivals or departures, are representative of the long run behaviour of our process?
Let us define the two probabilities pn(t) and an(t):
pn(t) = P{N(t) = n}
an(t) = P{N(t) = n | an arrival occurred just after time t}
pn(t) - seen by an external observer
an(t) - seen by a given user
P.A.S.T.A. stands for Poisson Arrivals See Time Averages. Time averages are the statis-tics seen by an external observer, and in the long run we know that Poisson arrivals will see the same statistics, thus concluding there is no bias