Learn
Lesson · Queues and Utilisation · Randomness

Memoryless Waiting: from Geometric to Exponential

Chop a second into slots of width Δ and give each slot an arrival with probability λΔ. The chance of still waiting after t is (1 − λΔ)^(t/Δ), exactly. Shrink Δ and that expression walks toward e^(−λt) — the exponential distribution, arriving as a limit of a distribution you already have.

P(T > t) = (1 − λΔ)^(t/Δ) exact, for slots of width Δ (1 − λΔ)^(t/Δ) → e^(−λt) as Δ → 0 E[T] = 1/λ the mean gap P(T > s + t | T > s) = P(T > t) memoryless, exactly, at every Δ λ = 1/2, t = 4: (19/20)⁴⁰ = 0.1285122 e^(−2) ≈ 0.1353353
One tail, two ways of computing it

Core ideas

What this lesson establishes

The geometric distribution from Discrete Mathematics is doing all the work here. The exponential is what it becomes when the slot stops mattering.

1

λΔ is a probability; λ is not

A rate of 1/2 arrivals a second is not a probability of 1/2. Chopped into slots of Δ = 1/10 second it becomes a probability of λΔ = 1/20 per slot, and that is the number a coin gets flipped against. Halve the slot and the per-slot probability halves with it; the rate does not move.

2

The limit is where e comes from

(1 − λΔ)^(t/Δ) is (1 − x/n)ⁿ with x = λt and n = t/Δ, and Algebra's the-number-e says where that goes. Nothing on this path writes a density or an integral: the exponential distribution is defined here by the limit of a geometric tail, and that is enough to compute with.

3

Memorylessness is exact, not a limit

The conditional tail P(T > s + t | T > s) equals P(T > t) at every slot size, for every s, with no approximation anywhere. It is not something the exponential acquires in the limit; the geometric already has it, and the limit inherits it.

The material

From a coin per slot to a continuous tail

The exact tail, the limit it approaches, the property both share, and why one of the two columns is printed as rounded.

Definition · Waiting in slots

Divide time into slots of width Δ. In each slot an arrival occurs with probability λΔ, independently. The waiting time T until the first arrival is geometric, and surviving t units of time means surviving t/Δ consecutive slots without one: P(T > t) = (1 − λΔ)^(t/Δ).

That expression is exact and rational. With λ = 1/2 per second, Δ = 1/10 second and t = 4 seconds it is (19/20)⁴⁰ — a ratio of two forty-digit integers, computed as a fraction and only then printed as a decimal.

λ = 1/2 per second, t = 4 s, so λt = 2 Δ = 1/10 s λΔ = 1/20, 40 slots (19/20)⁴⁰ = 0.1285122 Δ = 1/100 s λΔ = 1/200, 400 slots (199/200)⁴⁰⁰ = 0.1346580 Δ → 0 e^(−λt) = e^(−2) ≈ 0.1353353 gap at Δ = 1/10 0.0068231 gap at Δ = 1/100 0.0006772 about a tenth of it

Each tenfold refinement of the slot closes about nine tenths of the remaining gap, which is what “the error is of order Δ” looks like when it is printed rather than asserted. The exact column approaches the rounded one from below, because a slotted clock can only let an arrival happen at a slot boundary and so gives it slightly fewer chances.

Theorem · The memoryless property

For the geometric waiting time above, and for every whole number of slots s and t: P(T > s + t | T > s) = P(T > t). Having waited already tells you nothing about how much longer you will wait.

P(T > s + t | T > s) = P(T > s + t)/P(T > s) because the event T > s + t is contained in T > s. Substituting the tail formula gives (1 − λΔ)^((s+t)/Δ) / (1 − λΔ)^(s/Δ).

The powers subtract: the quotient is (1 − λΔ)^(t/Δ), which is P(T > t). Nothing about s survives the cancellation, which is the whole content of the property. It holds at every slot size, so it holds in the limit too.

□

Concretely: if the bus has not come for three minutes, the chance it takes another four is the same as it was when you arrived. Quiet time is not credit. This is the single most counter-intuitive fact on the course, and it is the assumption the M/M/1 model rests on — which is why it is worth being able to say precisely what it claims and what it does not.

What it does not claim is that arrivals are evenly spread. Memorylessness is exactly what makes bunching possible: nothing in the process discourages two arrivals landing in consecutive slots, because the process has no record of the first one.

One exact column and one rounded one

The geometric column is a fraction. The exponential column is not: e^(−λt) is computed by summing a series and is printed as rounded, with the method named on the page. The lab bounds λt at 12, because the series it uses loses significant digits to cancellation beyond that and a confident wrong number is worse than a refusal. The exact column has no such limit, which is the argument for exactness stated as a number.

The mean of the waiting time is 1/λ — two seconds at λ = 1/2 — and it is worth noticing that the tail at the mean is not a half: e^(−1) ≈ 0.368. An exponential wait is longer than its mean about 37% of the time, not half of it, and that asymmetry is the shape behind every long tail in the previous course.

Interactive

Memoryless waiting

The geometric tail exactly, and the exponential it becomes

From geometric to exponential(1 − λΔ)t/Δ exactly, against e−λt rounded
geometric, exactexponential, roundedthe gap

Method

Computing a waiting tail

Decide which number you want exact before deciding which formula to use.

1

Turn the rate into a per-slot probability

λΔ, with λ and Δ in the same unit of time. A per-slot probability above one is not a probability, which is the slot being too coarse for the rate.

2

Count the slots in the horizon

t/Δ, a whole number. The exact tail is (1 − λΔ) raised to that power, and because both are rational nothing is approximated.

3

Take the limit only when you want the shape

e^(−λt) is the limit, and it is quicker and independent of Δ. It is also rounded. Use it to reason about shape and use the exact column when the number goes into a decision.

4

Check the conditional tail if the answer surprises you

P(T > s + t | T > s) should equal P(T > t) for any s you try. If it does not, the model in your head has memory in it that the arithmetic does not.

Tails, limits and memory

Score 0 / 0

P(no arrival in four seconds) at half an arrival a second

The same probability computed at two slot sizes and in the limit, with the memoryless check underneath.

λ = 1/2 per second t = 4 s λt = 2 Δ = 1/10 s λΔ = 1/20 slots = 40 P(T > 4) = (19/20)⁴⁰ = 0.1285122 exact Δ = 1/100 s λΔ = 1/200 slots = 400 P(T > 4) = (199/200)⁴⁰⁰ = 0.1346580 exact Δ → 0 e^(−2) ≈ 0.1353353 rounded gaps 0.0068231 then 0.0006772 already quiet 3 s? P(T > 3 + 4 | T > 3) = (19/20)⁴⁰ = 0.1285122 the same number: the three seconds bought nothing

The two exact lines are fractions with forty and four hundred digit denominators, and they are computed as fractions. Only the last digit printed is rounding, and the e^(−2) line says on its face that it is the rounded one.

The final block is the property, not a coincidence of these numbers. Change the three seconds to thirty and the conditional tail is unchanged, which is either obvious or deeply strange depending on how long you look at it.

For a faded rehearsal, take λ = 1 per second and t = 3. The supplied first move is λt = 3, so the limit is e^(−3). Predict whether the geometric tail at Δ = 1/10 is above or below it before computing either.

Common mistakes

1
“It hasn't arrived in a while, so it's due”The conditional tail is identical for every amount of time already spent waiting, and the proof is two lines of cancellation. A process with no memory cannot owe you anything. The intuition that it does comes from timetables, which are the deterministic arm of the previous lesson.
2
Treating λ itself as a per-slot probabilityλ is a rate and can exceed one; λΔ is a probability and cannot. A model that flips a coin with probability λ per slot is running at a completely different rate from the one intended, and the error scales with how coarse the slot is.
3
Quoting the exponential figure as exacte^(−λt) is the limit, and on this page it is also a sum of a series printed to a few places. When a number is going into a decision, take the geometric column at the slot size you actually run at — it is a fraction, and it is the one the machine can check.

Check your understanding

✓
Finish when memorylessness is a property you can prove in two lines, not a slogan.

You should be able to turn a rate into a per-slot probability, compute P(T > t) exactly in slots, say where e^(−λt) comes from and which of the two is rounded, and show that the conditional tail does not depend on how long the wait has already lasted.

Note: The same shrinking-slot argument answers a different question: not how long until the next arrival, but how many arrive in a fixed window. “Poisson Arrivals and Bursts” builds that count from the binomial, and its variance turns out to equal its mean.

Kept in this browser only, for you. Nothing is sent anywhere and nothing checks it. Carry it to another device.

Feedback and recommendations

Something to change about this lesson? Write it down, tick it off when it is handled, and export the list when you want to act on it. Kept in this browser only: nothing is sent anywhere, and nobody is notified.

No recommendations yet for this lesson.