Keywords: M/G/1 queue, processor sharing service discipline, sojourn time ... and Doney [8] and the expression for the LaplaceâStieltjes transform (LST) of the.
Queueing Systems 35 (2000) 141–166
141
Sojourn time asymptotics in the M/G/1 processor sharing queue A.P. Zwart a and O.J. Boxma a,b a
Department of Mathematics and Computing Science, Eindhoven University of Technology, P.O. Box 513, 5600 MB Eindhoven, The Netherlands E-mail: {zwart,boxma}@win.tue.nl b CWI, P.O. Box 94079, 1090 GB Amsterdam, The Netherlands
Received 29 April 1998; revised 8 September 1999
We show for the M/G/1 processor sharing queue that the service time distribution is regularly varying of index −ν, ν non-integer, iff the sojourn time distribution is regularly varying of index −ν. This result is derived from a new expression for the Laplace–Stieltjes transform of the sojourn time distribution. That expression also leads to other new properties for the sojourn time distribution. We show how the moments of the sojourn time can be calculated recursively and prove that the kth moment of the sojourn time is finite iff the kth moment of the service time is finite. In addition, we give a short proof of a heavy traffic theorem for the sojourn time distribution, prove a heavy traffic theorem for the moments of the sojourn time, and study the properties of the heavy traffic limiting sojourn time distribution when the service time distribution is regularly varying. Explicit formulas and multiterm expansions are provided for the case that the service time has a Pareto distribution. Keywords: M/G/1 queue, processor sharing service discipline, sojourn time distribution, heavy tailed distributions, regular variation, heavy traffic theory
1.
Introduction
In this paper, we investigate asymptotic properties of the sojourn time distribution in the stable M/G/1 processor sharing (PS) queue. In the (egalitarian) processor sharing service discipline every customer is being served with rate 1/X with X the number of customers in the system. An extensive overview on processor sharing queues can be found in the surveys [41,42]. In particular, we are interested in the tail behaviour of the sojourn time distribution when the service time distribution B(x) has a heavy tail, i.e., 1 − B(x) ∼ hν x−ν ,
(1.1)
if x → ∞ (with f (x) ∼ g(x) we mean f (x)/g(x) → 1), and 1 < ν < 2. Queueing systems in which the tail of the service time behaves like (1.1) have recently become important in the performance modelling and analysis of communication traffic. The J.C. Baltzer AG, Science Publishers
142
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
main reason for this is that extensive traffic measurements for traffic in Ethernet local area networks [39], wide area networks [32], and VBR video [6], exhibit phenomena like self-similarity and long-range dependence – phenomena that can be explained by the occurrence of service requirements like in (1.1). A convenient class of distribution functions that satisfies (1.1) and enables a tractable asymptotic analysis is the class of distribution functions with regularly varying tails, see the appendix. The main result in this study is presented in theorem 4.1, which states that the sojourn time distribution of the M/G/1 processor sharing queue is regularly varying of index −ν if and only if the service time distribution is regularly varying of index −ν, ν not an integer. More precisely, theorem 4.1 provides explicit equivalents of the former in terms of the latter. To the best of the authors’ knowledge, this is the first asymptotic expansion for the sojourn time distribution in the M/G/1 processor sharing queue – even the asymptotic behaviour of the sojourn time distribution in the M/M/1 processor sharing queue seems to be unknown. Theorem 4.1 reveals a crucial property of the processor sharing service discipline. For the GI/G/1 queue in which the service discipline is first come first served (FCFS), Cohen [16] has shown that the waiting time distribution is regularly varying of index 1 − ν iff the service time distribution is regularly varying of index −ν. This implies that if the latter is the case, also the sojourn time is regularly varying of index 1 − ν, which means that the tail of the sojourn time distribution is even fatter than the tail of the service time distribution. This is due to the FCFS discipline, in which long jobs are favoured, and short jobs can be held up by long jobs. Theorem 4.1 implies that the processor sharing discipline is more effective in handling heavy-tailed service times: in a processor sharing system, short jobs can overtake long jobs, so the influence of long jobs on the sojourn time of short jobs is limited. This consideration has formed the main motivation for the present study. To establish theorem 4.1, we will use the Tauberian theorem due to Bingham and Doney [8] and the expression for the Laplace–Stieltjes transform (LST) of the sojourn time distribution given by Ott [31]. This transform is derived by representing the sojourn time as a functional on a branching process, cf. [40]. A more general relationship between branching processes and processor sharing queues is investigated in [25]. For an overview on the connections between regular variation and branching processes we refer to [10, chapter 8.12] and more in particular to [8,9]. In order to prove theorem 4.1, we rewrite the expression for the LST of the sojourn time distribution. Known expressions for the LST of the sojourn time, see [31,35,40], all contain contour integrals which are inversion formulas of Laplace transforms. We show how to get rid of these contour integrals and thus obtain a more explicit formula. Using this result, we show how the moments of the sojourn time can be calculated recursively and prove that the kth moment of the sojourn time is finite iff the kth moment of the service time is finite. Apart from the tail behaviour of the sojourn time distribution, we study some properties of the sojourn time in heavy traffic, in particular, when the service time
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
143
distribution satisfies (1.1). We give a new proof of a heavy traffic theorem due to Sengupta [36] and Yashkov [43] and prove a similar statement for the moments of the sojourn time in heavy traffic. When the service time has a Pareto distribution, it is possible to give an explicit formula for the heavy traffic limiting distribution. More generally, we show that the heavy traffic limiting distribution is regularly varying of index −ν if the service time distribution is regularly varying of index −ν, ν > 1. The paper is organised as follows. Preliminary results are given in section 2. In section 3, we derive a new expression for the Laplace–Stieltjes transform (LST) of the sojourn time distribution and study the moments of the sojourn time. Section 4 establishes the link between the tail behaviour of the service time and the sojourn time with theorem 4.1, of which the proof is given in section 5. The heavy traffic analysis is performed in section 6. Section 7 contains conclusions and suggestions for further research. A short overview of regular variation is given in the appendix. 2.
Preliminaries
For later use, we give in this section a short review of the M/G/1 PS queue. Customers arrive according to a Poisson process with rate λ > 0. The service time B of a customer has distribution B(t) with B(0+) = 0 and first moment 0 < β1 < ∞. Customers are served according to the processor sharing discipline: if X customers are present then they all receive service with rate 1/X. In this study, it is assumed that the workload is less than one, i.e., ρ := λβ1 < 1. The LST of the service time distribution is given by β(s). If the kth moment of the service time exists, it is denoted by βk . In the analysis in the next sections, the integrated tail distribution (or excess distribution) of the service time will be useful. The distribution function and LST of the excess service time are respectively given by Z t 1 e 1 − B(x) dx, t > 0, B(t) := β1 0 Z ∞ e e = 1 − β(s) , Re s > 0. β(s) := e−st dB(t) β1 s 0 It is well known, due to Sakata et al. [34] (see also [27]), that the steady state distribution (Pn )n>0 of the number of customers in the system is geometric and only depends on the service time through its mean: Pn = (1 − ρ)ρn . Determination of the distribution of the sojourn time of a customer in steady state, defined by the r.v. V , has turned out to be a more difficult problem. Define the r.v. V (τ ) as the sojourn time of a customer entering the system in steady state having a service time equal to τ . Define the LST of V (τ ) by v(s, τ ) := E e−sV (τ ) .
144
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
Yashkov has derived an expression for v(s, τ ) by writing the sojourn time as a functional on a branching process, see Yashkov [40]. Using the structure of the branching process, Yashkov found (and solved) a system of differential equations determining v(s, τ ). Similar results for v(s, τ ), each obtained by using a different approach, are obtained in [35,38]. For our purposes, the expression for v(s, τ ) derived in [31] is the most suitable one. It is given by (see also [31, pp. 367–368]) v(s, τ ) =
1−ρ , (1 − ρ)H1 (s, τ ) + sH2 (s, τ )
where the functions H1 and H2 are given by Z ∞ x − λ(1 − β(x)) e−xτ dH1 (s, τ ) = , x − s − λ(1 − β(x)) 0 Z ∞ ρx − λ(1 − β(x)) , e−xτ dH2 (s, τ ) = x(x − s − λ(1 − β(x))) 0
(2.1)
Re x > 0,
(2.2)
Re x > 0.
(2.3)
Define the kth moment of V (τ ) by vk (τ ). The first moment of V (τ ) is given by (cf. [28, p. 168]): τ . (2.4) v1 (τ ) = 1−ρ Note that v1 (τ ) is linear in τ. An immediate consequence of (2.4) (or of the expression for (Pn )n>0 and Little’s formula) is that the first moment of the sojourn time E[V ] is finite and equals β1 /(1 − ρ) if β1 < ∞. In section 3, we will show that a similar result holds for higher moments of the sojourn time. This property is contrasting with the FCFS service discipline, where finiteness of E[V ] requires β2 < ∞. We come back to this in section 4, where we study the tail behaviour of V. Closing the section, we define the n-fold convolution F n∗ of a distribution function F of a non-negative random variable by, for x > 0, F 0∗ (x) = 1, Z x F n∗ (x) = F (n−1)∗ (x − u) dF (u),
n = 1, 2, . . . .
0
3.
A new expression for the sojourn time distribution
The goal of this section is to provide a novel expression for v(s, τ ) that will be suitable for analysing the tail behaviour of the sojourn time distribution in the next section. In particular, we show that v(s, τ )−1 can be written as a power series in s. It turns out that the expression contains the LST of the waiting time distribution R(x) in the M/G/1 FCFS queue, which is given by the Pollaczek–Khintchine formula, i.e., Z ∞ 1−ρ e−sx dR(x) = . (3.1) ω(s) := e 1 − ρβ(s) 0
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
It can easily be shown by inversion of ω(s)k that, for k > 1 and x > 0, ∞ X n+k−1 k∗ k e n∗ (x). ρn B R (x) = (1 − ρ) k−1
145
(3.2)
n=0
We introduce some definitions before the main result of this section is presented. Define the coefficients αk (τ ), with k > 0 and τ > 0, by α0 (τ ) := 1, α1 (τ ) := τ /(1 − ρ), and for k > 2, Z τ k (τ − x)k−1 R(k−1)∗ (x) dx. (3.3) αk (τ ) := (1 − ρ)k x=0 Obviously, we can write αk (τ ) =
τ 1−ρ
k − δk (τ ),
with δ0 (τ ) = δ1 (τ ) := 0, and Z τ k (τ − x)k−1 1 − R(k−1)∗ (x) dx, δk (τ ) := k (1 − ρ) 0
(3.4)
k = 2, 3, . . . .
(3.5)
The next theorem expresses v(s, τ )−1 as a power series in s with coefficients (αk (τ ))/k!. Theorem 3.1. For Re s > 0, τ > 0: v(s, τ ) =
"
∞ k X s k=0
k!
#−1 αk (τ )
.
(3.6)
The theorem will be proven by analysing the LST of v(s, τ )−1 . It is also possible to prove theorem 3.1 without using transforms, starting from [41, formula (5.2)]. However, this proof is rather lengthy and therefore omitted. Instead, we give a short proof of theorem 3.1 with the aid of the following lemma. Lemma 3.1. For Re s > 0 and Re x > 0: Z ∞ 1 s 1 . e−xτ dv(s, τ )−1 = 1 + 1 − ρ x 1 − sω(x)/(x(1 − ρ)) 0
(3.7)
Proof. By (2.1)–(2.3) and (3.1) we have for Re x > 0: Z ∞ x − λ(1 − β(x)) s ρx − λ(1 − β(x)) e−xτ dv(s, τ )−1 = + x − s − λ(1 − β(x)) 1 − ρ x(x − s − λ(1 − β(x))) 0 1 s − sλ(1 − β(x))/x =1+ 1 − ρ x − s − λ(1 − β(x))
146
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
e s 1 − ρβ(x) e − s/x x 1 − ρβ(x) s 1 , x 1 − sω(x)/(x(1 − ρ))
1 1−ρ 1 =1+ 1−ρ =1+
which proves the lemma.
Proof of theorem 3.1. It is sufficient to show that the LST of the power series in the denominator of the right hand side of (3.6) has the same LST as v(s, τ )−1 for Re x > |s| + λ. It is not difficult to show using the expression for ω(s) that sω(x) (1 − ρ)x < 1 if Re x > |s| + λ. Hence, we have by lemma 3.1 that Z ∞ e−xτ dv(s, τ )−1 = 1 +
1 s 1 1 − ρ x 1 − sω(x)/(x(1 − ρ)) ∞ X 1 s k ω(x)k−1 . =1+ 1−ρ x
0
(3.8)
k=1
On the other hand, we have for k > 1, cf. (3.3): Z ∞ 1 k! e−xτ dαk (τ ) = k ω(x)k−1 , k x (1 − ρ) 0 which implies (3.5). As a first application of theorem 3.1 we show how the moments vk (τ ) can be found recursively. Note that all vk (τ ) exist and are equal to (−1)k ((∂ k /∂sk )v)(0, τ ), since theorem 3.1 implies that v(s, τ ) is analytic in s = 0. From (3.5) we obtain the identity v(s, τ )
∞ n X s n=0
n!
αn (τ ) = 1.
Differentiating both sides k times with respect to s and putting s = 0, we obtain the following result (with v0 (τ ) := 1). Corollary 3.1. For k > 1 and τ > 0, vk (τ ) = −
k X k j=1
j
vk−j (τ )αj (τ )(−1)j .
In particular, the variance of V (τ ) is given by Var V (τ ) = δ2 (τ ),
τ > 0.
(3.9)
(3.10)
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
147
This result is also obtained in [40]. Remark 3.1. Apart from being a tool in the proof of theorem 3.1, lemma 3.1 is also useful for the determination of a tractable expression for v(s, τ ). For example, if the service time is exponentially distributed with parameter µ, it is possible to invert the right-hand side of (3.7) by partial fraction expansion, which yields the following expression for v(s, τ ): s µ + λ − x1 (s) x1 (s)τ s µ + λ − x2 (s) x2 (s)τ 2ρ −1 e e v(s, τ ) = − − , 1 − ρ x1 (s)x0 (s) 1 − ρ x2 (s)x0 (s) 1−ρ with x0 (s) = x1 (s) − x2 (s) and i p 1h x1 (s) = s + λ − µ + (s + λ − µ)2 + 4µs , 2 i p 1h x2 (s) = s + λ − µ − (s + λ − µ)2 + 4µs . 2 Equivalence with the result in [15] can be established by noting that x1 (s) = λπ(s)−µ, where π(s) is the LST of the busy period distribution in the M/M/1 queue. We omit the details. More generally, the right-hand side of (3.7) can be inverted when the LST of the service time distribution is a rational function, since then also ω(s) and the right-hand side of (3.7) are rational functions. Remark 3.2. A challenging task is to derive more explicit expressions for the LST and the moments of V (τ ) when the service time distribution has a heavy tail. Recently, an explicit expression for the waiting time distribution in the standard M/G/1 queue with a particular class of heavy-tailed service time distributions has been found by Boxma and Cohen [12], and has been extended by Abate and Whitt [4]. These results can be used to calculate exact expressions for the second moment of V (τ ) (cf. (3.10) and (3.5) for k = 2) for a particular class of heavy-tailed service time distribution. It might be possible to use the results in [4,12] to obtain a tractable expression for v(s, τ ) using lemma 3.1. When the LST of the service time distribution is a rational function, it is possible to obtain an explicit expression for the waiting time distribution in the standard M/G/1 queue and to invert the right hand side of (3.7). However, this class of distribution functions does not satisfy (1.1). Remark 3.3. If β2 < ∞, we have the following two-term asymptotic expansion for vk (τ ): vk (τ ) = v1k (τ ) +
β2 ρ k(k − 1) k−1 τ + o τ k−1 , k 2β1 1 − ρ (1 − ρ)
τ → ∞.
148
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
This result can be derived by analysing the behaviour of δk (τ ) for τ → ∞ by means of its LST and applying the classical Tauberian theorem (cf. [18, appendix 4]). Then, apply corollary 3.1 and induction. We omit the details. The case k = 2 is similar to a result in [40]. Using corollary 3.1, it is not difficult to show that the kth moment of the sojourn time is finite iff the kth moment of the service time is finite. Corollary 3.2. For integer k > 1, E V k < ∞ ⇔ βk < ∞. Proof. Since V > B for any particular customer, ‘⇒’ is trivial. To prove ‘⇐’, fix k > 1 and write Z ∞ k vk (τ ) dB(τ ). (3.11) E V = 0
Note that, cf. (3.3), for j > 1, αj (τ ) 6
τj . (1 − ρ)j
From this and corollary 3.1, it is easily shown that vk (τ ) 6
Ck τ k, (1 − ρ)k
(3.12)
with C0 = 1 and Ck =
k−1 X k j=0
j
Cj ,
k > 1.
The proof follows from (3.11)–(3.13).
(3.13)
Corollary 3.2 indicates that the tail behaviour of the service time distribution and the sojourn time distribution are similar. In the next section, we will study this relation in the case that the service time distribution or the sojourn time distribution has a regularly varying tail of index −ν. 4.
Sojourn time asymptotics for a heavy tailed service time distribution
In this section we present theorem 4.1, the main result in this study. Theorem 4.1 establishes an equivalence between the tail behaviour of the service time distribution and the sojourn time distribution. With L we denote a slowly varying function, cf. the appendix.
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
149
Theorem 4.1. Let ν > 1, ν not an integer. The following are equivalent: (i) (ii)
P(B > x) ∼ x−ν L(x), x → ∞, −ν −ν P(V > x) ∼ (1 − ρ) x L(x), x → ∞.
The proof of theorem 4.1 is based on lemma A.1 in the appendix and theorem 3.1 and will be presented in the next section. Taking corollary 3.2 into account (see also remark 4.2 below), we expect the result of theorem 4.1 to be true for all ν > 1. A proof for integer ν will bring extra difficulties, see [10, chapter 3 and theorem 8.1.6]. We refer to De Meyer and Teugels [21], where a similar statement has been proven for the busy period in the M/G/1 queue. They give a proof for general ν > 0, including integer values. Note that 1 < ν < 2, the heavy-tailed case, is the most interesting one, see also section 1. Remark 4.1. For the GI/G/1 queue with FCFS service discipline, Cohen [16] has shown that the tail of the waiting time is regularly varying of index 1 − ν iff the service time is regularly varying of index −ν, ν > 1. The same result holds for the sojourn time distribution. Theorem 4.1 shows that, in the M/G/1 queue with processor sharing, the sojourn time is as heavy as the tail of the service time. This reveals a crucial property of processor sharing: Long jobs have a much smaller effect on the delay of other customers than in the case of FCFS, where the heavy-tailed service time distribution gives rise to an even heavier tail of the sojourn time distribution. Remark 4.2. Note that both (i) and (ii) in theorem 4.1 imply P(V > x) ∼ P B > (1 − ρ)x ,
(4.1)
for x → ∞. It is possible to give an interpretation of the constant (1 − ρ) appearing in (4.1). When a tagged customer is in the system for a long time, the distribution of the total number of customers is approximately equal to the steady state distribution of the number of customers in a processor sharing queue with one permanent customer. This model is a special case of the M/G/1 generalised processor sharing queue, as studied by Cohen [17]. Using the results obtained in [17], it is possible to show that the mean service rate in steady state for the tagged (permanent) customer equals 1 − ρ. Hence, if a tagged customer has been in the system for x time periods, with x large, one would expect that the amount of service attained is equal to x(1 − ρ). It must be emphasised that the above heuristics do not apply in general. For example, (4.1) is not true if the service time is exponentially distributed, as can be shown from the expression for P(V > x) in the M/M/1 PS queue given by Morrison [30]. An explanation for this is that, when the service time distribution is exponential, the tagged customer does not stay in the system long enough to reach the equilibrium situation sketched above.
150
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
Remark 4.3. A result related to the observations in remark 4.2 is the following. If β1 < ∞, then V (τ ) 1 → , τ 1−ρ
τ → ∞,
where the convergence is in probability. This follows immediately from Var(V (τ )) = o(τ 2 ), τ → ∞, and Chebyshev’s inequality (the first argument can be derived from (3.10) and the fact that R(x) is a proper distribution function). We conjecture that the convergence also holds with probability one. Remark 4.4. The asymptotics for vk (τ ) given in remark 3.3 are not valid if 1−B(x) = x−ν L(x), 1 < ν < 2. However, it is still possible to obtain a two-term expansion for vk (τ ) in this case. We mention the result for k = 2. B(2, 2 − ν) 2λ 3−ν L(τ ), τ → ∞, (4.2) τ v2 (τ ) − v12 (τ ) = Var V (τ ) = δ2 (τ ) ∼ (1 − ρ)3 ν − 1 where B(·, ·) is the Beta-function. This result can be derived from Karamata’s theorem (see (A.3) in the appendix) and the asymptotics for 1 − R(x) given by Cohen [16]. A similar result holds for vk (τ )−v1k (τ ), k > 2, which can be derived from corollary 3.1 and asymptotics for 1 − R(k−1)∗ (x) (cf. (A.6)). We omit the details. Remark 4.5. Define the delay time W of a customer entering the system in steady state as the sojourn time minus the length of the service request. The conditional delay time W (τ ) is given by (cf. [41]) W (τ ) = V (τ ) − τ. The LSTs of W and W (τ ) are denoted by w(s) and w(s, τ ). Note that ρτ , E W (τ ) = 1−ρ w(s, τ ) = esτ v(s, τ ).
(4.3)
(4.4) (4.5)
One can show that the kth moment of W is finite iff the kth moment of the service time is finite. If the latter is the case, this follows from corollary 3.2 and the fact that W 6 V for any particular customer. If the former holds, use Jensen’s inequality and ρ > 0: k Z ∞ k Z ∞ k ρ ρ k k E W (τ ) dB(τ ) > τ dB(τ ) = βk . ∞>E W = 1−ρ 1−ρ 0 0 If the service time distribution is regularly varying of index −ν, 1 < ν < 2, it is possible to show from (4.3)–(4.5), following a similar analysis as in the proof of theorem 4.1 in the next section, that for x → ∞, ρ B>x . P(W > x) ∼ P 1−ρ
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
5.
151
Proof of theorem 4.1
First, we will give a proof for the case 1 < ν < 2. The proof for the case ν > 2 is somewhat different. In both cases, we will use the relation Z ∞ v(s, τ ) dB(τ ), v(s) = 0
and the expression for v(s, τ ) given by theorem 3.1. Also, the Tauberian theorem of Bingham and Doney [8] (see lemma A.1 in the appendix) is applied in both cases. It turns out that the asymptotic analysis of v(s) for s → 0 is rather intricate. In several cases we need to write v(s) − β(s/(1 − ρ)) and related quantities (like the residual term of a Taylor expansion of v(s) − β(s/(1 − ρ)) in the case ν > 2) as Z h(s) Z ∞ s v(s, τ )−e−sτ /(1−ρ) dB(τ )+ v(s, τ )−e−sτ /(1−ρ) dB(τ ), = v(s)−β 1−ρ 0 h(s) for some function h(s) like h(s) = 1/s. This decomposition turns out to be convenient. In most cases, we only need a trivial upper bound for the last integrand, and a nontrivial upper bound for the first integrand, using the inequality τ 6 h(s). Case I: 1 < ν < 2 By the Tauberian theorem of Bingham and Doney [8] (see lemma A.1 in the appendix) and the fact that E(V ) = β1 /(1 − ρ), it suffices to show that s = o sν L(1/s) v(s) − β (5.1) 1−ρ for s ↓ 0 and s real. First, note that v(s) − β(s/(1 − ρ)) > 0 for real s by Jensen’s inequality and (2.4) (or by using δk (τ ) > 0 and theorem 3.1): Z ∞ Z ∞ v(s, τ ) dB(τ ) = E e−sV (τ ) dB(τ ) v(s) = 0 Z ∞ Z0 ∞ s . e−sE[V (τ )] dB(τ ) = e−sτ /(1−ρ) dB(τ ) = β > 1−ρ 0 0 The following representation for v(s) − β(s/(1 − ρ)) is crucial in the remainder of the proof. By our representation in theorem 3.1 for v(s, τ ) and (3.4) we have Z ∞ s v(s) − β = v(s, τ ) − e−sτ /(1−ρ) dB(τ ) 1−ρ Z0 ∞ 1 −sτ/(1−ρ) P dB(τ ) −e = k esτ /(1−ρ) − ∞ 0 k=2 (s /k!)δk (τ ) Z ∞ −2sτ /(1−ρ) P∞ k e k=2 (s /k!)δk (τ ) P = dB(τ ). ∞ −sτ /(1−ρ) k 1−e 0 k=2 (s /k!)δk (τ )
152
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
Define
P k e−2sτ /(1−ρ) ∞ k=2 (s /k!)δk (τ ) P . f (s, τ ) := k 1 − e−sτ /(1−ρ) ∞ k=2 (s /k!)δk (τ )
We assume that statement (i) of theorem 4.1 holds with equality and prove statement (ii). To prove (ii), we have to bound f (s, τ ). It turns out that we only need a nontrivial upper bound for f (s, τ ) if τ 6 T1 /s for some finite constant T1 . Therefore, we write for 0 < T1 < ∞: Z
Z
∞
f (s, τ ) dB(τ ) = 0
Z
T1 /s
∞
f (s, τ ) dB(τ ) +
f (s, τ ) dB(τ ).
(5.2)
T1 /s
0
Bounding the first term in the right hand side of (5.2) will be our main task. The second term can be bounded by using f (s, τ ) 6 v(s, τ ) 6 1: −ν T1 T1 f (s, τ ) dB(τ ) 6 L . s s T1 /s
Z
∞
Since T1 can be chosen arbitrarily large, (5.1) and the first part of theorem 4.1 follow once we have proven that Z
T1 /s
f (s, τ ) dB(τ ) = o sν L(1/s) .
(5.3)
0
Proof of (5.3).
Since δk (τ ) 6 (τ /(1 − ρ))k , it follows that
e−sτ/(1−ρ) e−sτ/(1−ρ) P 6 k 1 − e−sτ /(1−ρ) ∞ 1 − e−sτ /(1−ρ) (esτ /(1−ρ) − sτ/(1 − ρ) − 1) k=2 (s /k!)δk (τ ) 1 = . 1 + sτ/(1 − ρ) Hence, ∞
∞
k=2
k=2
X sk X sk 1 e−sτ /(1−ρ) δk (τ ) 6 e−sτ /(1−ρ) δk (τ ). f (s, τ ) 6 1 + sτ /(1 − ρ) k! k!
(5.4)
Obtaining an upper bound for δk (τ ) will be crucial in the proof of (5.3). In view of (3.5), we need an upper bound for 1 − R(k−1)∗ (x). By a result of Cohen [16], we have that 1 − R(x) is regularly varying of index 1 − ν. Hence, for each ε > 0 there exists an M such that, for x > 0, 1 − R(x) 6 M (x + 1)1−ν+ε .
(5.5)
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
153
Let (Wi )i>1 be a sequence of i.i.d. random variables (defined on the same probability space) with distribution function R(x). Then, we have ! k−1 [ x Wi > 1 − R(k−1)∗ (x) = P(W1 + · · · + Wk−1 > x) 6 P k−1 i=1 x 6 (k − 1)P W1 > . k−1 Hence, by 1 < ν < 2 and (5.5) we get for k > 2 1−ν+ε x (k−1)∗ +1 1−R (x) 6 (k − 1)M 6 (k − 1)2 M (x + 1)1−ν+ε . k−1
(5.6)
In the sequel, we choose ε fixed such that 0 < 2ε < ν − 1 and ν + ε < 2. By (3.5) and (5.6), we have for some finite constant M 0 and k > 2 Z k+1−ν+ε M k(k − 1)2 τ k−1 τ 1−ν+ε 0 2 τ δk (τ ) 6 (x + 1) dx 6 M (k − 1) k . (5.7) (1 − ρ)k (1 − ρ)k 0 Define
T1 M0 . 1+ M := (1 − ρ)2 1−ρ 00
Since τ 6 T1 /s, it follows from (5.7) after some simple calculations that f (s, τ ) 6 e−sτ/(1−ρ)
∞ k X s k=2
k!
M 0 (k − 1)2 k
τ k+1−ν+ε (1 − ρ)k
2 X k ∞ sτ k+1 sτ =M τ e 1−ρ k! 1−ρ k=0 2 3 2 sτ sτ T1 sτ 6 M 0 τ 1−ν+ε 1+ 6 M 0 τ 1−ν+ε + 1−ρ 1−ρ 1−ρ 1−ρ 0 1−ν+ε −sτ /(1−ρ)
= M 00 s2 τ 3−ν+ε 6 M 00 sν+ε τ 1+2ε T12−ν−ε .
(5.8)
Since 1 + 2ε < ν, the right hand side of (5.8) is B(τ )-integrable. This proves (5.3), since L(1/s) = o(sδ ), s → 0, for all δ > 0, cf. (A.2) in the appendix. Now, suppose that statement (ii) of theorem 4.1 holds with equality. Again, it suffices to prove (5.1). A simple, but important observation is that for all x > 0, P(B > x) 6 P(V > x).
(5.9)
First, we show that (5.9) and (ii) together imply (5.5). Fix 0 < ε < (1/2)(ν − 1). (ii) implies that E[V ν−(1/2)ε ] < ∞. Hence, by (5.9), also E[B ν−(1/2)ε ] < ∞. It follows that for s → 0 (cf. Lo`eve [29, p. 199]) β(s) = 1 − β1 s + O |s|ν−(1/2)ε ,
154
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
and by (3.1), for s → 0,
ω(s) = 1 + O |s|ν−1−(1/2)ε = 1 + o sν−1−ε .
Finally, by [11, lemma 2.2] (see also lemma 8.1 with C = 0 in the appendix), we have for x → ∞ 1 − R(x) = o x1−ν+ε , which implies (5.5). Following the arguments made in the first part of the proof, we obtain (5.8), which in turn implies (5.3). A second application of (5.9) to the second term in (5.2), together with (5.3), yields (5.1). Case II: ν > 2 The proof in this case is different from case I, because we need the property β2 < ∞ (which follows from both (i) and (ii) if ν > 2). Again, we will apply lemma A.1. Suppose that (i) holds with equality for n < ν < n + 1. Write for real s>0 X Z ∞ n k (−s)k s βk − E V − = Rn (s, τ ) dB(τ ), v(s) − β 1−ρ k! (1 − ρ)k 0 k=0
with Rn (s, τ ) being the residual term of the n-term Taylor expansion of f (s, τ ) in s = 0, i.e., Rn (s, τ ) = f (s, τ ) −
n X sk k=0
k!
f (k) (0, τ ),
(5.10)
with ∂k . f (s, τ ) s=0 ∂sk Since f (s, τ ) is analytic in s = 0, we can apply Taylor’s theorem, which gives, for s in a neighbourhood of 0, Z Z s s (s − u)n (n+1) (n+1) 6 sn f Rn (s, τ ) = f (u, τ ) du (u, τ ) du. (5.11) n! 0 0 f (k) (0, τ ) :=
Note that Taylor’s theorem cannot be applied to the n-term Taylor expansion of v(s) − β(s/(1 − ρ)), since the latter function is not n+1 times differentiable in s = 0, because βn+1 = ∞. Hence, one cannot interchange the limit s → 0 and the integration with respect to τ (in that case, the proof would be finished since the residual term is O(sn+1) due to the mean value theorem). It suffices to show that Z ∞ Rn (s, τ ) dB(τ ) = o sν L(1/s) , s ↓ 0. (5.12) 0
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
155
To prove (5.12), we will construct an upper bound for |f (n+1) (s, τ )|. Using the probabilistic interpretation of f (s, τ ) we get for some finite constant M n+1 (n+1) n+1 τ −sV (τ ) −sτ /(1−ρ) f (s, τ ) = E V (τ ) e − e 1−ρ n+1 (τ ) e−sV (τ ) − E V n+1 (τ ) E e−sV (τ ) 6 E V n+1 n+1 −sV (τ ) −sV (τ ) τ + E V − (τ ) E e E e 1−ρ n+1 n+1 τ τ + E e−sV (τ ) − e−sτ/(1−ρ) 1−ρ 1−ρ n+1 n+1 τ −sV (τ ) 6 Cov V (τ ), e + vn+1 (τ ) − 1−ρ n+1 τ + f (s, τ ) 1−ρ n+1 n+1 τ τ n+1/2 −sτ 6 Mτ e + vn+1 (τ ) − + f (s, τ ). 1−ρ 1−ρ The last inequality follows from the inequality of Cauchy–Schwarz, q Var e−sV (τ ) 6 e−sτ (V (τ ) > τ ), and, cf. remark 3.3, since β2 < ∞, 2 (τ ) = O τ 2n+1 , Var V n+1 (τ ) = v2n+2 (τ ) − vn+1 Hence, from (5.11) it follows that Z ∞ Z Rn (s, τ ) dB(τ ) 6 M sn 0
Z
∞
τ 0
n+1/2
s
0
τ → ∞.
e−uτ du dB(τ )
n+1 τ vn+1 (τ ) − dB(τ ) +s 1−ρ 0 Z ∞ Z s −(n+1) n n+1 + (1 − ρ) s τ f (u, τ ) du dB(τ ). n+1
Z
∞
0
0
The second term is integrable, since β2 < ∞, cf. remark 3.3. To bound the other terms, it turns out that it is convenient to split the integrals up in two parts. It suffices to show that Z s−1 Z s n n+1/2 τ e−uτ du dB(τ ) = o sν L(1/s) , s ↓ 0, (5.13) s Z0 ∞ Z 0s τ n+1/2 e−uτ du dB(τ ) = o sν L(1/s) , s ↓ 0, (5.14) sn s−1
0
156
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
Z Z s
Z s τ n+1 f (u, τ ) du dB(τ ) = o sν L(1/s) , Z s0 n+1 τ f (u, τ ) du dB(τ ) = o sν L(1/s) ,
s−α
sn 0
n
∞
s−α
s ↓ 0,
(5.15)
s ↓ 0.
(5.16)
0
In (5.15) and (5.16) α > 1 is chosen such that n + 1 − 1/α < ν. We prove only (5.15) and (5.16) because the proofs of (5.13) and (5.14) are similar and somewhat easier. Proof of (5.15). Using the Pollaczek–Khintchine formula for the mean waiting time in the M/G/1 FCFS queue (see, e.g., [18, p. 256]), we obtain the result Z ∞ kτ k−1 τ k−1 β2 ρ (k−1)∗ . (5.17) (x) dx = k(k − 1) 1 − R δk (τ ) 6 k k (1 − ρ) 0 (1 − ρ) 2β1 1 − ρ It follows easily from the first inequality in (5.4) and (5.17) that, with β2 ρ , 2β1 1 − ρ K s2 τ K 6 s. f (s, τ ) 6 2 1 + sτ (1 − ρ) (1 − ρ)2 K :=
(5.18)
The proof of (5.15) follows easily from (5.18). Since sτ 1/α 6 1 if τ 6 s−α , it follows that, for s ↓ 0, Z s−α Z s Z s−α 1 K n n+1 n+2 τ f (u, τ ) du dB(τ ) 6 s τ n+1−1/α τ 1/α dB(τ ) s 2 2 (1 − ρ) 0 0 0 Z s−α sn+1 K 6 τ n+1−1/α dB(τ ) 2 (1 − ρ)2 0 K sn+1 E B n+1−1/α = o sν L(1/s) . 6 2 2 (1 − ρ) To prove (5.13), use the inequality e−uτ 6 1 and a similar technique as in the last part of the proof of (5.15). Since V (τ ) > τ , we have
Proof of (5.16).
f (s, τ ) 6 v(s, τ ) = E e−sV (τ ) 6 e−sτ .
It follows for s > 0,
Z
s
Z f (u, τ ) du 6
0
This gives
Z s
n
s−α
τ
e−uτ du =
0
Z
∞
∞
s
n+1 0
Z f (u, τ ) du dB(τ ) 6 s
n
1 . τ ∞
s−α
τ n dB(τ ).
(5.19)
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
157
Define δ := ν − n > 0. Fix ε > 0 such that αε < (α − 1)δ. For s small enough we have that L(τ ) 6 τ ε if τ > s−α . Using partial integration, we get, if s ↓ 0, Z ∞ Z ∞ n n n τ dB(τ ) 6 −s τ n d 1 − B(τ ) s s−α s−α Z ∞ n(1−α) −α n =s 1 − B(s ) + s n 1 − B(τ ) τ n−1 dτ s−α Z ∞ τ −1−δ+ε dτ 6 sn+αδ−αε + nsn s−α
n sn+αδ−αε = o sν L(1/s) , = sn+αδ−αε + δ−ε since n + αδ − αε > ν. This proves (5.16). The proof of (5.14) is similar to that of (5.16). We conclude that (5.12) holds, which implies (ii). The proof of the implication (ii) ⇒ (i) follows by the same arguments and (5.9). Remark 5.1. In the proof for the case ν < 2, we constructed an upper bound for 1 − R(k−1)∗ (x). In the part (i) ⇒ (ii), it is sufficient to use the upper bound provided by (A.7) in the appendix, which is valid for subexponential distribution functions. However, in the converse direction, it is not possible to apply (A.7), since in that case 1 − R(x) need not be subexponential. 6.
Heavy traffic and heavy tails
In this section we give a new proof of a heavy traffic theorem, due to Sengupta [36] and Yashkov [43], based on theorem 3.1. We will show that the ‘contracted’ moments of the sojourn times converge to the moments of the limiting distribution. Finally, we give both explicit and asymptotic results for the sojourn time distribution in heavy traffic when the service time distribution has a regularly varying tail. 6.1. General results We present a new proof for the following result, see [36,43]. Theorem 6.1. If β1 < ∞, then lim v s(1 − ρ), τ =
1 , ρ→1 1 + sτ lim P (1 − ρ)V (τ ) 6 x = 1 − e−x/τ , ρ→1
Re s > 0, τ > 0,
(6.1)
x > 0, τ > 0.
(6.2)
158
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
A heavy traffic theorem for the GI/G/1-PS queue is also known, see Grishechkin [26]. Note that it is only required that the first moment of the service time distribution is finite, which is not the case in the FCFS service discipline, cf. [13,18]. Proof. Note that (6.1) and (6.2) are equivalent. Since " #−1 ∞ k X s k (1 − ρ) αk (τ ) v s(1 − ρ), τ = 1 + sτ + , k! k=2
it suffices to show that, for k > 2, lim (1 − ρ)k αk (τ ) = 0.
ρ→1
(6.3)
This follows immediately from (3.3) and the fact that limρ→1 R(x) = 0 for x > 0. Indeed, when β2 < ∞ this follows from the heavy traffic limit in [18, p. 597]. If e e n∗ (x) 6 B e n (x), < 1. Hence, since B β2 = ∞, then it must hold that B(x) R(x) = (1 − ρ)
∞ X
e n∗ (x) 6 ρn B
n=0
1−ρ → 0, e 1 − ρB(x)
when ρ → 1.
Since v(s(1 − ρ), τ ) 6 1 we have by dominated convergence and theorem 6.1 the following heavy traffic limit for the unconditional sojourn time distribution. Corollary 6.1. For Re s > 0, lim v s(1 − ρ) =
ρ→1
and lim v s(1 − ρ) =
ρ→1
Z
∞
0
Z
∞
1 dB(τ ), 1 + sτ
(6.4)
e−x β(sx) dx.
(6.5)
0
Proof. (6.4) follows from theorem 6.1 and Lebesgue’s dominated convergence theorem (v(s(1 − ρ), τ ) 6 1). (6.5) follows easily from (6.4) since Z ∞Z ∞ Z ∞ Z ∞ 1 −x−sτ x dB(τ ) = e dx dB(τ ) = e−x β(sx) dx. 1 + sτ 0 0 0 0 This result has also been obtained by Sengupta [36]. Note that (6.5) is the LST of a random variable Y := XB, where B is equal to the service time and X is exponentially distributed with mean 1 and independent of B. A similar interpretation is given in [36], where it serves as a basis for approximations for the sojourn time distribution in the GI/G/1-PS queue.
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
159
We now turn to convergence of the moments of the sojourn time in heavy traffic. It will be shown that the moments of the contracted sojourn times converge to the corresponding moments of the heavy traffic limiting distribution. Theorem 6.2. If β1 < ∞, then k lim E (1 − ρ)V (τ ) = k!τ k , ρ→1
τ > 0, k > 1.
Proof. We apply induction on k. Fix τ > 0. By (2.4), the result holds for k = 1. Suppose the result is true for n 6 k − 1. By corollary 3.1 we have k E (1 − ρ)V (τ ) = (1 − ρ)k vk (τ ) k X k (1 − ρ)k−j vk−j (τ )(1 − ρ)j αj (τ )(−1)j . (6.6) =− j j=1 The result follows after some simple calculations for n = k by the induction hypothesis, (6.3), and (1 − ρ)α1 (τ ) ≡ τ . A similar result holds for the unconditional moments of the sojourn time, whenever they exist. Corollary 6.2. If βk < ∞, k > 1, then k lim E (1 − ρ)V = k!βk . ρ→1
Proof.
The same idea as in the proof of corollary 3.2 is used. Write Z ∞ k (1 − ρ)k vk (τ ) dB(τ ). E (1 − ρ)V = 0
Note that, cf. (3.4), (1 − ρ)k αk (τ ) 6 τ k .
(6.7) (1 − ρ)k vk (τ )
From (6.6), (6.7) and by induction on k, it is trivially seen that 6 Ck τ k , with C0 = 1 and Ck , k > 1, given in (3.13). The result follows by dominated convergence and theorem 6.2. Both theorem 6.2 and corollary 6.2 can be used for the approximation of higher moments for the sojourn time distribution. Note that corollary 6.2 provides a certain robustness, since the heavy traffic behaviour of the kth moment of the sojourn time is completely determined by the kth moment of the service time. Van den Berg [38, chapter 4], has proven theorem 6.2 and corollary 6.2 in the case k = 2. Numerical results in [38] indicate that the heavy traffic approximation for the second moment of the sojourn time performs well.
160
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
Remark 6.1. Abate and Whitt [3] perform a heavy traffic analysis for the waiting time in the M/G/1 LIFO system. They prove a heavy traffic theorem for the moments of the waiting time under additional assumptions to meet uniform integrability conditions. The latter concept can also be applied in our case without making any additional assumptions. Note that in our case the kth moment of the heavy traffic limiting distribution is equal to k!βk if βk < ∞. 6.2. An explicit expression for the limiting distribution Let VHT be a rv with a distribution equal to the heavy traffic limit, i.e., P(VHT 6 x) := lim P (1 − ρ)V 6 x . ρ→1
If the service time has a Pareto distribution, given by r − 1 r −r r−1 1 − B(τ ) = , r>1 τ , τ> r r
(6.8)
(B(τ ) = 0 otherwise), an explicit expression for P(VHT 6 x) can be found if r is integer-valued and a multiterm asymptotic expansion is available for P(VHT 6 x) if r is non-integer. A similar result holds if we consider finite mixtures of (6.8). To show this, we exploit results of Abate and Whitt [1]. They define the class of Pareto Mixtures of Exponentials (PME) as follows. A distribution function F is a PME if Z ∞ e−x/τ dB(τ ), x > 0, (6.9) 1 − F (x) = 0
with B(·) given by (6.8). From this definition and (6.2) we can conclude that the heavy-traffic limiting distribution is a PME if the service time distribution is Pareto. We get, cf. [1], Z ∞ Z ∞ r − 1 r −r−1 −x/y −x/y P(VHT > x) = e dB(y) = e r y dy r 0 (r−1)/r Z r − 1 r r/(r−1) −yx r−1 e y dy. =r r 0 This expression is (up to a multiplicative constant) equal to the incomplete gamma function. Applications of well known results for the incomplete gamma function (see Abramovitz and Stegun [5, (4.2.55) and section 6.5]) give the following results. For r > 2 integer, we have " r−1−k # r−1 X xr r − 1 r r! 1 1 − e−rx/(r−1) . P(VHT > x) = r xr (r − 1 − k)! r − 1 k=0
(6.10)
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
161
And, for non-integer r > 1, rx r−1 −rx/(r−1) r−1 r r Γ(r) − e P(VHT > x) = r xr r−1 r−1 (r − 1)(r − 2) × 1+ + · · · . (6.11) + rx/(r − 1) (rx/(r − 1))2 It is not difficult to obtain an explicit expression for P(VHT > x) when the service time distribution is a mixture of (6.8). In that case, the distribution of VHT is a mixture of PME’s, which implies that P(VHT > x) is given by a mixture of (6.10) and (6.11). Both (6.10) and (6.11) indicate that a one-term asymptotic expansion for the heavy traffic limiting distribution will behave quite accurately since the residual terms decrease exponentially fast if x → ∞ (cf. the observation in [1, p. 321]). Another interesting observation is that the one-term expansion for P(VHT > x) behaves like Γ(r + 1)P(B > x), x → ∞. In the next section, we will show that this property still holds if we only assume that the service time distribution is regularly varying. 6.3. Tail behaviour In this subsection we study the behaviour of P(VHT > x) for x large in the case that the service time distribution is regularly varying. In particular, it will be shown that the heavy traffic approximation P(V > x) ≈ P VHT > (1 − ρ)x for the sojourn time overestimates the true sojourn time distribution for large x. Theorem 6.3. If 1 − B(x) = x−ν L(x) with ν > 1, then P(VHT > x) ∼ Γ(ν + 1)P(B > x) if x → ∞. d
Proof. Since VHT = Y B, with Y exponentially distributed with mean 1 and B the service time independent of Y (cf. the remark below corollary 5.1), theorem 6.3 immediately follows from [14, proposition 3], which is stated only for 0 < ν < 1, but can easily be extended to ν > 0 (see also [19,22,33]). Remark 6.2. It is possible to get more refined asymptotics for P(VHT > x). Suppose 1 − B(x) is given by 1 − B(x) =
N X i=1
pi x−νi + o x−νN ,
x → ∞,
(6.12)
162
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
with 1 < ν1 < · · · < νN , and pi > 0. Applying (6.10), (6.11), and theorem 6.3, we get P(VHT > x) =
N X
pi Γ(νi + 1)x−νi + o x−νN ,
x → ∞.
(6.13)
i=1
This result is useful for numerical purposes. Remark 6.3. By theorems 6.3 and 4.1, we have the following interesting result: P((1 − ρ)V > x) P((1 − ρ)V > x) = Γ(ν + 1) > 1 = lim lim . x→∞ ρ→1 ρ→1 x→∞ P(B > x) P(B > x) lim lim
(6.14)
Hence, the heavy traffic approximation for P(V > x) overestimates the true value when x is large. This indicates that the approximations for the waiting time distribution induced by theorems 4.1 and 6.3 will behave differently.
7.
Conclusion
In this study, we have investigated asymptotic properties of the sojourn time distribution in the M/G/1 processor sharing queue. Our main result (theorem 4.1) is that the sojourn time distribution is regularly varying of index −ν iff the service time distribution is regularly varying of index −ν, with ν not an integer. More precisely, in the case of regular variation, we have P(V > x) ∼ P(B > (1 − ρ)x) for x → ∞. A generalisation of theorem 4.1 to integer ν seems difficult. However, it might be possible to apply the techniques used in [21,20] for a particular class of regularly varying functions. Another extension of theorem 4.1 is to assume only subexponentiality (cf. the appendix) instead of regular variation. However, proving such an extension seems to be a hard problem, since no characterisation of a subexponential distribution function by its LST is available. In a sequel [44] to this paper, theorem 4.1 has been extended in another way, namely to the M/G/1 processor sharing queue with different types of customers. For this system it has been shown in [44] that the sojourn time distribution of a tagged customer is regularly varying of index −ν iff the service time distribution of the tagged customer is regularly varying of index −ν, even if the tail of the service time distribution of another class of customers is heavier. Theorem 4.1 is derived from a new expression (theorem 3.1) for the LST of the sojourn time distribution. That expression has also led us to several other explicit and asymptotic results for the sojourn time distribution. It seems worthwhile to investigate the potential of these results when approximating various characteristics of the sojourn time distribution.
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
163
Acknowledgements The authors are indebted to J.W. Roberts, for posing the problem that led to the present research, and to F. Baccelli, J.W. Cohen and R. N´un˜ ez-Queija for stimulating discussions and useful remarks. Appendix. Regular variation and subexponentiality In this appendix, we give a short overview of regular variation, and show some basic results that are used in this paper. Regular variation is an important concept in probability theory and various other fields. The main reference is the book [10], see also [24, pp. 275–284]. For a more general introduction to (applications of) heavy tailed distributions, the reader is referred to [23]. All the material discussed in this appendix can be found in these books. A measurable positive function f is called regularly varying with index ϑ if, for all x > 0, lim
t→∞
f (xt) = xϑ f (t)
(A.1)
(cf. [10, p. 18]). The class of regularly varying functions with index ϑ is called Rϑ . A random variable, or its distribution function F , is said to be regularly varying if 1 − F is a regularly varying function. When L ∈ R0 , we call L a slowly varying function. In this paper, a slowly varying function is denoted by L. The following basic property for slowly varying functions is often used without mention. Let L be a slowly varying function. Then, for all ε > 0, there exists a T such that, if x > T , x−ε 6 L(x) 6 xε ,
(A.2)
see, e.g., Feller [24, p. 271]. The next result is part of Karamata’s theorem ([10, p. 26]) and is useful to determine the tail behaviour of excess distributions, cf. section 2. Let ϑ > −1, let T > 0 and let L be locally bounded in {x: x > T }. Then, for t → ∞, Z t 1 1 . (A.3) L(x)xϑ dx → tϑ+1 L(t) T ϑ+1 An important result due to Bingham and Doney [8] (see also [10, theorem 8.1.6]) characterises the tail behaviour of a regularly varying distribution function uniquely by the behaviour around the origin of its LST. Let X be a random variable with distribution function F , LST φ(s), and finite first n moments µ1 , . . . , µn (and µ0 = 1). Define " # n j X (−s) µj φn (s) := (−1)n+1 φ(s) − . j! j=0
We have the following lemma from [8,11].
164
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
Lemma A.1. Let n < ν < n + 1, C > 0. The following are equivalent: φn (s) ∼ C + o(1) sν L(1/s), s ↓ 0, s real, (−1)n −ν t L(t), t → ∞. 1 − F (t) ∼ C + o(1) Γ(1 − ν)
(A.4) (A.5)
The case C > 0 is due to [8]. The case C = 0 is treated in [11, lemma 2.2]. For the more complicated case if ν is integer, we refer to [10, theorem 8.1.6 and chapter 3]. If a distribution function F is regularly varying, then (see, e.g., [24]) 1 − F 2∗ (x) = 2. x→∞ 1 − F (x) lim
(A.6)
A random variable of which the distribution function F satisfies (A.6) is called subexponential. The following property for subexponential distributions is often useful, see also remark 5.1. Let F satisfy (A.6). Then, for all ε > 0 there exists a K(ε) < ∞ such that for all n > 1 and all x > 0, 1 − F n∗ (x) 6 K(ε)(1 + ε)n . 1 − F (x)
(A.7)
References [1] J. Abate, G.L. Choudhury and W. Whitt, Waiting-time tail probabilities in queues with long-tail service-time distributions, Queueing Systems 16 (1994) 311–338. [2] J. Abate, G.L. Choudhury and W. Whitt, Exponential approximations for tail probabilities in queues. I. Waiting times, Oper. Res. 43 (1995) 885–901. [3] J. Abate and W. Whitt, Limits and approximations for the M/G/1 LIFO waiting-time distribution, Oper. Res. Lett. 20 (1997) 199–206. [4] J. Abate and W. Whitt, Explicit M/G/1 waiting-time distributions for a class of long-tail servicetime distributions, Oper. Res. Lett. 25 (1999) 25–31. [5] M. Abramovitz and I.A. Stegun, Handbook of Mathematical Functions (Dover, New York, 1965). [6] J. Beran, R. Sherman, M.S. Taqqu and W. Willinger, Long-range dependence in variable-bit-rate video, IEEE Trans. Commun. 43 (1995) 1566–1579. [7] P. Billingsley, Probability and Measure, 3rd ed. (Wiley, New York, 1996). [8] N.H. Bingham and R.A. Doney, Asymptotic properties of supercritical branching processes I: The Galton–Watson process, Adv. in Appl. Probab. 6 (1974) 711–731. [9] N.H. Bingham and R.A. Doney, Asymptotic properties of supercritical branching processes II: Crump-Mode and Jirina processes, Adv. in Appl. Probab. 7 (1975) 66–82. [10] N.H. Bingham, C.M. Goldie and J.L. Teugels, Regular Variation (Cambridge Univ. Press, Cambridge, 1987). [11] O.J. Boxma and V. Dumas, The busy period in the fluid queue, Performance Evaluation Rev. 26 (1998) 100–110. [12] O.J. Boxma and J.W. Cohen, The M/G/1 queue with heavy-tailed service time distribution, IEEE J. Selected Areas Commun. 16 (1998) 749–763. [13] O.J. Boxma and J.W. Cohen, Heavy-traffic analysis for the GI/G/1 queue with heavy-tailed distributions, Queueing Systems 33 (1999) 177–204. [14] L. Breiman, On some limit theorems similar to the arc-sin law, Theory Probab. Appl. 10 (1965) 323–331.
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
165
[15] E.G. Coffman, R.R. Muntz and H. Trotter, Waiting time distributions for processor-sharing systems, J. ACM 17 (1970) 123–130. [16] J.W. Cohen, Some results on regular variation in queueing and fluctuation theory, J. Appl. Probab. 10 (1973) 343–353. [17] J.W. Cohen, The multiple phase service network with generalized processor sharing, Acta Informatica 12 (1979) 245–284. [18] J.W. Cohen, The Single Server Queue, 2nd ed. (North-Holland, Amsterdam, 1982). [19] R.A. Davis and S.I. Resnick, Limit theory for bilinear processes with heavy-tailed noise, Ann. Appl. Probab. 6 (1996) 1191–1210. [20] A. de Meyer, On a theorem of Bingham and Doney, J. Appl. Probab. 19 (1982) 217–220. [21] A. de Meyer and J.L. Teugels, On the asymptotic behaviour of the distributions of the busy period and service time in M/G/1, J. Appl. Probab. 17 (1980) 802–813. [22] P. Embrechts and C. Goldie, On closure and factorization properties of subexponential and related distributions, J. Austral. Math. Soc. A 29 (1980) 243–256. [23] P. Embrechts, C. Kl¨uppelberg and T. Mikosch, Modelling Extremal Events (Springer, Berlin, 1997). [24] W. Feller, An Introduction to Probability Theory and its Applications, Vol. II, 2nd ed. (Wiley, New York, 1971). [25] S. Grishechkin, On a relationship between processor-sharing queues and Crump-Mode–Jagers branching processes, Adv. in Appl. Probab. 24 (1992) 653–698. [26] S. Grishechkin, GI/G/1 processor sharing queue in heavy traffic, Adv. in Appl. Probab. 26 (1994) 539–555. [27] F.P. Kelly, Reversibility and Stochastic Networks (Wiley, New York, 1979). [28] L. Kleinrock, Queueing Systems, Vol. II: Computer Applications (Wiley, New York, 1976). [29] M. Lo`eve, Probability Theory, 2nd ed. (New York, 1960). [30] J.A. Morrison, Response-time distribution for a processor sharing system, SIAM J. Appl. Math. 45 (1985) 152–167. [31] T.J. Ott, The sojourn-time distribution in the M/G/1 queue with processor sharing, J. Appl. Probab. 21 (1984) 360–378. [32] V. Paxson and S. Floyd, Wide area traffic: The failure of Poisson modeling, IEEE/ACM Trans. Networking 3 (1995) 226–244. [33] S. Resnick, Point processes, regular variation and weak convergence, Adv. in Appl. Probab. 18 (1986) 66–138. [34] M. Sakata, S. Noguchi and J. Oizumi, Analysis of a processor shared queueing model for time sharing systems, in: Proc. of the 2nd Hawaii Internat. Conf. on System Sciences (1969) pp. 625– 628. [35] R. Schassberger, A new approach to the M/G/1 processor sharing queue, Adv. in Appl. Probab. 16 (1984) 802–813. [36] B. Sengupta, An approximation for the sojourn-time distribution for the GI/G/1 processor-sharing queue, Comm. Statist. Stochastic Models 8 (1992) 35–57. [37] H.C. Tijms, Stochastic Models (Wiley, Chichester, 1994). [38] J.L. van den Berg, Sojourn times in feedback and processor sharing queues, Ph.D. thesis, Utrecht (1990). [39] W. Willinger, M.S. Taqqu, W.E. Leland and D.V. Wilson, Self-similarity in high-speed packet traffic: Analysis and modeling of ethernet traffic measurements, Statist. Sci. 10 (1995) 67–85. [40] S.F. Yashkov, A derivation of response time distribution for a M/G/1 processor sharing queue, Problems Control Inform. Theory 12 (1983) 133–148. [41] S.F. Yashkov, Processor-sharing queues: Some progress in analysis, Queueing Systems 2 (1987) 1–17. [42] S.F. Yashkov, Mathematical problems in the theory of shared-processor systems, J. Soviet Math. 58 (1992) 101–147.
166
A.P. Zwart, O.J. Boxma / Sojourn time asymptotics
[43] S.F. Yashkov, On a heavy traffic limit theorem for the M/G/1 processor-sharing queue, Comm. Statist. Stochastic Models 9 (1993) 467–471. [44] A.P. Zwart, Sojourn times in a multiclass processor sharing queue, in: Teletraffic Engineering in a Competitive World, Proc. of ITC 16, Edinburgh, UK, eds. P. Key and D. Smith (North-Holland, Amsterdam, 1999) pp. 335–344.