Artalejo, Jesús R. and GómezCorral, Antonio and QiMing, He (2010) Markovian arrivals in stochastic modelling: a survey and some new results. Sort: Statistics and Operations Research Transactions, 34 (2). pp. 101156. ISSN 16962281

PDF
Creative Commons Attribution Noncommercial. 425kB 
Official URL: http://dialnet.unirioja.es/servlet/articulo?codigo=3352462
Abstract
This paper aims to provide a comprehensive review on Markovian arrival processes (MAPs), which constitute a rich class of point processes used extensively in stochastic modelling. Our starting point is the versatile process introduced by Neuts (1979) which, under some simplified notation, was coined as the batch Markovian arrival process (BMAP). On the one hand, a general point process can be approximated by appropriate MAPs and, on the other hand, the MAPs provide a versatile, yet tractable option for modelling a bursty flow by preserving the Markovian formalism. While a number of wellknown arrival processes are subsumed under a BMAP as special cases, the literature also shows generalizations to model arrival streams with marks, nonhomogeneous settings or even spatial arrivals. We survey on the main aspects of the BMAP, discuss on some of its variants and generalizations, and give a few new results in the context of a recent statedependent extension.
Item Type:  Article 

Uncontrolled Keywords:  DiscreteTime; Stationary Distributions; Transition Matrices; Inventory Problems; Additive Processes; Markovian arrival process; batch arrivals; marked process; phasetype distribution; BSDE approach 
Subjects:  Sciences > Mathematics > Stochastic processes 
ID Code:  15069 
References:  Ahn, S. and Badescu, A. L. (2007). On the analysis of the GerberShin discounted penalty function for risk processes with Markovian arrivals. Insurance: Mathematics and Economics, 41, 234249. Alfa, A. S. and Neuts, M. F. (1995). Modelling vehicular traffic using the discrete time Markovian arrival process. Transportation Science, 29, 109117. Alfa, A. S., Liu, B. and He, Q.M. (2003). Discretetime analysis of MAP/PH/1 multiclass general preemptive priority queue. Naval Research Logistics, 50, 662682. Allen, L. J. S. (2003). An Introduction to Stochastic Processes with Applications to Biology. New Jersey:Prentice Hall. Artalejo, J. R. and GómezCorral, A. (2008). Retrial Queueing Systems: A Computational Approach. Berlin:SpringerVerlag. Artalejo, J. R. and GómezCorral, A. (2010). A statedependent Markovmodulated mechanism for generating events and stochastic models. Mathematical Methods in the Applied Sciences, 33, 13421349. Artalejo, J. R. and Li, Q.L. (2010). Performance analysis of a blockstructured discretetime retrial queue with statedependent arrivals. Discrete Event Dynamic Systems, 20, 325347. Asmussen, S. and Koole, G. (1993).Marked point processes as limits ofMarkovian arrival streams. Journal of Applied Probability, 30, 365372. Asmussen, S. and Bladt, M. (1999). Point processes with finitedimensional conditional probabilities. Stochastic Processes and their Applications, 82, 127142. Asmussen, S. (2000). Matrixanalytic models and their analysis. Scandinavian Journal of Statistics, 27,193226. Asmussen, S. and Møller, J. R. (2001). Calculation of the steady state waiting time distribution in GI/PH/c and MAP/PH/c queues. Queueing Systems, 37, 929. Badescu, A. L., Drekic, S. and Landriault, D. (2007). Analysis of a threshold dividend strategy for a MAP risk model. Scandinavian Actuarial Journal, 2007, 227247. Baek, J. W., Lee, H. W., Lee, S. W. and Ahn, S. (2008). A factorization property for BMAP/G/1 vacation queues under variable service speed. Annals of Operations Research, 160, 1929. Bini, D. A., Latouche, G. and Meini, B. (2005). Numerical Methods for Structured Markov Chains. Oxford: Oxford University Press. Blondia, C. and Casals, O. (1992). Statistical multiplexing of VBR sources: A matrixanalytic approach. Performance Evaluation, 16, 520. Bodrog, L., Horvath, A. and Telek, M. (2008). Moment characterization of matrix exponential and Markovian arrival processes. Annals of Operations Research, 160, 5168. Breuer, L. (2002). An EM algorithm for batch Markovian arrival processes and its comparison to a simpler estimation procedure. Annals of Operations Research, 112, 123138. Breuer, L. (2003). From Markov Jump Processes to Spatial Queues. Dordrecht: Kluwer Academic Publishers. Breuer, L. and Alfa, A. S. (2005). An EM algorithm for platoon arrival processes in discrete time. Operations Research Letters, 33, 535543. Breuer, L. and Baum, D. (2005). An Introduction to Queueing Theory and MatrixAnalytic Methods. Dordrecht:Springer. Chakka, R. and Do, T. V. (2007). TheMM Kk=1CPPk/GE/c/L Gqueue with heterogenous servers: Steadystate solution and an application to performance evaluation. Performance Evaluation, 64, 191209. Chakravarthy, S. R. (2001). The batchMarkovian arrival process: A review and future work. In Advances in Probability & Stochastic Processes, A. Krishnamoorthy, N. Raju and V. Ramaswami (eds.), Notable Publications, 2149. Chakravarthy, S. R., Krishnamoorthy, A. and Joshua, V. C. (2006). Analysis of a multiserver retrial queue with search of customers from the orbit. Performance Evaluation, 63, 776798. Chakravarthy, S. R. and GómezCorral, A. (2009). The influence of delivery times on repairable koutofN systems with spares. Applied Mathematical Modelling, 33, 23682387. Chakravarthy, S. R. (2010). Markovian arrival process. In Wiley Encyclopedia of Operations Research and Management Science, J. J. Cochran (ed.), John Wiley and Sons, to appear. Chen, F. and Song, J.S. (2001). Optimal policies for multiechelon inventory problems with Markovmodulated demand. Operations Research, 49, 226234. Cheung, E. C. K. and Landriault, D. (2009). Perturbed MAP risk models with dividend barrier strategies. Journal of Applied Probability, 46, 521541. Ching, W. K. (1997).Markovmodulated Poisson processes for multilocation inventory problems. International Journal of Production Economics, 53, 217223. Ching, W. K. (2001). Iterative Methods for Queuing and Manufacturing Systems. London: SpringerVerlag. Choi, B. D., Kim, B. and Zhu, D. (2004). MAP/M/c queue with constant impatient time. Mathematics of Operations Research, 29, 309325. Çinlar, E. (1972a). Markov additive processes. I. Z. Wahrscheinlichkeitstheory verw. Geb., 24, 8593. Çinlar, E. (1972b). Markov additive processes. II. Z. Wahrscheinlichkeitstheory verw. Geb., 24, 95121. Cohen, A. M. (2007). Numerical Methods for Laplace Transform Inversion. New York: Springer. Daikoku, K., Masuyama, H., Takine, T. and Takahashi, Y. (2007). Algorithmic computation of the transient queue length distribution in the BMAP/D/c queue. Journal of the Operational Research Society of Japan, 50, 5572. Darroch, J. N. and Seneta, E. (1967). On quasistationary distributions in absorbing continuoustime finite Markov chains. Journal of Applied Probability, 4, 192196. Dudin, A. N. and Nishimura, S. (1999). A BMAP/SM/1 queueing system with Markovian arrival input of disasters. Journal of Applied Probability, 36, 868881. Eckberg, A. E. (1983). Generalized peakedness of teletraffic processes. In Proceedings of the Tenth International Teletraffic Congress, Montreal, Canada, paper no. 4, 4B3. Frostig, E. and Kenzin, M. (2009). Availability of inspected systems subject to shocks –A matrix algorithmic approach. European Journal of Operational Research, 193, 168183. He, Q.M. (1996). Queues with marked customers. Advances in Applied Probability, 28, 567587. He, Q.M. and Neuts, M. F. (1998). Markov chains with marked transitions. Stochastic Processes and their Applications, 74, 3752. He, Q.M. (2000). Quasibirthanddeath Markov processes with a tree structure and the MMAP[K]/PH [K]/N/LCFS nonpreemptive queue. European Journal of Operational Research, 120, 641656. He, Q.M. and Alfa, A. S. (2000). Computational analysis of MMAP[K]/PH[K]/1 queues with a mixed FCFS and LCFS service discipline. Naval Research Logistics, 47, 399421. He, Q.M. (2001). The versatility of MMAP[K] and the MMAP[K]/G[K]/1 queue. Queueing Systems, 38, 397418. He, Q.M., Jewkes, E. M. and Buzaccot, J. (2002). Optimal and nearoptimal inventory control policies for a maketoorder inventoryproduction system. European Journal of Operational Research, 141, 113132. He, Q.M. (2010). Construction of continuous time Markov arrival processes. Journal of Systems Science and Systems Engineering, 19, 351366. Horvath, A., Horvath, G. and Telek, M. (2010). A joint moments based analysis of networks of MAP/MAP/1 queues. Performance Evaluation, 67, 759788. Kim, B. and Kim, J. (2010). Queue size distribution in a discretetime D − BMAP/G/1 retrial queue. Computers & Operations Research, 37, 12201227. Kim, C. S., Klimenok, V. I., Mushko, V. and Dudin, A. N. (2010). The BMAP/PH/N retrial queueing system operating in Markovian random environment. Computers & Operations Research, 37, 12281237. Kulkarni, V. G. (1989). A new class of multivariate phase type distributions. Operations Research, 37, 151158. Kulkarni, V. G. (1995). Modelling and Analysis of Stochastic Systems. London: Chapman & Hall. Lambert, J., Van Houdt, B. and Blondia, C. (2006). Queues with correlated service and interarrival times and their application to optical buffers. Stochastic Models, 22, 233251. Latouche, G. and Ramaswami, V. (1999). Introduction to Matrix Analytic Methods in Stochastic Modelling. Philadelphia: ASASIAM. Li, Q.L., Ying, Y. and Zhao, Y. Q. (2006). A BMAP/G/1 retrial queue with a server subject to breakdowns and repairs. Annals of Operations Research, 141, 233270. Li, Q.L. (2010). Constructive Computation in Stochastic Models with Applications: The RGfactorizations. Beijing, Berlin Heidelberg: Tsinghua University Press, SpringerVerlag. Lucantoni, D. M., MeierHellstern, K. S. and Neuts, M. F. (1990). A singleserver queue with server vacations and a class of nonrenewal arrival processes. Advances in Applied Probability, 22, 676705. Lucantoni, D. M. (1991). New results on the single server queue with a batch Markovian arrival process. Stochastic Models, 7, 146. Lucantoni, D. M. (1993). The BMAP/G/1 queue: A tutorial. In Performance Evaluation of Computer and Communication Systems, L. Donatiello and R. Nelson (eds.), Lecture Notes in Computer Science,Vol. 729, SpringerVerlag, 330358. Lucantoni, D. M., Choudhury, G. L. and Whitt, W. (1994). The transient BMAP/G/1 queue. Stochastic Models, 10, 145182. Manuel, P., Sivakumar, B. and Arivarignan, G. (2007). A perishable inventory system with service facilities, MAP arrivals and PHservice times. Journal of Systems Science and Systems Engineering, 16,6273. Milne, C. (1982). Transient behaviour of the interrupted Poisson process. Journal of the Royal Statistical Society. Series B, 44, 398405. MontoroCazorla, D. and PérezOcón, R. (2006).Reliability of a system under two types of failures using a Markovian arrival process. Operations Research Letters, 34, 525530. MontoroCazorla, D. and PérezOcón, R. (2008). A maintenance model with failures and inspection following Markovian arrival processes and two repair modes. European Journal of Operational Research,186, 694707. Narayana, S. and Neuts, M. F. (1992). The first two moment matrices of the counts for the Markovian arrival process. Stochastic Models, 8, 459477. Neuts, M. F. (1979). A versatile Markovian point process. Journal of Applied Probability, 16, 764779. Neuts, M. F. (1981). Matrixgeometric Solutions in Stochastic Models: An Algorithmic Approach. Baltimore: The Johns Hopkins University Press. Neuts, M. F. (1989). Structured Stochastic Matrices of M/G/1 Type and Their Applications. New York: Marcel Dekker, Inc. Neuts, M. F. (1992). Models based on the Markovian arrival process. IEICE Transactions on Communications,E75B, 12551265. Neuts, M. F., Liu, D. and Narayana, S. (1992). Local poissonification of the Markovian arrival process. Stochastic Models, 8, 87129. Neuts, M. F. (1993). The burstiness of point processes. Stochastic Models, 9, 445466. Neuts, M. F. (1995). Algorithmic Probability: A Collection of Problems. London: Chapman & Hall. Neuts, M. F. and Li, J.M. (1997). An algorithm for the P(n, t) matrices of a continuous BMAP. In Matrixanalytic Methods in Stochastic Models, S.R. Chakravarthy and A.S. Alfa (eds.), Lecture Notes in Pure and Applied Mathematics, Vol. 183, Marcel Dekker, 719. Nielsen, B. F., Nilsson, L. A. F., Thygesen, U. H. and Beyer, J. E. (2007). Higher order moments and conditional asymptotics of the batch Markovian arrival process. Stochastic Models, 23, 126. Norden, R. H. (1982). On the distribution of the time to extinction in the stochastic logistic population model. Advances in Applied Probability, 14, 687708. Okamura, H., Dohi, T. and Trivedi, K. S. (2009). Markovian arrival process parameter estimation with group data. IEEE/ACM Transactions on Networking, 17, 13261339. Ost, A. (2001). Performance of Communication Systems: A Modelbased Approach with Matrixgeometric Methods. Berlin: SpringerVerlag. Pacheco, A. and Prabhu, N. U. (1995). Markovadditive processes of arrivals. In Advances in Queuing: Theory, Methods and Open Problems, J.H. Dshalalow (ed.), CRC Press, 167194. Ramaswami, V. (1980). The N/G/1 queue and its detailed analysis. Advances in Applied Probability, 12,222261. Ramaswami, V. (1981). Algorithms for a continuousreview (s,S) inventory system. Journal of Applied Probability, 18, 461472. Rudemo, M. (1973). Point processes generated by transitions of Markov chains. Advances in Applied Probability, 5, 262286. Sengupta, B. (1989). Markov processes whose steady state distribution is matrixexponential with an application to the GI/PH/1 queue. Advances in Applied Probability, 21, 159180. Shin, Y. W. (2004). BMAP/G/1 queue with correlated arrivals of customers and disasters. Operations Research Letters, 32, 364373. Squillante, M. S., Zhang, Y., Sivasubramanian, A. and Gautam, N. (2008). Generalized parallelserver forkjoin queues with dynamic task scheduling. Annals of Operations Research, 160, 227255. Takine, T. and Hasegawa, T. (1994). The workload in the MAP/G/1 queue with statedependent services:Its applications to a queue with preemptive resume priority. Stochastic Models, 10, 183204. Takine, T. (1999). The nonpreemptive priority MAP/G/1 queue. Operations Research, 47, 917927. Telek, M. and Horvath, G. (2007). A minimal representation of Markov arrival processes and a moments matching method. Performance Evaluation, 64, 11531168. Tian, N. and Zhang, Z. G. (2006). Vacation Queueing Models: Theory and Applications, International Series in Operations Research & Management, Vol. 93. New York: Springer. Tweedie, R. L. (1982). Operatorgeometric stationary distributions for Markov chains, with application to queueing models. Advances in Applied Probability, 14, 368391. Van Houdt, B. and Blondia, C. (2002). The delay distribution of a type k customer in a firstcomefirstserved MMAP[K]/PH[K]/1 queue. Journal of Applied Probability, 39, 213223. 
Deposited On:  03 May 2012 08:42 
Last Modified:  20 Apr 2015 12:11 
Repository Staff Only: item control page