MDP routing for multi-rate loss networks

Ren Hung Hwang, James F. Kurose, Don Towsley

Research output: Contribution to journalArticlepeer-review

31 Scopus citations


Markov decision theory has been successfully used in adaptive routing in traditional circuit-switched networks. When extending Markov decision-based routing algorithms to future Broadband Integrated Service Digital Networks (B-ISDNs), the required computational complexity becomes extremely high. In this paper, we propose an approach towards adaptive routing in multi-rate networks using a Markov decision theoretic framework which maintains low computational complexity while still providing quite good routing information. In this approach, each link, based on PASCAL distribution, is modeled as a one-dimensional birth-death process to reduce the state space size and a policy iteration method from Markov decision theory is iteratively applied to achieve better network performance. Our results show that routing algorithms based on this approach yield better performance than least-load path routing (LLP) without incurring any significant increase in computational complexity.

Original languageEnglish
Pages (from-to)241-261
Number of pages21
JournalComputer Networks
Issue number2
StatePublished - Aug 2000


Dive into the research topics of 'MDP routing for multi-rate loss networks'. Together they form a unique fingerprint.

Cite this