Home / Research Library / Constrained Markov Decision Processes
∑ Mathematics OpenAlex

Constrained Markov Decision Processes

📅 December 13, 2021 👤 Eitan Altman 📖 Research Journal 📊 1,421 citations

🤖 Plain-English Summary

This book provides a unified approach for the study of constrained Markov decision processes with a finite state space and unbounded costs. A thorough overview of these applications is presented in the introduction.

🔑 Key Findings

  • Unlike the single controller case considered in many other books, the author considers a single controller with several objectives, such as minimizing delays and loss, probabilities, and maximization of throughputs.
  • It is desirable to design a controller that minimizes one cost objective, subject to inequality constraints on other cost objectives.
  • This framework describes dynamic decision problems arising frequently in many engineering fields.

💡 Why This Matters

Mathematical breakthroughs form the theoretical backbone of science, cryptography, data analysis, and engineering.

Read the full paper
Access the original peer-reviewed research via OpenAlex.

View on DOI ↗

📋 Article Details

Category ∑ Mathematics
Published Dec 13, 2021
Journal Research Journal
Authors Eitan Altman
DOI 10.1201/9781315140223
Citations 1,421
Source OpenAlex

More ∑ Mathematics Research