Counterexamples In Markov Decision Processes

Alexey B Piunovskiy (The Univ Of Liverpool, Uk)

$366.95 $293.44

Hardback

Not in-store but you can order this
How long will it take?

Availability Information

We source books from suppliers in Australia and overseas. For books we don't currently have in stock, the time it takes to get them from our suppliers can vary widely - from a few days to a few months - so we check each book with each supplier to determine the expected time it will take to be supplied to us.

We then advise you accordingly. If the time taken to get any book is too long for you, you can let us know and we will cancel or adjust your order, and refund as required.

To find out the anticipated arrival time for specific items prior to ordering, please contact us by phone or email:

Phone +61 2 9264 3111, or 1800 4 BOOKS (1800 4 26657) if outside Sydney:
option 1 Abbey's Bookshop (Crime, History, Science, Kids & more) • info@abbeys.com.au
option 2 Language Book Centre (ESL & Foreign Languages) • language@abbeys.com.au
option 3 Galaxy Bookshop (Sci-fi, Fantasy, Romance, Graphic Novels) • sf@galaxybooks.com.au

QTY:

English

World Scientific Europe Ltd
11 April 2025

Calculus of variations; Probability & statistics

Series: Series On Optimization And Its Applications

Summary
Details

Markov Decision Processes (MDPs) form a cornerstone of applied probability, with over 50 years of rich research history. Throughout this time, numerous foundational books and thousands of journal articles have shaped the field. The central objective of MDP theory is to identify the optimal control strategy for Markov random processes with discrete time. Interestingly, the best control strategies often display unexpected or counterintuitive behaviors, as documented by a wide array of studies.

This book gathers some of the most compelling examples of such phenomena while introducing new ones. By doing so, it serves as a valuable companion to existing textbooks. While many examples require little to no prior knowledge, others delve into advanced topics and will primarily interest specialists.

In this second edition, extensive revisions have been made, correcting errors and refining the content, with a wealth of new examples added. The range of examples spans from elementary to advanced, requiring background knowledge in areas like measure theory, convex analysis, and advanced probability. A new chapter on continuous time jump processes has also been introduced. The entire text has been reworked for clarity and accessibility.

This book is an essential resource for active researchers and graduate students in the field of Markov Decision Processes.

By: Alexey B Piunovskiy (The Univ Of Liverpool Uk)
Imprint: World Scientific Europe Ltd
Country of Publication: United Kingdom
Volume: 6
ISBN: 9781800616752
ISBN 10: 1800616759
Series: Series On Optimization And Its Applications
Pages: 508
Publication Date: 11 April 2025
Audience: College/higher education , Professional and scholarly , Primary , Undergraduate
Format: Hardback
Publisher's Status: Active

SALE ON NOW! PROMOTIONS

Counterexamples In Markov Decision Processes

Alexey B Piunovskiy (The Univ Of Liverpool, Uk)

$366.95 $293.44

Hardback

See Also

Contact Abbeys

Contact Galaxy

Contact Language

Contact Us

About ABBEY'S