Skip to content

Booksellers & Trade Customers: Sign up for online bulk buying at trade.atlanticbooks.com for wholesale discounts

Booksellers: Create Account on our B2B Portal for wholesale discounts

Markov Chains and Decision Processes for Engineers and Managers by Theodore J. Sheskin

Markov Chains and Decision Processes for Engineers and Managers

by Theodore J. Sheskin
Save 35% Save 35%
₹5,865.00
₹9,022.00
₹9,022.00
₹9,022.00
(-35%)
₹5,865.00
₹5,865.00

Imported Edition - Ships in 12-14 Days

Free Shipping in India on orders above Rs. 500

Request Bulk Quantity Quote
+91
Book cover type: Paperback
  • ISBN13: 9780367383435
  • Binding: Paperback
  • Subject: N/A
  • Publisher: Taylor & Francis
  • Publisher Imprint: CRC Press
  • Publication Date:
  • Pages: 492
  • Original Price: GBP 69.99
  • Language: English
  • Edition: N/A
  • Item Weight: 590 grams
  • BISAC Subject(s): Operations Research, Probability & Statistics / Bayesian Analysis, and Industrial Design / General

Recognized as a powerful tool for dealing with uncertainty, Markov modeling can enhance your ability to analyze complex production and service systems. However, most books on Markov chains or decision processes are often either highly theoretical, with few examples, or highly prescriptive, with little justification for the steps of the algorithms used to solve Markov models. Providing a unified treatment of Markov chains and Markov decision processes in a single volume, Markov Chains and Decision Processes for Engineers and Managers supplies a highly detailed description of the construction and solution of Markov models that facilitates their application to diverse processes.

Organized around Markov chain structure, the book begins with descriptions of Markov chain states, transitions, structure, and models, and then discusses steady state distributions and passage to a target state in a regular Markov chain. The author treats canonical forms and passage to target states or to classes of target states for reducible Markov chains. He adds an economic dimension by associating rewards with states, thereby linking a Markov chain to a Markov decision process, and then adds decisions to create a Markov decision process, enabling an analyst to choose among alternative Markov chains with rewards so as to maximize expected rewards. An introduction to state reduction and hidden Markov chains rounds out the coverage.

In a presentation that balances algorithms and applications, the author provides explanations of the logical relationships that underpin the formulas or algorithms through informal derivations, and devotes considerable attention to the construction of Markov models. He constructs simplified Markov models for a wide assortment of processes such as the weather, gambling, diffusion of gases, a waiting line, inventory, component replacement, machine maintenance, selling a stock, a charge account, a career path, patient flow

Trusted for over 49 years

Family Owned Company

Secure Payment

All Major Credit Cards/Debit Cards/UPI & More Accepted

New & Authentic Products

India's Largest Distributor

Need Support?

Whatsapp Us

Related Category

technology & engineering > operations research

mathematics > probability & statistics / bayesian analysis

technology & engineering > industrial design / general

Bestselling

View All
Atomic Habits (Lead Title) by Clear, James

Atomic Habits (Lead Title)

Clear, James

₹585
₹899
₹899
₹899
(-35%)
₹585
₹585

• Author(s): Clear | James • Publisher: Penguin • Publisher Imprint: Penguin Random House • Subject: General Books

Diary of a Wimpy Kid: Partypooper (Book 20) by Jeff Kinney

Diary of a Wimpy Kid: Partypooper (Book 20)

Jeff Kinney

₹455
₹699
₹699
₹699
(-35%)
₹455
₹455

• Author(s): Jeff Kinney • Publisher: Penguin Random House Children's UK • Publisher Imprint: Penguin Random House Children's UK • BISAC: Comics & Graphic Novels - Humorous

Ikigai by Hector Garcia

Ikigai

Hector Garcia

₹390
₹599
₹599
₹599
(-35%)
₹390
₹390

• Author(s): Hector Garcia • Publisher: Penguin • Publisher Imprint: Penguin Random House • Subject: General Books

The Courage To Be Disliked How To Free Yourself Change Your Life And Achieve Real Happiness Courage To Series by Ichiro Kishimi

The Courage To Be Disliked How To Free Yourself Change Your Life And Achieve Real Happiness Courage To Series

Ichiro Kishimi

₹358
₹550
₹550
₹550
(-35%)
₹358
₹358

• Author(s): Ichiro Kishimi • Publisher: GROVE ATLANTIC • Publisher Imprint: Allen & Unwin • BISAC: Personal Growth - SuccessIchiro Kishimi lives in Kyoto. He writes, lectures and teaches in psychiatric clinics as a certified counsellor and c...

View full details
12 Years: My Messed-up Love Story by Chetan Bhagat

12 Years: My Messed-up Love Story

Chetan Bhagat

₹260
₹399
₹399
₹399
(-35%)
₹260
₹260

• Author(s): Chetan Bhagat • Publisher: HarperCollins Publishers India • Publisher Imprint: HarperCollins Publishers India • BISAC: GeneralFrom India's top-selling writer Chetan Bhagat comes a powerful new love story that will make you laugh, cry...

View full details
The Mountain Is You: Transforming Self-Sabotage Into Self-Mastery

The Mountain Is You: Transforming Self-Sabotage Into Self-Mastery

Brianna Wiest

₹260
₹399
₹399
₹399
(-35%)
₹260
₹260

• Author(s): Brianna Wiest • Publisher: Manjul Publishing • Publisher Imprint: Amaryllis • BISAC: Body Mind And SpiritThis is a book about self-sabotage. Why we do it, when we do it, and how to stop doing it—for good. Coexisting but conflicting n...

View full details
The Art of Spending Money: Simple Choices for a Richer Life by Morgan Housel

The Art of Spending Money: Simple Choices for a Richer Life

Morgan Housel

₹290
₹499
₹499
₹499
(-42%)
₹290
₹290

• Author(s): Morgan Housel • Publisher: Pan Macmillan • Publisher Imprint: Pan Macmillan • BISAC: Finance - Wealth ManagementA third book from the International bestselling author of The Psychology of Money and Same as Ever, lessons on harnessing...

View full details
Mother Mary Comes To Me by Arundhati Roy

Mother Mary Comes To Me

Arundhati Roy

₹585
₹899
₹899
₹899
(-35%)
₹585
₹585

• Author(s): Arundhati Roy• Publisher: PRH INDIA LOCAL PRINT• Publisher Imprint: Penguin Hamish Hamilton• BISAC: Literary FiguresArundhati Roy’s first work of memoir, this is a soaring account, both intimate and inspiring, of how the author became...

View full details
Truth without Apology: A Guide for Those Who Can Stand It by Acharya Prashant

Truth without Apology: A Guide for Those Who Can Stand It

Acharya Prashant

₹260
₹399
₹399
₹399
(-35%)
₹260
₹260

• Author(s): Acharya Prashant • Publisher: HarperCollins Publishers India • Publisher Imprint: HarperCollins Publishers India • BISAC: GeneralIn a world where vagueness is mistaken for depth and obscurity passes for wisdom, Truth without Apology ...

View full details
Grandma's Bag of Stories by Sudha Murthy

Grandma's Bag of Stories

Sudha Murthy

₹179
₹275
₹275
₹275
(-35%)
₹179
₹179

• Author(s): Sudha Murthy • Publisher: India Puffin • Publisher Imprint: India Puffin • BISAC: Short StoriesWho can resist a good story, especially when it's being told by Grandma? From her bag emerges tales of kings and cheats, monkeys and mic...

View full details
Days at the Morisaki Bookshop by Satoshi Yagisawa

Days at the Morisaki Bookshop

Satoshi Yagisawa

₹260
₹399
₹399
₹399
(-35%)
₹260
₹260

• Author(s): Satoshi Yagisawa • Publisher: Bonnier Books Ltd • Publisher Imprint: Bonnier Books Ltd

Deep Work: Rules For Focused Success In A Distracted World by Newport, Cal

Deep Work: Rules For Focused Success In A Distracted World

Newport, Cal

₹260
₹399
₹399
₹399
(-35%)
₹260
₹260

• Author(s): Newport, Cal • Publisher: Little, Brown Book Group • Publisher Imprint: Piatkus

Can We Be Strangers Again?: A National Bestseller by Shrijeet Shandilya

Can We Be Strangers Again?: A National Bestseller

Shrijeet Shandilya

₹195
₹299
₹299
₹299
(-35%)
₹195
₹195

• Author(s): Shrijeet Shandilya • Publisher: Ebury Press • Publisher Imprint: Ebury Press • BISAC: Romance - GeneralIn the electric haze of college life, three friends are bound by laughter, late-night talks and unspoken promises. But when two of...

View full details
The Secret of Secrets: (Robert Langdon Book 6) by Dan Brown

The Secret of Secrets: (Robert Langdon Book 6)

Dan Brown

₹2,245
₹3,250
₹3,250
₹3,250
(-31%)
₹2,245
₹2,245

• Author(s): Dan Brown • Publisher: Transworld Publishers Ltd • Publisher Imprint: Transworld Publishers Ltd • BISAC: Thrillers - EspionageDan Brown is the bestselling author of Digital Fortress, Deception Point, Angels and Demons, The Da Vinci C...

View full details
Magic of the Lost Temple by Sudha Murty

Magic of the Lost Temple

Sudha Murty

₹179
₹275
₹275
₹275
(-35%)
₹179
₹179

• Author(s): Sudha Murty • Publisher: India Puffin • Publisher Imprint: India Puffin • BISAC: Action & Adventure - General

Rich Dad Poor Dad: What the Rich Teach Their Kids about Money That the Poor and Middle Class Do Not!

Rich Dad Poor Dad: What the Rich Teach Their Kids about Money That the Poor and Middle Class Do Not!

₹390
₹599
₹599
₹599
(-35%)
₹390
₹390

• Publisher: Penguin • Publisher Imprint: Penguin Random House • Subject: General Books • BISAC: Personal Finance - GeneralApril of 2022 marks a 25-year milestone for the personal finance classic Rich Dad Poor Dad that still ranks as the #1 Pers...

View full details
World’S Greatest Books For Personal Growth & Wealth (Set Of 4 Books) : Perfect Motivational by Dale Carnegie, Napoleon Hill

World’S Greatest Books For Personal Growth & Wealth (Set Of 4 Books) : Perfect Motivational

Dale Carnegie, Napoleon Hill

₹390
₹599
₹599
₹599
(-35%)
₹390
₹390

• Author(s): Dale Carnegie | Napoleon Hill • Publisher: Fingerprint • Publisher Imprint: Fingerprint • Subject: General Books

The Housemaid: An Addictive Psychological Thriller With Mind-Bending Twists by Freida Mcfadden

The Housemaid: An Addictive Psychological Thriller With Mind-Bending Twists

Freida Mcfadden

₹358
₹550
₹550
₹550
(-35%)
₹358
₹358

• Author(s): Freida Mcfadden • Publisher: Penguin Select Print • Publisher Imprint: Penguin Select Publishing"Multi-Million Copy Bestselling Series •Now Being Made Into a Major Motion Picture Starring Sydney Sweeney and Amanda Seyfried #1 New Yor...

View full details
101 Tales: The Great Panchatantra Collection by Wonder House Books

101 Tales: The Great Panchatantra Collection

Wonder House Books

₹390
₹599
₹599
₹599
(-35%)
₹390
₹390

• Author(s): Wonder House Books • Publisher: Wonder House Books • Publisher Imprint: Wonder House Books • BISAC: Comics & Graphic Novels - Fairy Tales, Folklore, Legends & MTimeless Wisdom, Talking Animals & Life Lessons for Young Min...

View full details
Man's Search For Meaning by Viktor E. Frankl

Man's Search For Meaning

Viktor E. Frankl

₹260
₹399
₹399
₹399
(-35%)
₹260
₹260

• Author(s): Viktor E. Frankl • Publisher: Random House • Publisher Imprint: Random Hou • Subject: Medical, Nursing and Health Sciences

Bacchon KI Doctor's Desi Parenting Book: A Doctor-Mom's Guide to Milk, Myths, Motherhood and More by Madhavi Bharadwaj

Bacchon KI Doctor's Desi Parenting Book: A Doctor-Mom's Guide to Milk, Myths, Motherhood and More

Madhavi Bharadwaj

₹260
₹399
₹399
₹399
(-35%)
₹260
₹260

• Author(s): Madhavi Bharadwaj • Publisher: PRH India • Publisher Imprint: Penguin Ebury Press • BISAC: Parenting - MotherhoodWelcome to the wild, messy, wonderful world of parenting--where the nights are long, the diapers are explosive, and unso...

View full details
The Outsider by Vir Das

The Outsider

Vir Das

₹455
₹699
₹699
₹699
(-35%)
₹455
₹455

• Author(s): Vir Das • Publisher: HarperCollins Publishers India • Publisher Imprint: HarperCollins Publishers India • BISAC: Entertainment & Performing ArtsComedian and actor Vir Das is beloved (by some, tolerated by others, blocked by a few...

View full details
The Very Hungry Caterpillar by Eric Carle

The Very Hungry Caterpillar

Eric Carle

₹293
₹450
₹450
₹450
(-35%)
₹293
₹293

• Author(s): Eric Carle • Publisher: Penguin Books, Limited (UK) • Publisher Imprint: Penguin Books, Limited (UK) • BISAC: Animals - Butterflies, Moths & CaterpillarsEric Carle's The Very Hungry Caterpillar is a perennial favourite with child...

View full details
Too Good to Be True : A smart, funny will-they-won’t-they romance by mostlysane by Prajakta Koli

Too Good to Be True : A smart, funny will-they-won’t-they romance by mostlysane

Prajakta Koli

₹260
₹399
₹399
₹399
(-35%)
₹260
₹260

• Author(s): Prajakta Koli • Publisher: Harper Fiction India • Publisher Imprint: Harper Fiction India • BISAC: Romance - ContemporaryWinner of the Amazon India Popular Choice Debut Book 2025 Award. From one of India's most-loved creators comes s...

View full details
Home
Genres
Account
Chat