{"product_id":"markov-decision-processes-and-reinforcement-learning-for-timely-uav-iot-data-collection-applications-9783031970108","title":"Markov Decision Processes and Reinforcement Learning for Timely UAV-IoT Data Collection Applications","description":"\u003cp\u003e • Author(s): Oluwatosin Ahmed Amodu | Raja Azlina Raja Mahmood | Huda Althumali\u003cbr\u003e • Publisher: Springer\u003cbr\u003e • Publisher Imprint: Springer\u003cbr\u003e • BISAC: Artificial Intelligence - General\u003c\/p\u003e\u003cp\u003e\u003c\/p\u003e\u003cp\u003eThis book offers a structured exploration of how Markov Decision Processes (MDPs) and Deep Reinforcement Learning (DRL) can be used to model and optimize UAV-assisted Internet of Things (IoT) networks, with a focus on minimizing the Age of Information (AoI) during data collection. Adopting a tutorial-style approach, it bridges theoretical models and practical algorithms for real-time decision-making in tasks like UAV trajectory planning, sensor transmission scheduling, and energy-efficient data gathering. Applications span precision agriculture, environmental monitoring, smart cities, and emergency response, showcasing the adaptability of DRL in UAV-based IoT systems. Designed as a foundational reference, it is ideal for researchers and engineers aiming to deepen their understanding of adaptive UAV planning across diverse IoT applications. \u003c\/p\u003e","brand":"Springer","offers":[{"title":"Hardcover","offer_id":47658140106903,"sku":"9783031970108","price":12009.0,"currency_code":"INR","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0666\/3471\/1191\/files\/9783031970108.webp?v=1775817304","url":"https:\/\/atlanticbooks.com\/products\/markov-decision-processes-and-reinforcement-learning-for-timely-uav-iot-data-collection-applications-9783031970108","provider":"Atlantic Books","version":"1.0","type":"link"}