Bolstered by a massive scale of ubiquitously connected smart devices, the emergence of Internet-of-Things (IoT) has brought about substantial conveniences to our daily life through a plethora of applications, of which many are safety-critical, including healthcare, surveillance, and autonomous driving, to name a few. For such safety-critical domains, the current toolkits usually fall short in uncertainty quantification, a key feature that is necessitated for informed decision-making. Given the enormous data collected by IoT devices on-the-go, scalability is another key enabler of real-time IoT sensing and management with low latency. Further, how to endow learning with adaptivity and robustness to unpredictable dynamics in IoT is of utmost importance, especially with humans-in-the-loop. Before embracing the full potential of safety-critical IoT, novel tools have to be developed to address these major challenges. Towards this goal, this CAREER proposal advocates fundamental research that aspires to advance the current tools for real-time IoT sensing and management, with direct impact on a number of safety-critical domains, including healthcare, transportation, and environmental sensing. Leveraging the PI’s institutional resources, the PI will transform the proposed research goals into educational activities, through i) mentoring graduate and undergraduate students, especially those from the underrepresented groups; ii) curriculum development that cross-fertilizes the fields of machine learning, communications, signal processing and networking; as well as iii) interdisciplinary collaboration with UGA’s Center of Cyber-Physical Systems. This seamless integration of research and education is central to the PI’s career path and is well aligned with UGA’s mission “to teach, to serve, and to inquire into the nature of things.” To further promote the societal embracing of the emergent IoT technologies, the PI is committed to disseminate the research outcomes to the general public, in particular K-12 students, through short courses, online videos, and workshops.
This proposal puts forth an ambitious plan by tailoring advances in contemporary Bayesian machine learning tools, namely, Bayesian function approximation, Bayesian bandit optimization, and Bayesian reinforcement learning, to address the aforementioned challenges. This fresh Bayesian flavor naturally innovates existing toolkits with uncertainty quantification and robustness, essential to safety-critical IoT. The resultant approaches will not only benefit key IoT-enabled tasks, but also markedly push the envelope of these disciplines by incorporating IoT-driven constraints. Specifically, three complementary and intertwined research thrusts will be pursued. Thrust 1 (T1) puts forth a fundamental uncertainty-aware function learning framework, which not only directly benefits the prediction-oriented IoT sensing task in T1, but also contributes to Bayesian optimization for open-loop blind IoT management in Thrust 2 (T2), where the decisions made by the IoT controller do not affect the IoT state. Thrust 3 further builds on T1 and T2 to scale up Bayesian RL for real-time closed-loop IoT management with full interaction between the IoT state and the IoT controller. The ultimate pursuit is a holistic framework that integrates novel algorithms with uncertainty awareness, scalability, and adaptivity for real-time IoT sensing and management, the associated rigorous analyses for robustness to unpredictable dynamics, and the deployment to real safety-critical IoT applications.
Funder: National Science Foundation
Amount: $522,786
PI: Qin Lu, College of Engineering