Closed Loop Perception for Resource Efficient Autonomous Systems

Deep Samal

Event Details
Thursday, January 27, 2022
3:30 p.m., Zoom

N/A, N/A

Deep Samal, Ph.D.

Post Doc, University of Nebraska–Lincoln School of Computing


Autonomous Systems such as Autonomous Vehicles (AV), robots and drones are being developed for large scale deployments in real world applications such as transportation, agriculture, defense, urban planning etc. To operate safely in such diverse and dynamic scenarios, the perception engine within these systems must be capable of adapting to the dynamic real-time constraints such as latency and energy consumption. This adaptability is not present in the modern perception systems as they are open-loop by design and therefore neither aware nor capable of reacting to the dynamics of a real-world scenario. My research presents the Closed Loop Perception that interprets the perception process in modern autonomous systems as a control system. It creates the notion of 'perception risk' which represents the state of the process by estimating perception failures and then proposes a risk-resource controller that generates feedback signals to dynamically control the resource consumption within the system by using biologically inspired focus-of-attention mechanisms. The proposed Closed Loop Perception System can introspect and adapt to the real-time requirements of an Autonomous System operating in the wild.

Speaker Bio

Deep Samal received the B.Tech. degree in electronics and electrical engineering from KIIT University, BBSR, India, in 2012, the M.S. degree in electrical and computer engineering from Georgia Institute of Technology, Atlanta, GA, USA, in 2016, and the Ph.D. degree in electrical and computer engineering with Georgia Institute of Technology, Atlanta, GA, USA, under the supervision of Prof. S. Mukhopdhyay. Before starting his Ph.D., he was with the End-User Computing Team, VMWare, USA. His current research interests include multimodal computer vision, resource efficient autonomous systems and adaptive perception systems.