Publications

Under Review

Real-Time Optical Communication Using Event-Based Vision with Moving Transmitters

Paper currently under submission. Full details withheld pending publication.

In multi-robot systems, traditional RF communication struggles with contention and jamming. Event cameras support microsecond temporal resolution and high dynamic range, making them extremely sensitive to scene changes under fast relative motion with an optical transmitter. Leveraging these strengths, we develop a complete optical communication system capable of tracking moving transmitters and decoding messages in real time via a Geometry-Aware Unscented Kalman Filter (GA-UKF), achieving 7× faster processing compared to the prior state-of-the-art while maintaining equivalent tracking accuracy at transmitting frequencies ≥ 1 kHz.

95%+ Decoding accuracy during motion
Faster than prior EKF state-of-the-art
≥1 kHz Supported transmit frequency
  • Hardware setup and integration of Prophesee EVK4 event cameras with ROS2
  • Simulation frameworks, performance visualizations and plots to validate system behavior
  • Tracking pipeline bug fixes and real-world testing of the transmitter-receiver system
Event Cameras Prophesee EVK4 ROS2 Optical Communication GA-UKF Multi-Robot Systems