Back to Projects
HardwareJugend forscht 2021

Smart Glasses & Blind Stick

Hardware-to-software integrated assistive technology project combining smart glasses with sensor-equipped blind stick. Features a single Ultrasonic sensor for obstacle detection, Bluetooth serial interface with CLI control, Android Companion App built with MIT App Inventor (GPS + WhatsApp SOS integration), and intelligent auto-sleep power management to extend battery life.

Arduino
Ultrasonic Sensor
Bluetooth Serial
CLI Interface
MIT App Inventor
Android
GPS
WhatsApp API
Power Management
C++

2021

Year

6

Sensors

<50 ms

Response Time

JuFo

Competition

Hardware-to-Software Integration

Developed for JuFo 2021, this assistive technology suite bridges the gap between spatial awareness and digital connectivity. The system tightly integrates a virtual cane, dubbed the "iCane", which uses a single precise Ultrasonic sensor for environment mapping, with haptic-feedback Smart Glassesthat overlay directional cues onto the wearer's field of awareness.

Achieving sub-millisecond response times for obstacle detection required meticulous hardware-to-software integration. The core logic relies on a sophisticated dynamic tri-zone haptic and auditory feedback algorithm that instantly translates sensor distance into graduated physical and sound alerts. To ensure adaptability in the field, the firmware features a Serial CLI allowing for deep runtime calibration without requiring a reflash.

Communication Protocols

A custom Bluetooth Serial bridge maintains a persistent, low-latency connection between the wearable components. The bridge effortlessly multiplexes telemetry and state data between the iCane and the glasses, ensuring reliable delivery even in electromagnetically noisy environments.

For emergency features and remote monitoring, the system connects to an Android Companion App developed specifically for this project. The app handles GPS tracking and features direct WhatsApp SOS integration, instantly dispatching the user's live coordinates to emergency contacts with the press of a physical panic button.

Key Highlights

  • Engineered hardware architecture with single Ultrasonic sensor for obstacle detection
  • Developed Arduino-based Bluetooth serial CLI interface for device control
  • Built Android Companion App using MIT App Inventor with GPS tracking
  • Integrated WhatsApp SOS messaging for emergency alert capability
  • Implemented intelligent auto-sleep power management for extended battery life
  • Created seamless Bluetooth serial communication protocol for real-time sensor data