Multimodal UAV with Voice Sensing and SSVEP
An FPV drone testbed for hands-free UAV control, integrating ESP32 communication, Betaflight flight-controller input mapping, and bench-level latency testing.
Overview
This project explores hands-free UAV command input using voice sensing and SSVEP-based interaction concepts. The current platform is an FPV drone testbed used to validate communication flow, command mapping, and safety boundaries before flight testing.
Problem & Approach
Traditional RC control requires continuous manual input. The approach is to route decoded commands through embedded hardware into a Betaflight-configured flight controller while preserving conventional control paths for safety and manual override.
System Architecture
The planned system architecture is sensor input and command processing on a Raspberry Pi, ESP32 communication, flight-controller input mapping, and Betaflight configuration for command interpretation and safety checks.
My Role
- Built and wired the FPV drone testbed.
- Integrated ESP32 communication with the flight-controller input path.
- Configured Betaflight input mapping for bench-level validation.
- Prepared the system for latency and command-path testing.
Evidence
Current evidence is centered on hardware assembly, wiring, Betaflight configuration, and bench-level communication checks. Images, diagrams, and test plots will be added after the artifact set is organized.
Outcome
The project has produced a working prototype path for validating embedded communication and flight-controller command mapping before higher-risk flight tests.
Limitations
The system should not be presented as a completed autonomous flight-control solution. Current claims are limited to prototype integration, bench validation, and testbed development.
Next Step
Next steps include documenting latency results, adding architecture diagrams, improving command validation, and defining a safe staged flight-test plan.