Project Objectives

Identify Obstacles

Identify new outdoor obstacles that could potentially be dangerous to visually impaired individuals by custom tuning the pre-trained object detection model.

Object detection challenge

Custom object detection for uncommon obstacles

View Detection Model

Alert Rules

Provide timely and informative warnings to users by developing alert rules on the front end to minimize latency.

Alert rule development

Latency-conscious alert logic

View Alert Rules

Scene Description

To provide scenic descriptions that extend beyond pre-defined classes by utilizing a visual language model.

Scene description model

Beyond class-level interpretation using VLMs

View Scene Description