An official website of the United States government
dot gov icon

Official websites use .gov

A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS

A lock ( ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

By: Kitware Inc.

Project Objective & Overview

  • Planning safer, more accessible streets requires significant time and expert effort.
  • Analyzing pedestrian and traffic infrastructure across large areas is difficult with today's manual tools.
  • Creating detailed, up-to-date maps of walkways and sidewalks at scale remains a challenge.
  • Many existing transportation datasets are missing important pedestrian details, such as curbs and sidewalk conditions.

Key Results & Findings

Proposed Approach

  • Create an accurate digital traffic network that captures walkways, sidewalks, and their interactions using AI on overhead and ground-level imagery.
  • Automate extraction of walkway networks from overhead imagery, enhanced with ground-level images for fine details like curbs and sidewalk conditions.

Phase I Key Findings and Challenges

  • Walkway detectability: AI models detected sidewalks with 40% accuracy overall compared to OpenStreetMap data, reaching 75% in well-annotated areas. Some semantic segmentation models did not transfer well without domain-specific training.
  • Imagery resolution matters: Reliable detection requires overhead imagery of at least 12 in/px; performance drops sharply at lower resolutions.
  • Ground imagery and LiDAR add value: Incorporating ground-level photos and LiDAR improves the quality of training and evaluation masks, providing better data than current crowd-sourced maps.
CURBS-AID key results

Company Info

Since Kitware's founding in 1998, we have been committed to upholding the principles of our open source philosophy. We work with our customers to solve their most complex scientific challenges by providing custom software solutions based on our open source software.

This project was a collaboration between Kitware Inc., M-J Engineering, and NYU

Project POC: Dr. Connor Greenwell
Email: connor.greenwell@kitware.com
Website: https://www.kitware.com

Next Steps

  • Scale experimentation: Expand testing of walkway detection and AI models to six major metropolitan regions in the eastern United States.
  • Develop LLM-based planning assistant: Build an interactive tool that allows planners to query the pedestrian network, explore infrastructure data, and generate improvement suggestions.
  • Engage with state and local DOTs: Collaborate with transportation agencies to understand how they would use AI-generated data and tools in real-world planning workflows.
  • Integrate multi-source data: Combine overhead imagery, ground-level photos, and LiDAR data to improve model accuracy and detail for large-scale deployment.
  • Enhance user interaction: Use web-based visualization tools to allow planners to see proposed changes, assess network conditions, and make data-driven decisions efficiently.