An official website of the United States government
dot gov icon

Official websites use .gov

A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS

A lock ( ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Intelligent Transportation Systems
Joint Program Office

Artificial Intelligence Processing and Analysis Framework for Infrastructure Planning, Design, and Maintenance

By: Creare

Project Objective & Overview

StreetPulse is an in-development functional digital twin software system that generates rich infrastructure data from street-level imagery for city infrastructure planning. Leveraging artificial intelligence (AI), it understands images and recognizes elements (such as sidewalks, road signs, and lane markings), their geospatial location, and detailed 3D geometry.

StreetPulse project objective overview

Key Results & Findings

To demonstrate the feasibility of StreetPulse we:

  • Collected city wide datasets:
    • GIS layers (curb ramps and elevation data) and Street level images of Denver, CO
    • Level of traffic stress (LTS) for the city of Philadelphia, PA
  • Processed street level images to generate high resolution 3D infrastructure data (in .obj format), with semantic information
  • Exported data using GeoJSON open standards file format for easy incorporation and analysis.
  • Analyzed active transport network analysis using LTS data
  • Extracted contextual LTS information using a vision aware large language model (LLM), a task that typically requires considerable effort and time from human reviewers.
StreetPulse key results and findings

Company Info

Creare develops innovative technology and new products for Federal and industrial clients. We are a small business located in Hanover, NH.

We developed StreetPulse in part under DOT SBIR Phase I Contract No. 6913G625P800003.

Project POC: Matt Ueckermann
Email: mpu@creare.com
Website: https://www.creare.com/

Next Steps

The next phase of development focuses on maturing our technical approach. We plan to:

  • Collect street level images for our selected transportation department partners (TDPs), which include: Denver, CO; Bellevue, WA; Austin, TX; town of Hanover, NH; and town of Hartford, VT
  • Develop a data management system for continuous infrastructure data updates
  • Complete development of automated digital twin creation software
  • Develop post-processing pipelines to generate specific decision-support data (e.g., GIS layers)
  • Evaluate the performance (accuracy and completeness) of StreetPulse-generated data
  • Work with TDPs to identify use cases and high value products to define the most promising paths towards commercialization, capability development, and maintenance