Papers
arxiv:2610.18356

Urbex: Agentic Spatial Grounding for City-Scale 3D Scenes

Published on Oct 13
· Submitted by
Wang Yu
on Oct 14
#3 Paper of the day
Authors:
,
,
,
,
,

Abstract

Urbex reframes city-scale 3D grounding as an active search process using a vision-language agent with reinforcement learning, improving accuracy and speed without precomputed proposals.

City-scale 3D grounding is commonly formulated as candidate ranking, which requires precomputed instance proposals and becomes inefficient in large outdoor scenes. We propose Urbex, an agentic vision-language framework that instead casts grounding as active spatial search. Urbex represents a city-scale 3D scene as an interactive multi-view environment, allowing a VLM agent to query landmarks, zoom into local regions, render oblique views, and commit a grounded bounding box. We optimize this tool-use policy with reinforcement learning on CityRefer, using smooth localization rewards and lightweight shaping rewards for efficient exploration. Experiments show that Urbex achieves the best Hit@1 and IoU on CityRefer, supports candidate-free grounding without ground-truth boxes, and is substantially faster than the strongest city-scale ranking baseline. Zero-shot results on STPLS3D-Refer further indicate improved cross-scene robustness.

Community

Paper author Paper submitter

We introduce Urbex, an agentic vision-language framework for city-scale 3D grounding. Existing methods rank precomputed instance proposals. Urbex instead treats grounding as active spatial search: a VLM agent queries landmarks, zooms into local regions and renders oblique views, then commits a bounding box.

The code, model, the data and a Colab demo are all public:

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2610.18356
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 1

Datasets citing this paper 1

Spaces citing this paper 2

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.