Empowering Resilience in a Sinking City

Two Ways of Seeing

What an algorithm misses about flood risk in Jakarta, and what the people living in it know

By Muhammad Asa · March 2026

Resilience Development Initiative · Funded by the British Academy

Jakarta is sinking. Beneath its northern coastline, 1.65 million buildings settle deeper into waterlogged ground each year. To map which structures face the greatest flood risk, researchers combined satellite radar, building-level flood modeling, and AI-driven predictions from street-level imagery.

But the algorithm could only see what Google Street View could reach. In the narrow alleyways of North Jakarta's fishing villages, where concrete meets tidal water and houses stand on stilts, the camera never arrived. The buildings the model missed most are the ones that need attention most.

This is a story told two ways: through the data, and through the people who live inside it.

RW 04 Kamal Muara RW 22 Muara Angke
Government infrastructure construction site in Kamal Muara, built without community consultation
Part 1

The Sinking City

Jakarta sits on a swampy alluvial plain at the mouths of 13 rivers, home to more than 10 million people. Decades of groundwater extraction have set the city on a path that no flood infrastructure can fully reverse: the land itself is sinking.

Satellite radar measurements from 2016 to 2024 show that subsidence is far from uniform. The map reveals where the ground is dropping fastest.

1,651,218 building footprints mapped across Jakarta

To understand who is most vulnerable, researchers built a building-level flood risk model combining hazard, exposure, and vulnerability scores for every structure in the city.

How I built this

Data pipeline: satellite data acquisition (Sentinel-1 SAR, 2016–2024), time series processing via LiCSBAS2, ground-truth validation against GNSS measurements, and interpolation (kriging in QGIS).

Paper and GitHub repository forthcoming.

Part 2

What the Algorithm Sees

Zooming into North Jakarta, every building carries a composite flood risk score derived from three inputs: how exposed the structure is to flooding, how severe the hazard at its location, and how vulnerable the building itself is.

The colors represent that combined risk. The darkest buildings face the highest convergence of hazard, exposure, and vulnerability.

One limitation is visible in the coloring itself: flood-related metrics were computed at the kelurahan (sub-district) level, producing the blocky, uniform patterns across the map. Buildings within the same kelurahan share the same hazard and exposure values, masking the variation that exists building by building.

Filling the Data Gap

Jakarta's building data has significant gaps in physical characteristics: construction materials, building use, and height. This information is essential for physical vulnerability analysis, which feeds directly into risk modeling. At scale, it could help policymakers prioritize interventions and reduce risk where it is needed most.

To fill this gap, the research team applied three vision-language models to predict building typologies from Google Street View imagery in Kecamatan Penjaringan, North Jakarta. From 83,728 raw Street View images, quality filtering narrowed the set to 29,937 buildings that received predictions.

But coverage was uneven, even within Penjaringan. The model could only predict buildings on streets wide enough for the Street View car to reach. When we zoom into two neighborhoods, the pattern sharpens.

How I built this

End-to-end ML classification pipeline: data acquisition via the Google Street View API (83,728 images), multi-stage data validation (error filtering, spatial buffer, LLaVA-NeXT quality screening), prompt engineering across four strategies, and multi-model evaluation using three vision-language models (Gemini 2.0 Flash, GPT-4o, Claude 3.5 Sonnet). Built in Python.

Paper and GitHub repository forthcoming.

Part 3

The Gap

Two neighborhoods in Penjaringan, North Jakarta. Both are fishing villages. Both face tidal flooding. Both sit on sinking ground. But the algorithm treats them very differently.

RW 04 Kamal Muara

43.9% of buildings unpredicted

535 buildings, 235 with no prediction

RW 22 Muara Angke

84.3% of buildings unpredicted

728 buildings, 614 with no prediction

Land Tenure, Not Street Width

The gap is not a random technical limitation. RW 04's wider streets exist because the government happened to formalize land ownership there, enabling road construction and infrastructure upgrades. Street View cars could drive in. The models could see.

RW 22's density tells a different story. Many residents were displaced from other parts of Jakarta and resettled on land whose legal status remains unresolved. Without formal tenure, government infrastructure rarely follows. Alleys stay narrow. The camera never comes.

Not every gap follows this pattern. Near PIK, the gated luxury development visible across the water from Kamal Muara, some buildings go unpredicted because the estate management prohibits Street View vehicles from entering. Others sit along narrow commercial lanes that no car can reach. But the dominant pattern is clear: where land tenure is informal, the data thins out.

The algorithm's blind spots trace the contours of structural inequality, not just street geometry. Research and policy need more than remote sensing and AI. They need to engage with communities directly.

Alongside the modeling, a team of researchers was already doing exactly that.

Part 4

The Flip

Same place. Different way of seeing.

While the modeling work mapped risk from above, a parallel ethnographic study handed cameras to 15 young people aged 18 to 25 in RW 04 and RW 22 and asked them to photograph the places that matter to them. What they captured is not what any satellite or Street View car could see.

Part 5

Life in the Kampung

Joy and Play

Children swimming at Curug Eceng, a drainage overflow point in Muara Angke that youth have renamed as a waterfall play spot
"We call this location a waterfall because the currents from the two areas collide, resulting in a strong current. Many children swim and play in this location, one of the exciting places and enjoy fate because of the continuous flooding."
Muara Angke (RW 22), "Curug Eceng"

Where flood models see hazard, the youth of Muara Angke see a swimming hole. They renamed this drainage overflow "Curug Eceng," the waterfall. Down the road, a flooded alleyway becomes "Waterboom Gang 1," borrowing the name of Jakarta's commercial water park. The humor is pointed. The play is real. Risk reimagined as ritual.

View from Kamal Muara toward the PIK luxury development across the water channel that youth swim across
"We swim to PIK a lot. Sometimes we get chased by security, but we're used to it. We always make it back."
Kamal Muara (RW 04), channel to PIK

PIK is the gated luxury development visible across the water from Kamal Muara. Swimming there is recreation, but it is also a small act of crossing a boundary that was drawn without asking.

Care and Empathy

Mussel peeling site in Kamal Muara where elderly workers now face a longer, steeper walk due to seawall construction
"Now that the shelling area is higher [following the seawall construction], they have to walk farther and climb more. It is tiring for them."
Kamal Muara (RW 04), mussel peeling site

The seawall was built for protection. But for the elderly women who peel mussels for a living, it made their daily commute steeper and longer. Resilience infrastructure does not land equally on everyone.

A grandmother's house in the kampung, the reason one young person stays despite flood risk
"This is why I stay. I don't want to leave her."
Muara Angke (RW 22), grandmother's house

Resilience in the kampung is relational and intergenerational. One young person stays not because the flooding is manageable, but because leaving means leaving family behind.

Spatial Exclusion

Government infrastructure construction site in Kamal Muara, built without community consultation
"They build without asking. They just come. We adapt later."
Kamal Muara (RW 04), infrastructure site

Government infrastructure arrives without consultation. Seawalls, roads, and reclamation projects reshape the landscape around the kampung while the people inside it adjust as best they can. Adaptation, here, is not a strategy. It is a condition imposed from outside.

Quotes and photographs from Darmawan, Adinta, Wimbadi, & Colven (2025). Urban Geography.

Part 6

Both Ways of Seeing

Pull back to the city scale, and both layers are visible at once: the risk scores that algorithms compute and the lives that people actually lead in those same buildings.

Neither view is complete on its own. The flood model tells us which structures face the highest hazard. The ethnography tells us that hazard is not the whole story, that resilience is woven into relationships, humor, daily routines, and the stubborn act of staying.

When both ways of seeing work together, something else becomes possible: risk assessments that account for what people value, not just what they stand to lose. Infrastructure that serves the people it surrounds. Research that begins by listening.

This story map is part of the Empowering Resilience in a Sinking City research project. The communities of RW 04 Kamal Muara and RW 22 Muara Angke made this research possible. The youth participants who shared their photographs and words are its foundation.

How I built this

This story map serves 1.65 million building footprints as vector tiles (PMTiles generated via tippecanoe), with scroll-driven chapter transitions (Scrollama) and responsive map rendering (MapLibre GL JS). The frontend is vanilla HTML, CSS, and JavaScript, deployed as a static site. Explore the full technical details in the Methods section below.

Technical Stack

What I used to build this project, from raw satellite data to interactive web map.

Data engineering

Data Processing

Python · GeoPandas · rasterio · tippecanoe

1.65M buildings processed

End-to-end ML pipeline

AI / Machine Learning

Gemini 2.0 Flash · GPT-4o · Claude 3.5 Sonnet · LLaVA-NeXT

83,728 images classified

Time series analysis

Remote Sensing

LiCSBAS2 · Sentinel-1 SAR · GNSS · QGIS

8-year time series (2016–2024)

Interactive web application

Web Visualization

MapLibre GL JS · Scrollama · PMTiles · COG

Vanilla HTML/CSS/JS, static deploy

Methods and Data

This story map draws on four interconnected research outputs from the Empowering Resilience in a Sinking City project. Technical details for each component are below.

Building Typology Predictions

Forthcoming

My contribution: Full pipeline: data acquisition from the Street View API, multi-stage data validation and quality filtering, prompt engineering across four classification strategies (S-D, S-M, CoT-D, CoT-M), and multi-model evaluation with three VLMs. Presented at CUPUM 2025, UCL. Paper forthcoming.

Three commercial vision-language models (Google Gemini 2.0 Flash, OpenAI GPT-4o, Anthropic Claude 3.5 Sonnet) predicted construction material, current use, and number of storeys for buildings in Kecamatan Penjaringan from Google Street View imagery.

Pipeline

  1. Image query: Building centroid coordinates from the DKI Jakarta dataset queried against Google Street View Static API, yielding 83,728 raw images.
  2. Pre-processing: Error image filtering (71,487 error-free), 10m road buffer intersection (16,246 spatially accurate), LLaVA-NeXT quality filtering (6,083), producing 29,937 analysis-ready building images.
  3. Prediction: Prompt optimization across four strategies (S-D, S-M, CoT-D, CoT-M), batch prediction with three VLMs, expert agreement evaluation for construction, current use, and storeys.
Flowchart showing the three-phase building typology prediction pipeline: image query, pre-processing, and prediction with three vision-language models
Building typology prediction pipeline (Shabrina, Asa et al.)

Shabrina, Z., Asa, M., Rui, J., Yin, L., & Law, S. (forthcoming). AI vs. human expert reasonings: Assessing agreements in building typology predictions based on street view imageries. Presented at CUPUM 2025, UCL.

Paper and GitHub repository forthcoming.

Flood Risk Modeling

Forthcoming

My contribution: I contributed the land subsidence modeling (see below), which served as one of the input variables for the flood risk scenarios.

Building-level flood risk scores (exposure, hazard, vulnerability, risk) for all 1,651,218 buildings in Jakarta. Methodology details will be added when the publication is available.

Citation forthcoming.

Paper and GitHub repository forthcoming.

Land Subsidence Monitoring

Forthcoming

My contribution: Full remote sensing pipeline: LiCSBAS2 configuration, atmospheric correction, time series analysis, ground-truth validation against GNSS, and spatial interpolation (kriging) in QGIS.

InSAR time series analysis of land subsidence in DKI Jakarta (2016-2024) using Sentinel-1 data processed with the LiCSBAS2 pipeline. Validated against GNSS ground truth at the CKJT station, with kriging interpolation for spatial mapping of annual subsidence velocities.

Pipeline

  1. LiCSBAS processing: Sentinel-1 interferograms (frame 098A_09673_121312) processed through 16 steps including GACOS atmospheric correction, producing cumulative displacement and velocity fields.
  2. Time series extraction: Annual velocity fields computed for 2016-2024 at monitoring locations.
  3. GNSS validation: InSAR line-of-sight displacement compared against GNSS vertical measurements at the CKJT station.
  4. Post-processing: Kriging interpolation in QGIS for continuous spatial coverage, clipped to DKI Jakarta boundary.

Citation forthcoming. Subsidence data processed using LiCSBAS2 (Morishita, Y., et al., 2020. Remote Sensing, 12, 424).

Paper and GitHub repository forthcoming.

Ethnographic Research (Photovoice)

Published

My contribution: Collaborative fieldwork. I participated in interviews, focus groups, and observation/town-watching activities. I contributed the study area map (Figure 1 in the published paper) and built this story map to bring the findings to a wider audience.

Photovoice study with 15 youth aged 18-25 in RW 22 Muara Angke and RW 04 Kamal Muara, Penjaringan, North Jakarta. Fieldwork conducted October 2024 to March 2025. Participants documented their lived experience of flood risk through photography and narrative sharing.

Themes

  • Joy and play: Youth reimagining flood-prone spaces as sites of recreation, identity, and belonging.
  • Care and empathy: Intergenerational relationships, adaptation as relational practice, impact of infrastructure on elderly livelihoods.
  • Spatial exclusion: Proximity to elite development, top-down infrastructure without consultation, displacement of gathering spaces.

Darmawan, A. B., Adinta, U. N., Wimbadi, R. W., & Colven, E. (2025). Between joy, care, and risk in the sinking city: Using photovoice to understand youth resilience in North Jakarta. Urban Geography. https://doi.org/10.1080/02723638.2025.2583952

Data Sources

Datasets used in this story map
Dataset Records Description
Building footprints 1,651,218 Polygon geometries from OpenStreetMap
Building attributes 1,651,218 Columns used: dm_risk (flood risk score), ai_construction (AI prediction presence)
Subsidence raster 1 raster Average 2024 velocity, InSAR + kriging, clipped to Jakarta
Study area boundaries 2 polygons RW 22 Muara Angke, RW 04 Kamal Muara
Ethnographic quotes 8 points Geocoded quotes with theme, speaker, photo path

The full building typologies dataset and other building-level data will be published on the Colouring Indonesia platform (currently under construction).