← All projectsIndependent repository
Web Crawler Studio
A local-first TypeScript workspace for exploring pages, links, images and site structure across HTML and JavaScript-rendered websites.
TypeScriptNode.jsPlaywright
Problem
Turn a bounded website crawl into an inspectable inventory rather than an opaque list of URLs.
Architecture
Fast HTTP retrieval can escalate sparse application shells to Chromium. The workspace separates page inventory, link graphs, rendering evidence and export.
Tradeoffs & constraints
Browser rendering captures more dynamic content but costs time and memory. Smart mode preserves raw results and reports rendering failures rather than disguising them as success.
Architecture summary based on the repository documentation (new tab). Metadata verified 2026-09-17; repository availability and functionality may change.