Data tools

Two utilities for moving data in and out of an office: configurable web extraction, and a validated importer for CSV, JSON, Excel, and database sources.

Python · Streamlit · SQLite Stack

11,871 lines

Python only Frontend

Built · Local State

Built locally: it runs on a laptop or LAN, not a hosted demo.

Data Importer Pro upload screen with a selected CSV file. — A file upload starts the import. The app supports CSV, JSON, Excel, and database sources.

Inside the system

1 / 3

Data Importer Pro column mapping and a five-row preview of a fictional member register. — Source columns are mapped to output fields and previewed before the file is written.

Web Data Scraper job editor with four extraction fields. — A scraping job defines CSS or XPath fields, output format, and processing rules.

Web Data Scraper run summary with extracted item counts and a sample data preview. — Each run reports pages, extracted items, skipped URLs, and failures, with a sample of the output.

How it is built

Data tools is two internal utilities for moving records into and out of office systems. Web Data Scraper runs YAML jobs against static pages, JavaScript-rendered pages, or JSON APIs, with CSS or XPath selectors, pagination, processing rules, and CSV, JSON, or SQLite output. Data Importer Pro reads CSV, JSON, Excel, or database sources, maps columns, validates rows, and imports to SQLite or downloads a clean file.

The scraper reports pages, extracted items, skipped URLs, and failures after each run. The importer previews the mapped rows before it writes. The screens use a ten-row fictional register and a local demo notices page, not a client's records.

Surfaces

Web Data ScraperYAML jobs over static HTML, JavaScript pages, or JSON APIs.
Data ImporterValidated imports from CSV, JSON, Excel, and database sources.

→

Your system

The next entry is the work still done by hand. How a build runs.