Music data platform
A platform that collects music data from public sources, models it in dbt and serves it through a typed API.
It collects public charts and catalogs, such as Billboard and MusicBrainz, along with playlists from music platforms. Each record is linked to a MusicBrainz recording by ISRC, the standard ID code for a recording, and unclear matches wait for review.
Every stored record says which request and which run produced it. A retry reads the same frozen inputs as the first try and picks up where the work stopped. Each row the API serves carries flags for what its data may be used for.
How it's built
A Python service collects and enriches records, and dbt does every join and every total. A TypeScript control plane schedules the runs and shows each one in an operator console. It also generates a typed SDK for the tables, and an R package reads them for analysis. The whole stack starts on a laptop from one script, with synthetic data in place of the real sources.
Stack
- Languages
- TypeScriptRPython