Commit graph

13 commits

Author SHA1 Message Date
Шурупов Илья Викторович
0e64d439c4 DB-backed incremental redesign: find tracks missing locally
Replace the JSON-file pipeline with a SQLite/SQLAlchemy store (Postgres via
DATABASE_URL) and an incremental, ID-based matcher whose goal is "which
Spotify/iTunes tracks am I missing locally".

- src/db: models (Track/MbCache/FileState/IngestState) + engine/session.
- src/ingest: upsert prefetched spotify/itunes/local (work_dir/latest-1) by
  (source, source_id); pulls ISRC from raw Spotify; preserves enrichment.
- src/enrich: MusicBrainz recording-MBID resolver. Resolves via NORMALIZED
  text search (so the same song across sources lands on one MBID + one cached
  lookup), ISRC as exact fallback. Only touches unresolved tracks, caches
  positive AND negative results, rate-limited and resumable.
- src/match: normalization + cross-source matcher with tiers ISRC > MBID >
  normalized text; reports present/missing and the match method.
- main.py: CLI (ingest / enrich / match). Gui.py: missing-tracks viewer.
- README + requirements (SQLAlchemy, musicbrainzngs); ignore *.db.

Incremental everywhere: re-running updates only what changed; enrich continues
where it stopped. Live Spotify/local backends are left intact.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-15 01:25:21 +03:00
Шурупов Илья Викторович
36058c318a spotify: resilient fetching, progress bars, venv launcher
- fetch() uses a retrying session (connection resets, 5xx, 429 Retry-After)
  with backoff, so a transient drop mid-fetch no longer aborts the run.
- tqdm progress bars on all paginated fetches (driven by paging `total`).
- Flow.fetch_spotify(): drop stray `self` from the @staticmethod.
- gui.sh runs the venv's streamlit from the script dir; add requirements.txt.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-06-15 00:39:59 +03:00
Шурупов Илья Викторович
b6c59e81ad tmp 2026-02-07 11:24:59 +03:00
Шурупов Илья Викторович
99cd872227 nice 2026-02-07 00:48:46 +03:00
Шурупов Илья Викторович
35905ea942 stable 2026-02-04 21:21:19 +03:00
Шурупов Илья Викторович
5d38a146a1 lyrics fetcher 2026-01-17 14:24:05 +03:00
Шурупов Илья Викторович
9c9ddb7a9e nice stats and stable 2026-01-06 02:34:04 +03:00
Шурупов Илья Викторович
11fb2816e3 stable stat 2026-01-05 17:42:56 +03:00
Шурупов Илья Викторович
20c7b28ed6 fixes 2026-01-05 01:19:00 +03:00
Шурупов Илья Викторович
5f4bbbaa59 refactor 2 2026-01-04 23:40:41 +03:00
Шурупов Илья Викторович
a620e7a4f5 refactor initial not fully recovered 2026-01-04 19:25:42 +03:00
Шурупов Илья Викторович
892568d668 stable - generate local playlists & add default options 2026-01-04 01:37:47 +03:00
Ilya Shurupov
11e3b06824 stable
need run main fetch command
then run indexer
then LinkerPatternGenerator
then link_pattern command in the main
2026-01-03 19:56:39 +03:00