backup-docker-to-local

7 Commits

Include renames

Author	SHA1	Message	Date
Kevin Veen-Birkenbach	f3ef86a444	feat(backup): stricter databases.csv semantics + atomic SQL dumps CI (make tests, stable, publish) / make test (push) Has been cancelled Details CI (make tests, stable, publish) / Mark stable + publish image (SemVer tags only) (push) Has been cancelled Details - read databases.csv with stable types (dtype=str, keep_default_na=False) - validate database field: require '' or concrete name (no empty/NaN) - support Postgres cluster dumps via '' entries (pg_dumpall) - write SQL dumps atomically to avoid partial/empty files - early-skip fully ignored volumes before creating backup directories - update seed CLI to enforce new contract and update by (instance,database) - adjust tests: sql dir naming + add E2E coverage for early-skip and '*' seeding	2025-12-29 11:39:57 +01:00
Kevin Veen-Birkenbach	c01ab55f2d	test(e2e): add dump-only-sql mixed-run + CLI contract coverage - rename dump-only flag to --dump-only-sql across docs and tests - update backup logic: skip files/ only for DB volumes when dumps succeed; fallback to files when dumps fail - extend e2e helpers to support dump_only_sql - add e2e mixed-run regression test (DB dump => no files/, non-DB => files/) - add e2e CLI/argparse contract test (--dump-only-sql present, --dump-only rejected) - fix e2e files test to expect file backups for non-DB volumes in dump-only-sql mode and verify restore - update changelog + README flag table https://chatgpt.com/share/69522d9c-ce08-800f-9070-71df3bd779ae	2025-12-29 08:28:23 +01:00
Kevin Veen-Birkenbach	df32671cec	fix(backup): fallback to file backup in dump-only mode when no DB dump is possible CI (make tests, stable, publish) / make test (push) Has been cancelled Details CI (make tests, stable, publish) / Mark stable + publish image (SemVer tags only) (push) Has been cancelled Details - Change DB backup helpers to return whether a dump was actually produced - Detect DB containers without successful dumps in --dump-only mode - Fallback to file backups with a warning instead of skipping silently - Refactor DB dump logic to return boolean status - Add E2E test covering dump-only fallback when databases.csv entry is missing https://chatgpt.com/share/6951a659-2b0c-800f-aafa-3e89ae1eb697	2025-12-28 22:51:12 +01:00
Kevin Veen-Birkenbach	6adafe6b1f	fix(backup): log missing db config instead of raising CI (make tests, stable, publish) / make test (push) Has been cancelled Details CI (make tests, stable, publish) / Mark stable + publish image (SemVer tags only) (push) Has been cancelled Details - Use module logger in backup/db.py - Skip db dump when no databases.csv entry is present - Apply black/formatting cleanup across backup/restore/tests https://chatgpt.com/share/69519d45-b0dc-800f-acb6-6fb8504e9b46	2025-12-28 22:12:31 +01:00
Kevin Veen-Birkenbach	cf6f4d8326	test(e2e): stabilize MariaDB 11 tests and fix restore empty-mode client selection - add `make clean` and run it before `test-e2e` to avoid stale artifacts - restore: do not hardcode `mysql` for --empty; use detected mariadb/mysql client - e2e: improve subprocess error output for easier CI debugging - e2e: adjust MariaDB readiness checks for socket-only root on MariaDB 11 - e2e: add `wait_for_mariadb_sql` and run SQL readiness checks for dedicated TCP user - e2e: update MariaDB full/no-copy tests to use dedicated user over TCP and consistent credentials https://chatgpt.com/share/694ecfb8-f8a8-800f-a1c9-a5f410d4ba02	2025-12-26 19:10:55 +01:00
Kevin Veen-Birkenbach	4af15d9074	fix(restore): allow restoring files from different source volume The file restore command previously assumed that the target volume name was identical to the volume name used in the backup path. This caused restores to fail (exit code 2) when restoring data from one volume backup into a different target volume. Introduce an optional --source-volume argument for `baudolo-restore files` to explicitly specify the backup source volume while keeping the target volume unchanged. - Default behavior remains fully backward-compatible - Enables restoring backups from volume A into volume B - Fixes E2E test scenario restoring into a new volume Tests: - Update E2E file restore test to use --source-volume https://chatgpt.com/share/694ec70f-1d7c-800f-b221-9d22e4b0775e	2025-12-26 18:33:58 +01:00
Kevin Veen-Birkenbach	c30b4865d4	refactor: migrate to src/ package + add DinD-based E2E runner with debug artifacts - Replace legacy standalone scripts with a proper src-layout Python package (baudolo backup/restore/configure entrypoints via pyproject.toml) - Remove old scripts/files (backup-docker-to-local.py, recover-docker-from-local.sh, databases.csv.tpl, Todo.md) - Add Dockerfile to build the project image for local/E2E usage - Update Makefile: build image and run E2E via external runner script - Add scripts/test-e2e.sh: - start DinD + dedicated network - recreate DinD data volume (and shared /tmp volume) - pre-pull helper images (alpine-rsync, alpine) - load local baudolo:local image into DinD - run unittest E2E suite inside DinD and abort on first failure - on failure: dump host+DinD diagnostics and archive shared /tmp into artifacts/ - Add artifacts/ debug outputs produced by failing E2E runs (logs, events, tmp archive) https://chatgpt.com/share/694ec23f-0794-800f-9a59-8365bc80f435	2025-12-26 18:13:26 +01:00