Files
ComfyUI/app/database
Simon Pinfold 9d3bfc393b Take the SQLite write lock up front for asset scan and output-registration writes (#16480)
* Take the SQLite write lock up front for scan and output-registration writes

The scanner's seeding and reference sync, and executed-output registration,
write through a separate engine whose transactions open with BEGIN
IMMEDIATE, and the database runs in WAL mode. On those paths stat, hashing
and metadata extraction now happen before the write transaction opens, and
reference-sync results are applied only to rows unchanged since they were
observed. busy_timeout stays at pysqlite's 5s default.

A fast-scan batch now commits as one transaction, so an unexpected error
partway through discards the whole batch; the next scan recreates it.
Enrichment, verification, uploads and tagging still write through the
existing sessions.

Migration backups use SQLite's backup API, and a legacy database is
checkpointed before it is relocated, since in WAL mode committed pages can
live in the -wal file that a plain file copy misses.

* Skip relocating a legacy database whose WAL cannot be checkpointed

The checkpoint can report busy without raising; moving the file then would
leave committed pages behind in the -wal. Also keep the source's file mode
on SQLite backups, as the plain copy did.

* Replace run_write_txn with a create_write_session factory

Write paths open the write engine's session the same way the rest of the
code opens create_session(), and commit explicitly. Executed-output
registration reads the new record's fields before committing, so expiry
does not reload them in a second write transaction.

* Document the scanner's pre-transaction observation types

* Document that write sessions must not nest

* Warn that a nested write session looks like lock contention

* Seed a hashed spec with the stat its hash was verified against

* Bound the SQLite backup so a locked destination cannot hang startup

* Time out a backup only while it is blocked
2026-09-23 15:17:11 -07:00
..