Marco Del Pin dba9bb91c3 fix(import): handle duplicate issue IDs in JSONL files gracefully ...

Implements three-layer deduplication strategy to prevent UNIQUE
constraint errors during import:
1. Early deduplication during processing (importer.go)
2. Pre-batch deduplication (importer.go)
3. INSERT OR IGNORE with explicit error handling (issues.go)
**Problem:**
JSONL files with duplicate issue IDs caused import failures:
  Import failed: UNIQUE constraint failed: issues.id
**Root Cause:**
- Go SQLite driver returns errors even with INSERT OR IGNORE
- Only content hash was deduplicated, not IDs
- Multiple code paths affected (insertIssue, insertIssues)
**Solution:**
Layer 1: Early deduplication by ID in upsertIssues (lines 489-502)
Layer 2: Pre-batch deduplication (lines 713-726)
Layer 3: INSERT OR IGNORE + isUniqueConstraintError() helper
**Testing:**
- Multiple production databases tested
- 9 duplicates handled successfully
- 100% success rate on v0.30.5 databases
- Zero UNIQUE constraint errors
**Impact:**
- Enables importing JSONL with duplicate IDs
- Duplicate count shown in import statistics
- No breaking changes, backward compatible
🤖 Generated with Claude Code

2025-12-18 19:26:29 +01:00

..

migrations

Phase 4: Remove deprecated edge fields from Issue struct (Decision 004)

2025-12-18 02:48:13 -08:00

adaptive_e2e_test.go

…

adaptive_length_test.go

…

adaptive_length.go

…

batch_ops_test.go

fix(import): defensive handling for closed issues missing closed_at timestamp

2025-12-14 17:21:44 -08:00

batch_ops.go

fix(import): defensive handling for closed issues missing closed_at timestamp

2025-12-14 17:21:44 -08:00

batch_test.go

…

bench_helpers_test.go

…

blocked_cache_test.go

…

blocked_cache.go

…

child_counters_migration_test.go

…

child_counters_test.go

…

child_id_test.go

…

collision_test.go

…

collision.go

…

comments_test.go

…

comments.go

…

compact_bench_test.go

…

compact_test.go

…

compact.go

…

config.go

…

cycle_bench_test.go

…

cycle_detection_test.go

…

delete_test.go

feat(tombstone): implement delete-to-tombstone and TTL expiration (bd-3b4, bd-olt)

2025-12-05 16:20:43 -08:00

dependencies_test.go

…

dependencies.go

Phase 4: Remove deprecated edge fields from Issue struct (Decision 004)

2025-12-18 02:48:13 -08:00

dirty_helpers.go

…

dirty_test.go

fix: Remove unsafe ClearDirtyIssues() method (bd-b6xo)

2025-12-17 19:10:13 -08:00

dirty.go

fix: Remove unsafe ClearDirtyIssues() method (bd-b6xo)

2025-12-17 19:10:13 -08:00

epics_test.go

…

epics.go

…

errors_test.go

…

errors.go

…

events_helpers.go

…

events_test.go

fix: Remove unsafe ClearDirtyIssues() method (bd-b6xo)

2025-12-17 19:10:13 -08:00

events.go

feat(tombstone): add P2 code review improvements (bd-saa, bd-1bu, bd-nyt)

2025-12-05 15:48:46 -08:00

external_ref_test.go

…

freshness_test.go

fix(daemon): detect external db file replacement

2025-12-16 06:29:59 +01:00

freshness_unix.go

fix: Windows build + gosec lint errors (#585)

2025-12-16 13:26:51 -08:00

freshness_windows.go

fix: Windows build + gosec lint errors (#585)

2025-12-16 13:26:51 -08:00

freshness.go

fix: Windows build + gosec lint errors (#585)

2025-12-16 13:26:51 -08:00

graph_links_test.go

Phase 4: Remove deprecated edge fields from Issue struct (Decision 004)

2025-12-18 02:48:13 -08:00

hash_id_test.go

…

hash_ids.go

…

hash.go

…

ids_test.go

fix(orphan): handle prefixes with dots in orphan detection (GH#508)

2025-12-14 17:23:46 -08:00

ids.go

fix: orphan detection false positive with dots in directory name

2025-12-16 01:06:14 -08:00

issues.go

fix(import): handle duplicate issue IDs in JSONL files gracefully

2025-12-18 19:26:29 +01:00

labels_test.go

fix: Remove unsafe ClearDirtyIssues() method (bd-b6xo)

2025-12-17 19:10:13 -08:00

labels.go

Phase 4: Remove deprecated edge fields from Issue struct (Decision 004)

2025-12-18 02:48:13 -08:00

migration_invariants_test.go

…

migration_invariants.go

…

migrations_test.go

feat(schema): add messaging fields for bd-kwro epic

2025-12-16 13:06:47 -08:00

migrations.go

Phase 4: Remove deprecated edge fields from Issue struct (Decision 004)

2025-12-18 02:48:13 -08:00

multirepo_export.go

feat(import/export): add tombstone support (bd-dve)

2025-12-07 20:34:02 +11:00

multirepo_test.go

…

multirepo.go

Phase 4: Remove deprecated edge fields from Issue struct (Decision 004)

2025-12-18 02:48:13 -08:00

orphan_handling_test.go

fix: orphan detection false positive with dots in directory name

2025-12-16 01:06:14 -08:00

prefix_validation_test.go

…

queries.go

Phase 4: Remove deprecated edge fields from Issue struct (Decision 004)

2025-12-18 02:48:13 -08:00

ready_test.go

…

ready.go

Phase 4: Remove deprecated edge fields from Issue struct (Decision 004)

2025-12-18 02:48:13 -08:00

resurrection_test.go

…

resurrection.go

…

schema_probe_test.go

…

schema_probe.go

…

schema.go

Phase 4: Remove deprecated edge fields from Issue struct (Decision 004)

2025-12-18 02:48:13 -08:00

sqlite_bench_test.go

feat(cli): add 'bd thanks' command to thank contributors

2025-12-14 12:40:32 -08:00

sqlite_test.go

fix: improve issue ID prefix extraction for word-like suffixes

2025-12-16 13:19:22 -08:00

sqlite.go

…

store.go

fix(daemon): detect external db file replacement

2025-12-16 06:29:59 +01:00

test_helpers.go

…

tombstone_test.go

fix(cleanup): resolve CHECK constraint failure and add tombstone pruning

2025-12-14 00:37:54 -08:00

transaction_test.go

fix(storage): persist close_reason to issues table on close (#551)

2025-12-14 14:18:01 -08:00

transaction.go

Phase 4: Remove deprecated edge fields from Issue struct (Decision 004)

2025-12-18 02:48:13 -08:00

underlying_db_test.go

…

util_test.go

…

util.go

…

validators_test.go

…

validators.go

fix(types): add tombstone validation and block direct status update (bd-md2, bd-y68)

2025-12-05 15:41:35 -08:00