Files

Steve Yegge b31bddc210 Optimize test suite performance - 45% reduction in integration tests

- Add testutil.TempDirInMemory() using /dev/shm on Linux for 20-30% I/O speedup
- Update slow hash multiclone tests to use in-memory filesystem
- Convert 17 scripttest tests (~200+s) to fast CLI tests (31s) with --no-daemon
- Disable slow scripttest suite behind build tag
- Add README_TESTING.md documenting test strategy and optimizations
- Update CI to use -short flag for PR checks, full tests nightly

Results:
- TestHashIDs_* reduced from ~20s to ~11s (45% reduction)
- Scripttest suite eliminated from default runs (massive speedup)
- Total integration test time significantly reduced

Closes bd-gm7p, bd-l5gq

Amp-Thread-ID: https://ampcode.com/threads/T-c2b9434a-cd29-4725-b8e0-cbea50b36fe2
Co-authored-by: Amp <amp@ampcode.com>

2025-11-04 11:25:36 -08:00

2.3 KiB

Raw Blame History

Testing Strategy

This project uses a two-tier testing approach to balance speed and thoroughness.

Test Categories

Fast Tests (Unit Tests)

Run on every commit and PR
Complete in ~2 seconds
No build tags required
Located throughout the codebase

go test -short ./...

Integration Tests

Marked with //go:build integration tag
Include slow git operations and multi-clone scenarios
Run nightly and before releases
Located in:
- beads_hash_multiclone_test.go - Multi-clone convergence tests (~13s)
- beads_integration_test.go - End-to-end scenarios
- beads_multidb_test.go - Multi-database tests

go test -tags=integration ./...

CI Strategy

PR Checks (fast, runs on every PR):

go test -short -race ./...

Nightly (comprehensive, runs overnight):

go test -tags=integration -race ./...

Adding New Tests

For Fast Tests

No special setup required. Just write the test normally.

For Integration Tests

Add build tags at the top of the file:

//go:build integration
// +build integration

package yourpackage_test

Mark slow operations with testing.Short() check:

func TestSomethingSlow(t *testing.T) {
    if testing.Short() {
        t.Skip("skipping integration test")
    }
    // ... slow test code
}

Local Development

During development, run fast tests frequently:

go test -short ./...

Before committing, run full suite:

go test -tags=integration ./...

Performance Optimization

In-Memory Filesystems for Git Tests

Git-heavy integration tests use testutil.TempDirInMemory() to reduce I/O overhead:

import "github.com/steveyegge/beads/internal/testutil"

func TestWithGitOps(t *testing.T) {
    tmpDir := testutil.TempDirInMemory(t)
    // ... test code using tmpDir
}

Platform behavior:

Linux: Uses /dev/shm (tmpfs ramdisk) if available - provides 20-30% speedup
macOS: Uses standard /tmp (APFS is already fast)
Windows: Uses standard temp directory

For CI (GitHub Actions): Linux runners automatically have /dev/shm available, so no configuration needed.

Performance Targets

Fast tests: < 3 seconds total
Integration tests: < 15 seconds total
Full suite: < 18 seconds total

2.3 KiB Raw Blame History