3bce3138a9
- Created tests/benchmarks/git_traffic.py with 50-issue workflow - Measures git operations reduction: git-only vs Agent Mail - Generates comparison reports with pass/fail (70% target) - Results: 98.5% reduction (200 → 3 operations) - Added documentation in tests/benchmarks/README.md Closes bd-ic1m Amp-Thread-ID: https://ampcode.com/threads/T-0907bb40-ffc9-4f09-843f-b26716ef9ce0 Co-authored-by: Amp <amp@ampcode.com>
50 lines
1.2 KiB
Markdown
50 lines
1.2 KiB
Markdown
# Git Traffic Reduction Benchmark
|
|
|
|
**Date:** 2025-11-08T02:07:53.133565
|
|
**Issues Processed:** 50
|
|
|
|
## Results
|
|
|
|
### Without Agent Mail (Git-only mode)
|
|
- **Pulls:** 200
|
|
- **Commits:** 0
|
|
- **Pushes:** 0
|
|
- **Total Git Operations:** 200
|
|
|
|
### With Agent Mail
|
|
- **Pulls:** 1
|
|
- **Commits:** 1
|
|
- **Pushes:** 1
|
|
- **Total Git Operations:** 3
|
|
|
|
## Traffic Reduction
|
|
|
|
- **Absolute Reduction:** 197 operations
|
|
- **Percentage Reduction:** 98.5%
|
|
- **Target Reduction:** 70%
|
|
- **Status:** ✅ PASS
|
|
|
|
## Analysis
|
|
|
|
In git-only mode, each issue requires multiple git operations for coordination:
|
|
- Pull before checking status
|
|
- Commit after status update
|
|
- Push to share with other agents
|
|
- Pull by other agents to get updates
|
|
|
|
With Agent Mail, coordination happens over HTTP:
|
|
- No pulls for status checks (Agent Mail inbox)
|
|
- No commits for reservations (in-memory)
|
|
- Batched commits at strategic sync points
|
|
- Single push at end of workflow
|
|
|
|
**Expected workflow for 50 issues:**
|
|
|
|
| Mode | Operations per Issue | Total Operations |
|
|
|------|---------------------|------------------|
|
|
| Git-only | ~9 (3 pulls + 3 commits + 3 pushes) | 200 |
|
|
| Agent Mail | Batched | 3 |
|
|
|
|
**Reduction:** 98.5% fewer git operations
|
|
|