October 2026
arXiv · Preprint
VulnBump: A Benchmark for Fixing Vulnerable Dependencies in Real Projects While Keeping the Build and Tests Green
A benchmark of 307 dependency upgrades across 43 repositories, evaluating whether AI agents fix vulnerabilities while preserving successful builds and tests.
Gabija Pasiunaite, Ryan McMorrow, Brian Clark, Liran Tal, and Luke Tu