Compare performance of different AI coding models on their actual codebase
Buildermark supports agent benchmarking across Claude, Codex, Gemini, and Cursor, allowing developers to see which models perform best on their specific projects
Buildermark
Buildermark
Measure how much of your code is AI-generated. Open source.
Overview
What it is
Measure how much of your code is AI-generated. Buildermark matches your coding agent diffs with commits to calculate how much is by agents. Open source. Runs natively on macOS, Windows, and Linux.
Intent
I need it when
Aggregate AI code metrics across an entire development team
Buildermark's upcoming Team Server enables self-hosted aggregation of metrics across the organization, allowing comparison of agent adoption rates and developer productivity changes
Measure and track what percentage of code commits are generated by AI coding agents
Buildermark automatically matches agent conversation logs with git commits to attribute every line of code to AI agents, providing exact percentages per commit without requiring agent hooks or manual tagging
Rate and evaluate the quality of AI agent conversations and outputs
Buildermark allows manual conversation ratings or automatic agent self-critique via the /rate-buildermark skill, enabling quality assessment of agent-generated code
Maintain code privacy while analyzing AI-generated code contributions
Buildermark runs entirely locally on the user's machine with zero telemetry, ensuring proprietary code never leaves their infrastructure while still providing attribution metrics
Drop
Not a fit when
- User needs cloud-based code analysis without local infrastructure setup
- User requires real-time team collaboration features without self-hosting a server
- User works exclusively with non-AI-generated code and has no need for agent attribution tracking
- User needs support for coding agents beyond Claude, Codex, Gemini, and Cursor
- User operates on macOS versions older than Sequoia (15) or Windows versions older than Windows 10
Commercials
Pricing
Free open-source tool with optional paid Team Server for enterprise aggregation