When comparing Codecov vs ccguard, the Slant community recommends Codecov for most people. In the question“What are the best code coverage services?” Codecov is ranked 1st while ccguard is ranked 7th. The most important reason people chose Codecov is:
Great detailed pull request comments including Codecov's Coverage Diff which breaks down coverage changes in the pull request. Comments are updated after every successful CI build.
Specs
Ranked in these QuestionsQuestion Ranking
Pros
Pro Detailed pull request comments
Great detailed pull request comments including Codecov's Coverage Diff which breaks down coverage changes in the pull request. Comments are updated after every successful CI build.
Pro Free version
Codecov is free for up to 5 users and open source repositories on Github, Bitbucket, and Gitlab.
Pro Grouping Coverage Reports
Codecov groups coverage reports to isolate coverage metrics. For example: unittest
vs functional
. Learn more here.
Pro Github commit status
Commit statuses are posted to maintain minimum coverage percentage.
Pro Coverage reports can be integrated into Github and Bitbucket with a browser extension
Overlay coverage reports directly in Github and Bitbucket for seamless integration into your workflow.
Pro Good customer support
Codecov has great customer support. Especially because it uses Intercom for communication which makes it easy to ask questions or make feature requests.
Pro Your own server, your intellectual property
You don't trust a third party service to host your IP? Host your own server, at no cost (every cloud provider will host your server freely for the first year).
Pro Open source
Pro Distributed references
The code coverage "references" are the previous measurements of code coverage. These references are distributed: all the team members can share the references in the same way they share the source code.
Cons
Con Expensive - paid per user/month
Per-user pricing increases the pricing for us by 2600% compared to before.
Con Frequent downtime not reflected in status page
Often codecov.io URL returns 504 or 503 errors to the build scripts resulting in failed CI builds. Downtime is never reflected in their status page.
Con Node package doesn't support piped input
Most Node coverage uploaders allow you to pipe directly from a coverage tool into the coverage uploader, but Codecov seems to require that coverage is written to a file.
Con Browser extension not available for Safari
Con Not really user friendly
There is little/no graphical user interface. Everything is done via command line instructions.