When comparing Codecov vs Code Climate, the Slant community recommends Codecov for most people. In the question“What are the best code coverage services?” Codecov is ranked 1st while Code Climate is ranked 4th. The most important reason people chose Codecov is:
Great detailed pull request comments including Codecov's Coverage Diff which breaks down coverage changes in the pull request. Comments are updated after every successful CI build.
Specs
Ranked in these QuestionsQuestion Ranking
Pros
Pro Detailed pull request comments
Great detailed pull request comments including Codecov's Coverage Diff which breaks down coverage changes in the pull request. Comments are updated after every successful CI build.
Pro Free version
Codecov is free for up to 5 users and open source repositories on Github, Bitbucket, and Gitlab.
Pro Grouping Coverage Reports
Codecov groups coverage reports to isolate coverage metrics. For example: unittest
vs functional
. Learn more here.
Pro Github commit status
Commit statuses are posted to maintain minimum coverage percentage.
Pro Coverage reports can be integrated into Github and Bitbucket with a browser extension
Overlay coverage reports directly in Github and Bitbucket for seamless integration into your workflow.
Pro Good customer support
Codecov has great customer support. Especially because it uses Intercom for communication which makes it easy to ask questions or make feature requests.
Pro Gives code improvement suggestions
Code Climate gives you suggestions on how to improve the code which you can catalog on Jira.
Pro Integration with team chat software
Code Climate directly integrates with team chat tools like Slack or HipChat.
Pro Shows test code coverage
Code Climate is fully integrated with test coverage statistics and metrics, giving you a complete view and understanding of them.
Pro Free for open source
Code Climate is completely free for open source projects.
Cons
Con Expensive - paid per user/month
Per-user pricing increases the pricing for us by 2600% compared to before.
Con Frequent downtime not reflected in status page
Often codecov.io URL returns 504 or 503 errors to the build scripts resulting in failed CI builds. Downtime is never reflected in their status page.
Con Node package doesn't support piped input
Most Node coverage uploaders allow you to pipe directly from a coverage tool into the coverage uploader, but Codecov seems to require that coverage is written to a file.
Con Browser extension not available for Safari
Con Mostly for web development languages
Code Climate only supports web development projects at the moment. Or at least languages that are widely used in web development (JavaScript, Ruby, Python and PHP). It has no support for largely used languages like Java or C++.
Con Repository token must be set manually for open source projects
The other services tend to automatically integrate with CI services like Travis, but Code Climate requires you to copy your repo's token into your CI service's environment.
Con Web interface doesn't show hits per line
Most code coverage services show both what lines of code were run and how many times each line was run, but Code Climate only shows the former.