When comparing CrossBrowserTesting vs TestingBot, the Slant community recommends CrossBrowserTesting for most people. In the question“What are the best cloud-based cross-browser testing services?” CrossBrowserTesting is ranked 2nd while TestingBot is ranked 11th. The most important reason people chose CrossBrowserTesting is:
Can automate tests for Chrome and Firefox extensions using Selenium.
Specs
Ranked in these QuestionsQuestion Ranking
Pros
Pro Automate browser *extension* testing
Can automate tests for Chrome and Firefox extensions using Selenium.
Pro Free manual testing for CodePen projects
Put your code on CodePen and you can manually test it with CBT from the "Choose a View menu".
Pro Uses real browsers, not emulators
CBT uses real, physical devices for live (manual tests). Check the pictures on their blog post.
Automated tests use real Android devices (Nexus, Galaxy) and iPad and iPhone simulators.
Pro Community / forum
Only 350 users, likely because the Forum isn't linked prominently in the top nav menu and because it uses a crappy engine.
Pro Record videos
Record videos of a URL in the browser/OS combination manually or automatically via the API.
Pro Screenshot comparisons
Automated screenshot comparisons report differences in layout. Manual side-by-side comparison also available.
Pro Selenium testing
Selenium automation for mobile and desktop browsers, using scripts easily recoded with Selenium Builder.
Pro Runs Selenium tests
Pro Appium support
Pro Secure tunnel for testing code locally
Pro Run tests in parallel
Pro Allows testing both manually and automatically in several browsers and platforms
You can test your website both manually and automatically with TestingBot in different browsers and platforms.
Pro Pristine VM for each test
TestingBot guarantees a fresh, untouched virtual machine for every test, unlike with browserstack
Pro Free for 100 minutes
Free accounts receive 100 minutes free manual testing, paid accounts have unlimited manual testing minutes.
Pro Latest browsers (beta/dev)
You can run tests on the beta/dev builds of browsers, to make sure everything works on upcoming browser version releases.
Pro Real mobile devices
TestingBot now offers Real Mobile Devices in its datacenter, capable of running both automated and manual tests.
Pro Manual testing
Cons
Con Slow and unstable
Con Not a sponsor of the Selenium project
Con Typos in the documentation
"relavent", "retreive"
Con Can't change physical iOS device orientation
All iOS devices are physical and arranged in portrait mode. Emulators/simulators and Android devices can change their orientation via a button or keyboard combination.
Con Very slightly misleading Selenium examples / documentation
The Selenium WebDriver script examples, by default, don't explain what to put in browser_api_name
and os_api_name
. This leads to an UnknownError: Invalid browser_api_name / os_api_name combination specified
error, if you just copy and paste the script.
Instead, first select an OS and browser combination, and the script wizard will fill in the '?'s for you.
Con Uses mobile emulators instead of real devices
Unlike CrossBrowserTesting, TestingBot uses mobile emulators.