What is the best programming language for test automation?

Question

TestingProgramming LanguageAutomation

What is the best programming language for test automation?

6

Options
Considered

68

User
Recs.

Jan 15, 2024

Last
Updated

6 Options Considered

Best programming language for test automation	Price	Current stable version	GZipped size
-- Python	Free	3.9.1	22.5MB
-- Java	-	10	-
-- Node.js	-	-	-
-- Ruby	-	2.6.0	15.9 MB
-- bash	-	-	-

See Full List

VB.NET

Built By the Slant team

Find the best product instantly.

4.7 star rating

Try it now - it's free

score 33 · Answer 1

Python

Top Pro

Easy to get started

On top of the wealth of tutorials and documentation, and the fact that it ships with a sizeable standard library, Python also ships with both an IDE (Integrated Development Environment: A graphical environment for editing running and debugging your code); as well as a text-based live interpreter. Both help users to get started trying out code immediately, and give users immediate feedback that aids learning. See More

Top Con

Speed can matter

Python, like many interpreted and untyped languages, is fairly slow compared to compiled languages like C, C++ or Java. Sometimes this won't matter, but when it does you're talking about twenty times slower than C/C++ and ten times slowed than Java. See More

Specs

Current stable version:3.9.1

GZipped size:22.5MB

Platforms:Windows, Linux, macOS, AIX, IBM i, iOS, z/OS, Solaris, VMS

Typing discipline:Dynamically typed

See All Specs

Top Pro

Clear syntax

Python's syntax is very clear and readable, making it excellent for beginners. The lack of extra characters like semicolons and curly braces reduces distractions, letting beginners focus on the meaning of the code. Significant whitespace also means that all code is properly and consistently indented. The language also uses natural english words such as 'and' and 'or', meaning that beginners need to learn fewer obscure symbols. On top of this, Python's dynamic type system means that code isn't cluttered with type information, which would further distract beginners from what the code is doing. See More

Top Con

Might not be very future-proof

Lots of features that will probably be crucial as time goes (good support for parallelism for example) are missing or are not that well-supported in Python. See More

Top Pro

Cross-platform

Installs and works on every major operating systems if not already installed by default (Linux, macOS). See More

Top Con

Unflexible userbase

You will be expected to rigidly stick to the coding practices and to do everything by-the-numbers. See More

Top Pro

Active and helpful community

Python has an active and helpful community, such as the comp.lang.python Google Groups, StackOverflow, reddit, etc. See More

Top Con

Not good for mobile development

You can use frameworks like Kivy, but if your ultimate goal is to write mobile apps Python may not be the best first choice. See More

Top Pro

Has many libraries for scientific computing, data mining and machine learning

Python is commonly used in data science and has many libraries for scientific computing, such as numpy, pandas, matplotlib, etc. See More

Top Con

Hard to debug other people's code

As the structure of Python code is based on conventions many developers are not following them and so it is difficult to follow/extract the design of not trivial application from the code. See More

Top Pro

Good introduction to datatypes

Python's built-in support and syntax for common collection types such as lists, dictionaries, and sets, as well as supporting features like list comprehensions, foreach loops, map, filter, and others, makes their use much easier to get into for beginners. Python's support for Object Orient Programming, but with dynamic typing, also makes the topic of Data Structures much more accessible, as it takes the focus off of more tedious aspects, such as type casting and explicitly defined interfaces. Python's convention of only hiding methods through prefacing them with underscores further takes the focus off of details such as Access Modifiers common in languages such as Java and C++, allowing beginners to focus on the core concepts, without much worry for language specific implementation details. See More

Top Con

Slow to run

Check for example the first result from Google. See More

Top Pro

It's really simple

It's very simple for understanding how programming works. See More

Top Con

Language fragmentation

A large subset of the Python community still uses / relies upon Python 2, which is considered a legacy implementation by the Python authors. Some libraries still have varying degrees of support depending on which version of Python you use. There are syntactical differences between the versions. See More

Top Pro

Comes with extensive libraries

Python ships with a large standard library, including modules for everything from writing graphical applications, running servers, and doing unit testing. This means that beginners won't need to spend time searching for tools and libraries just to get started on their projects. See More

Top Con

Significant whitespace

While proper formatting is essential for any programmer, beginners often have trouble understanding the need and lack the discipline to do it. Add to that all those editors that randomly convert N spaces (usually 8) to tabs and you get an instant disaster. See More

Top Pro

Lots of tutorials

Python's popularity and beginner friendliness has led to a wealth of tutorials and example code on the internet. This means that when beginners have questions, they're very likely to be able to find an answer on their own just by searching. This is an advantage over some languages that are not as popular or covered as in-depth by its users. See More

Top Con

The process of shipping/distributing software is reatively complicated

Once you have you program the process of having a way to send it to others to use is fragile and fragmented. Python is still looking for the right solution for this with still differences in opinion. These differences are a huge counter to Python's mantra of "There should be one-- and preferably only one --obvious way to do it." See More

Top Pro

Good documentation

The Python community has put a lot of work into creating excellent documentation filled with plain english describing functionality. Contrast this with other languages, such as Java, where documentation often contains a dry enumeration of the API. As a random example, consider GUI toolkit documentation - the tkinter documentation reads almost like a blog article, answering questions such as 'How do I...', whereas Java's Swing documentation contains dry descriptions that effectively reiterate the implementation code. On top of this, most functions contain 'Doc Strings', which mean that documentation is often immediately available, without even the need to search the internet. See More

Top Con

Inelegant and messy language design

The first impression given by well-chosen Python sample code is quite attractive. However, very soon a lack of unifying philosophy / theory behind the language starts to show more and more. This includes issues with OOP such as lack of consistency in the use of object methods vs. functions (e.g., is it x.sort() or sorted(x), or both for lists?), made worse by too many functions in global name space. Method names via mangling and the init(self) look and feel like features just bolted on an existing simpler language. See More

Top Pro

Has features of both high and low level language

It is somewhere between C and Java. See More

Top Con

Limited support for functional programming

While Python imports some very useful and elegant bits and pieces from FP (such as list comprehensions, higher-order functions such as map and filter), the language's support for FP falls short of the expectations raised by included features. For example, no tail call optimisation or proper lambdas. Referential transparency can be destroyed in unexpected ways even when it seems to be guaranteed. Function composition is not built into the core language. Etc. See More

Top Pro

Static typing via mypy

Python's syntax supports optional type annotations for use with a third-party static type checker, which can catch a certain class of bugs at compile time. This also makes it easier for beginners to gradually transition to statically typed languages instead of wrestling with the compiler from the start. See More

Top Con

Does not teach you about data types

Since Python is a dynamically typed language, you don't have to learn about data types if you start using Python as your first language. Data types being one of the most important concepts in programming. This also will cause trouble in the long run when you will have to (inevitably) learn and work with a statically typed language because you will be forced to learn the type system from scratch. See More

Top Pro

Easy to find jobs

Python's popularity also means that it's commonly in use in production at many companies - it's even one of the primary languages in use at Google. Furthermore, as a concise scripting language, it's very commonly used for smaller tasks, as an alternative to shell scripts. Python was also designed to make it easy to interface with other languages such as C, and so it is often used as 'glue code' between components written in other languages. See More

Top Con

Assignment

Heavily relies on assignment, with no distinction between defining the variable and assigning the value. This makes it necessary to introduce rather complex environmental model of computation. See More

Top Pro

Supports various programming paradigms

Python supports three 'styles' of programming: Procedural programming. Object orientated programming. Functional programming. All three styles can be seamlessly interchanged and can be learnt in harmony in Python rather than being forced into one point of view, which is helpful for easing confusion over the debate amongst programmers over which programming paradigm is best, as developers will get the chance to try all of them. See More

Top Con

Multi-threading can introduce unwanted complexity

Although the principals of multi-threading in Python are good, the simplicity can be deceptive and multi-threaded applications are not always easy to create when multiple additional factors are accounted for. Multi-thread processes have to be explicitly created manually. See More

Top Pro

Advanced community projects

There are outstanding projects being actively developed in Python. Projects such as the following to name a random four: Django: a high-level Python Web framework that encourages rapid development and clean, pragmatic design. iPython: a rich architecture for interactive computing with shells, a notebook and which is embeddable as well as wrapping and able to wrap libraries written in other languages. Mercurial: a free, distributed source control management tool. It efficiently handles projects of any size and offers an easy and intuitive interface. PyPy: a fast, compliant alternative implementation of the Python language (2.7.3 and 3.2.3) with several advantages and distinct features including a Just-in-Time compiler for speed, reduced memory use, sandboxing, micro-threads for massive concurrency, ... When you move on from being a learner you can still stay with Python for those advanced tasks. See More

Top Con

Abstraction to the point of hinderance

Python is abstracted far enough that if it's your first language, it will be harder to pick up lower level languages later versus going the other direction. See More

Top Pro

Best chances of earning most money

According to Quartz, Python programming skills on average earn $100,000 per year. Closely followed by Java, C++, JavaScript, C, and R with $90,000 per year and above. See More

Top Pro

Can be used in many domains

Python can be used across virtually all domains: scientific, network, games, graphics, animation, web development, machine learning, and data science. See More

Top Pro

One right way to do things

One of the Guiding Principles of Python is that there should be only one obvious way to do things. This is helpful for beginners because it means that there is likely a best answer for questions about how things should be done. See More

Top Pro

Very similar to pseudo-code

When learning Computer Science concepts such as algorithms and data structures, many texts use pseudo-code. Having a language such as Python whose syntax is very similar to pseudo-code is an obvious advantage that makes learning easier. See More

Top Pro

Import Turtle

Do something visually interesting in minutes by using the turtle standard library package. Turtle graphics is a popular way for introducing programming to kids. It was part of the original Logo programming language developed by Wally Feurzig and Seymour Papert in 1966. Imagine a robotic turtle starting at (0, 0) in the x-y plane. After an import turtle, give it the command turtle.forward(15), and it moves (on-screen!) 15 pixels in the direction it is facing, drawing a line as it moves. Give it the command turtle.right(25), and it rotates in-place 25 degrees clockwise. Turtle can draw intricate shapes using programs that repeat simple moves. Example Turtle Star Drawing from turtle import * color('red', 'yellow') begin_fill() while True: forward(200) left(170) if abs(pos()) < 1: break end_fill() done() See More

See All

score 17 · Answer 2

Java

Top Pro

Selenium is written in Java

Top Con

Checked exceptions

Checked exceptions add significantly to the cognitive load of the beginner. The more rules unrelated to the actual task that you pile onto the beginner, the slower he gets. Exponentially. And for what? Sure, they look good on paper, but checked exceptions are useless in the real world. They don't scale. When you're calling APIs five levels deep and your method's throws clause balloons to 80 exceptions you might see, it gets kind of ridiculous. So you just say throws Exception, which defeats the whole feature, but is more pointless boilerplate in an already tediously verbose language. Or worse, while developing you can't be bothered and just catch{} and silently swallow them all. Then you forget about it. Now you don't even have exceptions. The cure is worse than the disease! So the wiser Java programmers will wrap all checked exceptions into a runtime exception, effectively making exceptions unchecked. That's at the cost of more boilerplate, but it's the lesser of evils. Unfortunately, Java doesn't even have macros to do this part for you. Maybe your IDE can write code templates for you, but that doesn't make it any easier to read. See More

Hendri Antomy's Experience

I am about 2,5 years do automation testing using java. in my opinion, Java is very easy to develop automation test. In my project, we implement SOLID principle and makes the code very reusable. we use maven also to help us get the library depedency. We also integrate our automation using springboot to get benefit for DI framework. We have tons of library to use in automation. Such as Serenity, Cucumber, Appium, Rest-Assured, etc. See More

Specs

Current stable version:10

Price:Open source (free)

Site:https://www.java.com

Top Pro

Most commonly used language in industry

Java is one of the most popular languages in industry, consistently ranking either first, or occasionally second (behind C or Javascript) in terms of usage. Polls (see sources below) show it to be consistently in high demand, particularly as measured by job board postings. This makes Java a great time investment, as you will be easily able to get a job utilizing your skills, particularly as those Java applications in production now will continue to need maintenance in the future. It also results in great support for tools and plenty of computer science books, example projects and online tutorials. See More

Top Con

Too verbose

A Hello world needs package, class, static method and the actual printf. Reading a line from input requires instatiating 5 objects in the right order. Exceptions are everywhere, particularly since all values are nullable. Java has a getter/setter culture, but without native syntax support. portable Java code lacks anonymous functions, and continues to lack good support for partial application, compensating instead with verbose design patterns, kludges like anonymous inner classes, or just inline code. It is statically typed without type inference, with a culture that promotes long class names. Poor support for sum-types and pattern matching leads to overuse of inheritance for dynamic dispatch and chains of nested conditionals Especially for beginners, this can make reading Java code feel overwhelming; most Java courses tell students to simply copy, paste, and ignore a significant percentage of the code until they've learned enough to understand what it means. For experienced programmers, this makes Java feel tedious, especially without an IDE, and actively discourages some solutions and some forms of abstraction. See More

Top Pro

Consistent programming standards

Most Java code follows very standardized coding styles. This means that when you're starting out, there are fewer questions about how you should implement something as the programming styles and patterns are well established and consistent. This consistent style means that it's often easier to follow others' example code, and that it's more likely to meet at least a certain minimum standard of quality. This discipline with consistent stylistic standards also becomes useful later, when collaborating on projects with larger teams. See More

Top Con

Worst-of-both-worlds static type system

It's just barely good enough to make decent IDEs, but it's not at the level of Idris or even Haskell. For large enterprise projects, the IDE support is important, but the static typing in Java just gets in the way for the smaller projects beginners would start with. Python is duck typed and this makes small programs easy to develop quickly, but the price is that you have to write unit tests to avoid breaking larger programs. In contrast, you can be reasonably certain that a program that actually compiles in Idris does what you want, because assertions are built into the powerful type system. Java can't make that claim and still requires unit tests. Java has the worst of both worlds because of its poor static type system. See More

Top Pro

Platform Independent

Because of the Java Virtual Machine, the Java programming language is supported wherever a JVM is installed. See More

Top Con

Half-baked generics

Type erasure means it doesn't even exist at runtime. The whole generics system is confusing for beginners. See More

Top Pro

Introduces you to object oriented languages

Object Oriented Programming (OOP) is a paradigm that teaches you to split your problem into simpler modules with few connections between them; it's the most common paradigm used in industry. Java is the best choice as an introduction to object oriented languages because, as a statically-typed OOP-only language, it very clearly highlights core OOP principles such as encapsulation, access control, data abstraction, and inheritance. While a scripting language provides more flexibility and terseness, learning a scripting language first would not instill these fundamental concepts as well, as they tend to obscure details such as how types work, and are less encouraging of an object oriented style. See More

Top Con

Long learning curve

Top Pro

Massive amount of libraries and APIs

Java has been around for such a long time that there have been tens of thousands of APIs and libraries written for almost anything you want to do. See More

Top Con

Confusing mis-features

Some features in Java can be quite confusing for beginners. Encapsulation is needlessly obfuscated with a confusing access control model. As an example, the "protected" keyword not only grants access to child classes, but to the entire package. Since small programs are written as one package, it becomes functionally equivalent to "public". In OOP, everything is supposed to be an object, but, in Java, primitive types such as integers, booleans and characters are not, and must be handled as special cases. Java continues to lack many high-level features, and, particularly prior to Java 7, compensated by adding confusing Java-only features, such as anonymous subclasses. Some example code is unreadable without knowing a special-case feature, libraries differ in style based on when they were released or what platform they target(e.g., Android vs. Desktop), and some solutions just aren't available on some platforms. See More

Top Pro

Fantastic IDEs

Because Java is statically typed, integrated development environments (IDEs) for Java can provide a lot more feedback on errors you will encounter. Java IDEs can give you specific errors in the location where they occur without having to run the code every time. This makes is faster to debug and learn from your mistakes. IDEs also have extensive auto complete capabilities that can help you learn the programming libraries you are using faster and tell you what functions are available. See More

Top Con

Lacks modern features

Java evolves very slowly - lambda expressions weren't available until Java 8 (which is not available on Android), and despite getters/setters being a long-time convention, the language still doesn't have native accessor syntax (a la C#'s properties). It's unlikely newer, popular features like list comprehensions or disjoint union types will be available anytime soon. While not strictly required for novice programmers, these make problems more complicated and tedious than they need to be - for example, when a simple local function would do, (portable) Java demands anonymous inner classes, an interface and a class, or worse, no abstraction at all. See More

Top Pro

Best introduction to "C style" languages

The Java syntax is very similar to other C style languages. Learning the fundamentals of Java will port over well to other languages so you can apply what you've leaned to other languages afterwards. See More

Top Con

Garbage collection may teach bad habits

Java is a garbage collected language and it does not force programmers to think about memory allocation and management for their programs. This is fine most of the time. However, it may cause some difficulties in adjusting to a non-GC language (such as C for example), where memory management needs to be done manually. But if good coding practices and habits are followed, this shouldn't be much of a problem. See More

Top Con

Locks you into the static OOP mindset

Top Con

Enforces some misguided principles

Java utilizes principles that organize code into "classes" as the central concept, instead of more familiar organizational methods. See More

Top Con

Static typing but no type inference

The type system gets in your way more than it helps. Heavy IDE support is absolutely required for reasonable productivity. This means beginners have to learn not just the language, but eventually a complex, heavyweight IDE too. See More

See All

score 8 · Answer 3

Node.js

Top Pro

Well-supported and tested

Large community of developers and deployed in many production environments. See More

score 5 · Answer 4

Ruby

Top Pro

Widely used

Ruby is one of the most popular languages for developing web sites. As a result, there's an abundant amount of documentation, sample code, and libraries available for learning the language and getting your project up and running. The most popular features are just 'gem install' away. Additionally, it is easier to find Ruby jobs because of this. See More

Top Con

Monkeypatching

Requiring a library can change the rules of the language. This is very confusing for beginners. See More

Thomas Clancy's Experience

It worked well. I didn't know much about Ruby but I was quickly able to understand the code, make modifications and add new tests for the product we were building. One complaint... it tended to be a bit slow. See More

Specs

Current stable version:2.6.0

GZipped size:15.9 MB

Top Pro

Clean syntax

Ruby has a very clean syntax that makes code easier to both read and write than more traditional Object Oriented languages, such as Java. For Ruby programmers, the focus is on the meaning of the program and how understandable the code is to developers. presidents = [ "Ford", "Carter", "Reagan", "Bush1", "Clinton", "Bush2" ] presidents.reverse.each_with_index { |name, index| puts "#{index}: #{name}" } See More

Top Con

No docstrings

It's hard to access Ruby's documentation from the REPL (irb), unlike Python, Lisp, and Smalltalk which let you ask functions how to use them, which is a great benefit to the beginner, and which also encourages you to document your program as you code it. See More

InfluentialAmeretat's Experience

Also used C, C++, JS, Python and Java. See More

Top Pro

Test Driven Development, #1

It's the fore-runner and trend setter for TDD. See More

Top Con

Focus on Object-Oriented Programming (OOP)

Focussing on OOP in a beginner stage is an easy and popular plan, but not the best one. See More

Top Pro

Hugely object oriented

Object oriented programming is one of the most important concepts in programming. See More

Top Con

Arcane grammar based on Perl

Ruby is too complicated for beginners: arcane Perlisms; semi-significant whitespace; parentheses are not necessary around method arguments, except for sometimes they are; control constructs could be elegantly implemented with block like Smalltalk (Instead they're baked into the grammar.); verbose block syntax, unless it happens to be the last argument. (proc lambda). There are too many exceptional cases and arcane precedence rules. See More

Top Pro

Easy to use by those who have little or no Ruby experience.

Top Con

More than one way to do it

A problem inspired by Perl. The core API interfaces are bloated. There's at least four different ways to define methods. More is not always better. Sometimes it's just more. See More

Top Pro

Newbie-friendly community

Top Con

Meta-programming causes confusion for new developers

The ability for libraries to open classes and augment them leads to confusion for new developers since it is not clear who injected the functionality into some standard class. In other words, if two modules decide to modify the same function on the same class can introduce a number of issues. Mainly, the order in which the modules are included matters. Since you more or less can't tell what kind of "helper" functions a module might write into any class, or for that matter, where the helper function was included from, you may sometimes wonder why class X can do Y sometimes but not at other times. See More

Top Pro

Meta-programming

Meta-programming provides efficiency and freedom. See More

Top Con

Dynamic type system

Majority of bugs could be resolved with types. See More

Top Pro

Essential algorithmic features

Top Con

Does not teach you about data types

Since Ruby is a dynamically typed language, you don't have to learn about data types if you start using Ruby as your first language. Data types being one of the most important concepts in programming. This also will cause trouble in the long run when you will have to (inevitably) learn and work with a statically typed language because you will be forced to learn the type system from scratch. See More

Top Pro

No indentation

No indentation increase development efficiency. See More

Top Con

Its ecosystem is limited outside of web development

If you're looking to host, generate, manipulate or secure a website, Ruby is your language. There's also some great support here for infrastructure as code work via Chef. However, it just doesn't have the depth and breadth that Python does. Things like native UI development, high performance math, and embedded / small footprint environments are barely supported at all in Ruby-space. See More

Top Pro

A large ecosystem of tools & libraries

Ruby has a large ecosystem of tools and libraries for just about every use. Such as ORMs (Active Record, DatabMapper), Web Application Frameworks(Rails, Sinatra, Volt), Virtualization Orchestration(docker-api, drelict), CLI tools(Thor, Commando), GUI Frameworks(Shoes, FXRuby) and the list goes on. If you can think of it, there is probably a gem for that ( and if not you can create your own and share with the community). See More

Top Pro

Ruby on Rails

Lays out an easy to follow and opinionated MVC pattern that teaches best practices through necessity. See More

Top Pro

Pry

See All

score 2 · Answer 5

bash

Top Pro

Default shell on most systems

Bash is the default shell on virtually every UNIX system. Making it very portable across different systems and once you get used to it, you can use it everywhere. See More

What is the best programming language for test automation?

6 Options Considered

Python

My Recommendation for Python

My Recommendation for Python

Easy to get started

Speed can matter

Clear syntax

Might not be very future-proof

Cross-platform

Unflexible userbase

Active and helpful community

Not good for mobile development

Has many libraries for scientific computing, data mining and machine learning

Hard to debug other people's code

Good introduction to datatypes

Slow to run

It's really simple

Language fragmentation

Comes with extensive libraries

Significant whitespace

Lots of tutorials

The process of shipping/distributing software is reatively complicated

Good documentation

Inelegant and messy language design

Has features of both high and low level language

Limited support for functional programming

Static typing via mypy

Does not teach you about data types

Easy to find jobs

Assignment

Supports various programming paradigms

Multi-threading can introduce unwanted complexity

Advanced community projects

Abstraction to the point of hinderance

Best chances of earning most money

Can be used in many domains

One right way to do things

Very similar to pseudo-code

Import Turtle

Java

My Recommendation for Java

My Recommendation for Java

Selenium is written in Java

Checked exceptions

Most commonly used language in industry

Too verbose

Consistent programming standards

Worst-of-both-worlds static type system

Platform Independent

Half-baked generics

Introduces you to object oriented languages

Long learning curve

Massive amount of libraries and APIs

Confusing mis-features

Fantastic IDEs

Lacks modern features

Best introduction to "C style" languages

Garbage collection may teach bad habits

Locks you into the static OOP mindset

Enforces some misguided principles

Static typing but no type inference

Node.js

My Recommendation for Node.js

My Recommendation for Node.js

Well-supported and tested

Ruby

My Recommendation for Ruby

My Recommendation for Ruby

Widely used

Monkeypatching

Clean syntax

No docstrings

Test Driven Development, #1

Focus on Object-Oriented Programming (OOP)

Hugely object oriented

Arcane grammar based on Perl

Easy to use by those who have little or no Ruby experience.

More than one way to do it

Newbie-friendly community