December’2020 update

I’ve made a workshop for this practice. If you interested in writing test cases and bugs titles better, take a look:

Prephase

I am for more than 10 years in Software Testing already and during last several years I’ve become very interested in what QA Engineers write in their test cases.

I participated in a lot number of projects during last years, I looked at another projects test cases, I reviewed our test cases base (which is more than 100.000 test cases for today), I participated in a number of QA conferences where test cases design has been debated…


TL;DR

If you put as a dataset for pairwise online tool not only pairs, but also the words in between, then you can get ready-to-go titles for checklist or your test cases:

Image for post
Image for post
Screenshot from https://sqamate.com/tools/pairwise SQA Mate online pairwise test case generation tool

Details of the approach

Current situation

Almost everyone uses pairwise test generation tools only as the tools for all-pairs generation. I mean users get to the tool (online or offline), enter their dataset, generate pairs, get those generated pairs and disappear.

For example in SQA Mate online pairwise test case generation tool, users enter their input dataset:

Chrome, Firefox, Safari
Windows, Linux, MacOS

enter their exclude-pairs dataset:

Safari, Windows
Safari, Linux

and press “Generate pairs”…


— this is one of “jokes” told by Jared Spool at “Mind the Product” conference, at his speech “Building a winning product and UX strategy from the Kano Model” (full joke starts at 15m 10s):

2 weeks ago I’ve added 2 features to pairwise testing tool: “hotkeys” and “exclude pairs”:

I felt fine about “exclude pairs” feature, but was not sure about “hotkeys”. To track features usage I’ve logged requests for clicks and hotkeys and for using exclude pairs and not. So, I’ve got some stats to make the decisions based on data, not on my feelings.

“Hotkeys” feature usage stats

Only 8…


Image for post
Image for post

I imagine a world where test cases ideas are maintained and shared all over the world, so we — software developers of any kind — could use that global knowledge base made by engineers to test our software x10 times faster and better. Not to invent tests, but to get them from a global knowledge base like we take goods into the basket in supermarket — to cook them at home.

3 years ago, in January of 2017, I wrote an article, where I’ve put my vision on the table:

Described problem still exists. And no one still built any…


In early June 2019 on weekend and within 24h sprint I’ve built and launched a web-based, simple and easy to use pairwise tool based on allpairspy. And I also wrote an article about that launch and the process behind it:

I’ve noticed, that the tool was found useful: the number of users steadily grown up (usage has dropped during pandemic after-shock in spring-summer 2020):

Image for post
Image for post
SQA Mate pairwise tool stats for June 2019 — December 2020

People use it — so I decided to improve the tool even more.

First of all, I improved META-tags, keywords, description, texts — so people could find this tool even more. …


Image for post
Image for post
Photo by Ant Rozetsky on Unsplash

TL;DR

Eng: http://write-better.tilda.ws/en/titles
Rus: http://write-better.tilda.ws/

Price: $25 USD for 2h class.

Why did this class appeared?

In summer 2019 I wrote a post on Medium:

By now it is one of the most viewed (2.5K) and read (1.5K) posts that I ever wrote on Medium. And I’ve noticed that people continue to be inspired by this post: they share it with their colleagues in their social networks. That’s why bursts of reading still happen from time to time:


Tanshihelair

Do you have an X in your product? Could you add Y to your product? If you had Z in your product we could buy thousands and thousands of seats… and we know that no one would use it, but we would use it!

Everyone knows such kind of customers requests! This is because customers want everything under the sun!

Even my 75-years old professor from military university in Russia told that even military want “tanshihelair”: which means tank, ship, helicopter and airplane — all in one.

And this “tanshihelair” concept is well explained with the picture below:

Image for post
Image for post
Image credit: Intercom blog

— where…


TL;DR

Enjoy.

Preface

I’ve recently faced a task that required pairwise testing. But I didn’t want to install any software on my computer to generate the result. I just wanted an online tool that could generate me all-pairs. I thought it was fine to expect such things online nowadays. But to my surprise I could find the only one online tool for pairwise generation and it was difficult to use…

That tool solved my problem, but I thought about to create pairwise online tool with better (simpler) UX and make it a part of SQA Mate test cases management tool. …


Make the basic Quality Assurance of your app fast

Image for post
Image for post
Image credit: https://www.flickr.com/photos/83269636@N00/864364024

There are 3 simple tests that are the best spot to start your testing from: the Regular, the Blank and the Error tests.

If you test the app, the form, configuration — anything — you can make a fast assurance of their quality just testing them on these 3 simple conditions.

Take a classic example: a login form which has 2 input fields (login and password) and a submit button.

Does the form work? How to check it fast with the minimum amount of tests? …


I often see that Quality Engineers don’t write good resolution comments for the bugs they close as verified. Sometimes I see:

“Verified.”

“Verified.” — is not enough! What was verified? Where (which environment)? What was the app’s version? What was the behavior of the app, product or service?

These are very good questions! And the answers on them are very helpful especially when you face tricky situations when bug fixes do not get into release, when regression bugs appear in Production and so on.

It is also a very good habit to write good resolutions, comments, copy of any kind…

Alexey Sotskov

I write about practical and effective techniques that help me and my colleagues in everyday software development and testing.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store