Skip to main content

What is What is Professional Testing?


I was invited to the fifth Midlands Exploratory Workshop on Testing (MEWT) yesterday. In it, the MEWTs were asking: 
What is Professional Testing?
Wikipedia has this to say about what a professional is: A professional is a member of a profession or any person who earns their living from a specified activity. 
Hmm. So what’s a profession then?  A profession is a vocation founded upon specialized educational training, the purpose of which is to supply disinterested objective counsel and service to others, for a direct and definite compensation, wholly apart from expectation of other business gain. (also from Wikipedia.) 
In MEWT 5 we’ll be asking – what exactly does it mean to be a Professional Tester? And, since I already cited the quotes above. You won’t be allowed to. In fact, we’ll expect you to delve deep and reach far and wide into the many and varied facets of what it means to demonstrate professionalism in the face of a rapidly changing technological and sociological landscape.
This post is an edit of the notes I made while I was preparing my talk.

I'm going to use the question What is Professional Testing? as a lens through which to view, inspect and explore itself. I'll imagine a project where I'll take on the role of tester; MEWT will be the client and the call for the workshop will be the brief.

In order to tease out intuitions about professional testing I'll work though the project by making assertions about what the average person might think it would be reasonable to expect from a professional tester in particular situations. Once I have those, I'll wonder whether we can generalise from them into some kind of definition.

It's probably not too controversial to suggest that a professional in most domains should think carefully about knee-jerk responses (except for professional cage fighters, perhaps) so my first action here will be to exploit the information in front of me and read the full brief.

The brief's headline asks What is Professional Testing? but the body of the text includes another question:
 ... in MEWT 5 we’ll be asking - what exactly does it mean to be a Professional Tester? 
Is the workshop asking about professional testers or professional testing? That's two different questions. Or, at least, it might be two different questions. But there's more:
 .... what it means to demonstrate professionalism
So perhaps there's even three concepts here?

A professional tester should be, reasonable people might think, alert to nuances of meaning. They will know that sometimes in those small gaps, those seemingly innocuous chinks between terms, the fuzzy areola of greyness around the sharp black centre of a label, there are vast conceptual differences lurking. Even Humpty Dumpty knew that semantics matter and was prone to useful aphorisms like this:
When I say "Professional Testing" it means just what I choose it to mean — neither more nor less.
But by the same token, wouldn't reasonable people expect a professional tester to also know that sometimes there are not great differences in people's use of terminology and it's quite common for them to use varied vocabulary to refer to the same thing?

And the professional tester, I guess most of us would agree, should be able to navigate the world keeping ambiguities and multiple possibilities in mind until it's a sensible time to ask those involved whether it matters and whether the range of possibles need to be collapsed.

The brief also includes a definition of profession, with explicit instructions that it should not be quoted ... So here it is:
A profession is a vocation founded upon specialized educational training, the purpose of which is to supply disinterested objective counsel and service to others, for a direct and definite compensation, wholly apart from expectation of other business gain.
The instruction given alongside the definition is a blocking manoeuvre and noting such things is a characteristic that the man on the Clapham Omnibus is likely to want in his professional tester.

Perhaps in this case it means nothing; perhaps it's simply a pointer that the client wants us to do our own research. But then again perhaps it's a coded message that they want us to start from their point of view, that they expect we will encounter other people with other perspectives on this project and they are trying to constrain our acceptance of them. Or perhaps they don't really care what we do with respect to definitions their intended point being that we shouldn't waste time on things that they would consider unnecessary. Or none of those things. Or all of them.

As an aside, would right-thinking people be upset if, having hired a professional tester and told them not to do something, they still did it? It probably depends on the something, right? What about if the tester did it because they had an instinct that it was the right thing to do for the project? Like I just did ...

To try to understand the motivations better, a professional tester might explore alternative definitions. Definitions are often a good place to start in any case; they can provide anchors or reference points for other information discovered along the way and supply related terms to be investigated in their own turn. On consulting Oxford Dictionaries, I find that there are multiple definitions of professional, and alternative definitions of profession:
Professional: (a) Relating to or belonging to a profession; (b) Engaged in a specified activity as one’s main paid occupation rather than as an amateur; (c) A person competent or skilled in a particular activity
Profession: A paid occupation, especially one that involves prolonged training and a formal qualification
Someone with a little experience of testing might expect that the professional tester would look a little further than the obvious. In this case, when I do that, I find that there are also other senses of profession that we might come across that we can disregard for the purposes of the current mission:
Profess: An open but often false claim: "his profession of delight rang hollow"
Ah yes, the mission. Surely a professional tester would want to understand what their mission was, or at least some things that it wasn't, before going too far?

A professional tester attuned to language and blockers and ready to ask questions at the point when they are likely to add value, might choose now to talk to the client and highlight the potential for the brief to not be expressing the client's intent unambiguously enough to move forward.

And I couldn't think of a strong enough reason not to, so I asked Simon Knight, the content owner for MEWT 5, if he would take some questions. He said he would and so I emailed him a bunch:
  `
Who is asking this question? (or on whose behalf are MEWT asking the question?)
The organisers, on behalf of the testing community
And why?
Because we needed a topic to discuss at MEWT
Do they have a problem to resolve and has this question come up in their attempts to resolve it? If so, what is the problem?
See question below
What do they hope to achieve by asking the question?
Through further discussion we hope to find some heuristics and principles that can be utilised within the testing community to increase the profile of testing by improving behaviours, work-products etc
What do they expect to do (or be able to do) once they have the answer?
We expect to be able to communicate the results of our discussions by sharing materials, slides, thoughts and experiences
One might assume that a professional tester could glean a lot from this, from both the implicit information that surrounds the surface information and that surface information itself.

Look at how terse some of those answers are, look at how efficiently one answer is said to be covered by another, look at how the longer answers to the more open questions are shorter on specifics and look how the questions that could easily be answered directly have been answered directly and apparently without guile.

A professional tester might now attempt to test the relationship he or she is building with the client. Perhaps a drop of humour, edged with respect, illustrating that this is not the first rodeo for either of them? In this case:

Well played. Are you in senior management? ;-)
Cost/benefit analysis suggested spending less than 5 minutes of my time and giving you my most honest response would probably suffice. If you actually do need more info, let me know. 
A professional tester might make a working hypothesis that Simon is a pragmatist, thinking about his answers and why he is giving them in the way he is, sounds like he is prepared to talk straight, took the questions seriously but cares to guard his time. And, importantly for an information-seeker, is offering further information should it be desired.

Further, a professional tester - who we can undoubtedly assume is attuned to language, and communication, and the sociology of interpersonal relationships - might note that Simon did not use the word profession, nor any of its derivatives, in his response. And also that he didn't simply copy-paste bits of information from the brief or even refer back to the brief.

Armed with this new information, any professional tester worth his salt would surely reevaluate what they already knew, and try to state the mission (for their own benefit at least):
On the basis that there is no specific problem to solve here, and indeed no specific client to solve it for, questions of definition could justifiably become less part of the mission's own definition and more part of the deliverable, the report, the testing story. 
And in order to deliver the story the professional tester (and indeed any other kind of tester) needs ways to get to the content of the story. Because you can't have a story with no content, can you?

Unless you're a consultant.

Experience is a great guide to instinct here, but experience comes from practice. We might hope that a professional tester has practised and continues to practice. A professional tester, a practising professional tester, would certainly have battle-hardened tricks, an A-Z, for getting an investigation going, wouldn't they? They'd reach for tools such as analogy, anecdote, and antithesis to just list a handful of the A's.

Let's practice then; I'll pick a technique that I have found productive in the past: the use of antithesis to shape understanding. What might we contrast professional with? Perhaps amateur.

Remember that Galton talked about the wisdom of the crowd from a statistical perspective over 100 years ago and then think of uTest or 99tests. uTest touts itself as "The Professional Network for Testers". A professional tester might again notice the nuance here. The network is professional but are the testers considered professional? By who? In what way? And what does it mean for a network to be professional?

A professional tester might dig for a little more evidence. The uTest Facebook site says "uTest is the world's largest open community that exists to advance and promote the software testing profession." Another variant.

These kinds of companies sell testing services. They would almost certainly assert that they provide a professional service, if asked, but their projects are staffed by people who are not necessarily professional testers. A professional tester might be expected to make this kind of observation: does professional testing have to be carried out by professional testers?

Is there another kind of opposite of professional? Yes: Unprofessional.

A professional tester might be thought unprofessional because of some aspect of the way the work was carried out. e.g. making racist remarks or punching a member of his team. Is Jeremy Clarkson a professional TV presenter? Might we say he always behaves professionally?

This exposes the difference between being professional and acting professionally. Which does our client care about? And it's not a binary decision, necessarily. Also, testing is an activity. A tester can be doing more than one activity at a time and so acting both professionally and unprofessionally at once. For different observers, the same single action could be perceived as professional or unprofessional.

Another tool I sometimes use, and might hope that our imagined professional tester would also be familiar with, is looking for exemplars. In fact, this exercise exploring What is Professional Testing? itself could be seen that way. So what exemplars of professional testing are out there?

Well, there are bodies such as the Association for Software Testing. Its website says:
The Association for Software Testing (AST)  is an international non-profit professional association ... focused on supporting the development of professionalism in software testing, among practitioners and academics, at all levels of experience and education.
There we go again, more variants: "professional association" and "professionalism in software testing".

I am a member of the AST (and good on them for providing grant funding for this MEWT) and one of the things this means is that I agree to abide by their Code of Ethics and Professional Conduct, itself adopted from another body, the Association for Computing Machinery. The code mentions various flavours of professional over 50 times. Some examples:
  •  professional conduct
  •  professional work
  •  professional ethical standards
  •  computing professional
It might seem, to the professional tester, that the policy could be trying to bridge the gap between being and acting by describing claims or considerations that define the being and govern the decisions that lead to actions.

Some of these claims are very strict
I will ... be fair and take action not to discriminate.
but others are more aspirational:
I will ... strive to achieve the highest quality, effectiveness and dignity in both the process and products of professional work.
You'd think this latter one would be interesting to an alert professional tester, as it means that there is room for a professional to do low quality work and remain within the ethical code - so long as the intent and efforts made were in line with the code.

The professional tester might note that the code only references testing once - perhaps understandable given that it has come from the ACM:
To minimize the possibility of indirectly harming others, computing professionals must minimize malfunctions by following generally accepted standards for system design and testing.
But notice how it refers to "standards for .. testing." The professional tester might file that away for another time ...

... because the professional tester might be expected to recognise that this is too much detail for the average client in the average situation - think of the man on the Clapham Omnibus - and also to notice when the client is not average, or the situation is not average.

This is not an average situation. The client is a testing workshop and the mission is both broad and deep and concerned largely with the generation of ideas. A professional tester should be able to deal with that, we'd hope, wouldn't we, and deliver something that met the client's brief to the extent that they'd understood it and confirmed it.

Which brings us to delivery. The question was What is Professional Testing?

I think what I've just done here enumerates a set of things that it could plausibly include. But it's not a complete enumeration and a small change in any number of details could mean that anything done here would be considered unprofessional.

Take the question of definitions. Here, my proxy for a professional tester decided not to pursue them. On some other project, where lives were at stake, say, it might be be critical to pursue definitions at an early stage. As Potter Stewart famously didn't quite say:
Professional Testing is hard to define but I know it when I see it
But most clients would be justified in wanting something more than that, wouldn't they? So here's my stab at it, based on what I've found out in this exploration of the question:

Professional testing is testing
  • … by someone in a testing role, for a client
  • … at some time, for some project
which might 
  • … include specified practices
  • … involve people nominated as professional testers
  • … involve acting professionally
and which is
  • … unlikely to be amenable to tight definition
  • … but might accept an envelope like the AST’s
  • … and so have the client’s interests foremost
  • … but offers no guarantees about outcome

And to finish, here's a question that I hope that our theoretical professional tester would ask at the end of a piece of work like this: was What is What is Professional Testing? professional testing?
Image: playbuzz

Here are my slides:

Comments

Popular posts from this blog

Can Code, Can't Code, Is Useful

The Association for Software Testing is crowd-sourcing a book,  Navigating the World as a Context-Driven Tester , which aims to provide  responses to common questions and statements about testing from a  context-driven perspective . It's being edited by  Lee Hawkins  who is  posing questions on  Twitter ,   LinkedIn , Mastodon , Slack , and the AST  mailing list  and then collating the replies, focusing on practice over theory. I've decided to  contribute  by answering briefly, and without a lot of editing or crafting, by imagining that I'm speaking to someone in software development who's acting in good faith, cares about their work and mine, but doesn't have much visibility of what testing can be. Perhaps you'd like to join me?   --00-- "If testers can’t code, they’re of no use to us" My first reaction is to wonder what you expect from your testers. I am immediately interested in your working context and the way

Meet Me Halfway?

  The Association for Software Testing is crowd-sourcing a book,  Navigating the World as a Context-Driven Tester , which aims to provide  responses to common questions and statements about testing from a  context-driven perspective . It's being edited by  Lee Hawkins  who is  posing questions on  Twitter ,   LinkedIn , Mastodon , Slack , and the AST  mailing list  and then collating the replies, focusing on practice over theory. I've decided to  contribute  by answering briefly, and without a lot of editing or crafting, by imagining that I'm speaking to someone in software development who's acting in good faith, cares about their work and mine, but doesn't have much visibility of what testing can be. Perhaps you'd like to join me?   --00-- "Stop answering my questions with questions." Sure, I can do that. In return, please stop asking me questions so open to interpretation that any answer would be almost meaningless and certa

Not Strictly for the Birds

  One of my chores takes me outside early in the morning and, if I time it right, I get to hear a charming chorus of birdsong from the trees in the gardens down our road, a relaxing layered soundscape of tuneful calls, chatter, and chirrupping. Interestingly, although I can tell from the number and variety of trills that there must be a large number of birds around, they are tricky to spot. I have found that by staring loosely at something, such as the silhouette of a tree's crown against the slowly brightening sky, I see more birds out of the corner of my eye than if I scan to look for them. The reason seems to be that my peripheral vision picks up movement against the wider background that direct inspection can miss. An optometrist I am not, but I do find myself staring at data a great deal, seeking relationships, patterns, or gaps. I idly wondered whether, if I filled my visual field with data, I might be able to exploit my peripheral vision in that quest. I have a wide monito

Testing (AI) is Testing

Last November I gave a talk, Random Exploration of a Chatbot API , at the BCS Testing, Diversity, AI Conference .  It was a nice surprise afterwards to be offered a book from their catalogue and I chose Artificial Intelligence and Software Testing by Rex Black, James Davenport, Joanna Olszewska, Jeremias Rößler, Adam Leon Smith, and Jonathon Wright.  This week, on a couple of train journeys around East Anglia, I read it and made sketchnotes. As someone not deeply into this field, but who has been experimenting with AI as a testing tool at work, I found the landscape view provided by the book interesting, particularly the lists: of challenges in testing AI, of approaches to testing AI, and of quality aspects to consider when evaluating AI.  Despite the hype around the area right now there's much that any competent tester will be familiar with, and skills that translate directly. Where there's likely to be novelty is in the technology, and the technical domain, and the effect of

Postman Curlections

My team has been building a new service over the last few months. Until recently all the data it needs has been ingested at startup and our focus has been on the logic that processes the data, architecture, and infrastructure. This week we introduced a couple of new endpoints that enable the creation (through an HTTP POST) and update (PUT) of the fundamental data type (we call it a definition ) that the service operates on. I picked up the task of smoke testing the first implementations. I started out by asking the system under test to show me what it can do by using Postman to submit requests and inspecting the results. It was the kinds of things you'd imagine, including: submit some definitions (of various structure, size, intent, name, identifiers, etc) resubmit the same definitions (identical, sharing keys, with variations, etc) retrieve the submitted definitions (using whatever endpoints exist to show some view of them) compare definitions I submitted fro

Testers are Gate-Crashers

  The Association for Software Testing is crowd-sourcing a book,  Navigating the World as a Context-Driven Tester , which aims to provide  responses to common questions and statements about testing from a  context-driven perspective . It's being edited by  Lee Hawkins  who is  posing questions on  Twitter ,   LinkedIn , Mastodon , Slack , and the AST  mailing list  and then collating the replies, focusing on practice over theory. I've decided to  contribute  by answering briefly, and without a lot of editing or crafting, by imagining that I'm speaking to someone in software development who's acting in good faith, cares about their work and mine, but doesn't have much visibility of what testing can be. Perhaps you'd like to join me?   --00-- "Testers are the gatekeepers of quality" Instinctively I don't like the sound of that, but I wonder what you mean by it. Perhaps one or more of these? Testers set the quality sta

Vanilla Flavour Testing

I have been pairing with a new developer colleague recently. In our last session he asked me "is this normal testing?" saying that he'd never seen anything like it anywhere else that he'd worked. We finished the task we were on and then chatted about his question for a few minutes. This is a short summary of what I said. I would describe myself as context-driven . I don't take the same approach to testing every time, except in a meta way. I try to understand the important questions, who they are important to, and what the constraints on the work are. With that knowledge I look for productive, pragmatic, ways to explore whatever we're looking at to uncover valuable information or find a way to move on. I write test notes as I work in a format that I have found to be useful to me, colleagues, and stakeholders. For me, the notes should clearly state the mission and give a tl;dr summary of the findings and I like them to be public while I'm working not just w

Build Quality

  The Association for Software Testing is crowd-sourcing a book,  Navigating the World as a Context-Driven Tester , which aims to provide  responses to common questions and statements about testing from a  context-driven perspective . It's being edited by  Lee Hawkins  who is  posing questions on  Twitter ,   LinkedIn , Mastodon , Slack , and the AST  mailing list  and then collating the replies, focusing on practice over theory. I've decided to  contribute  by answering briefly, and without a lot of editing or crafting, by imagining that I'm speaking to someone in software development who's acting in good faith, cares about their work and mine, but doesn't have much visibility of what testing can be. Perhaps you'd like to join me?   --00-- "When the build is green, the product is of sufficient quality to release" An interesting take, and one I wouldn't agree with in general. That surprises you? Well, ho

Make, Fix, and Test

A few weeks ago, in A Good Tester is All Over the Place , Joep Schuurkes described a model of testing work based on three axes: do testing yourself or support testing by others be embedded in a team or be part of a separate team do your job or improve the system It resonated with me and the other testers I shared it with at work, and it resurfaced in my mind while I was reflecting on some of the tasks I've picked up recently and what they have involved, at least in the way I've chosen to address them. Here's three examples: Documentation Generation We have an internal tool that generates documentation in Confluence by extracting and combining images and text from a handful of sources. Although useful, it ran very slowly or not at all so one of the developers performed major surgery on it. Up to that point, I had never taken much interest in the tool and I could have safely ignored this piece of work too because it would have been tested by

The Best Laid Test Plans

The Association for Software Testing is crowd-sourcing a book,  Navigating the World as a Context-Driven Tester , which aims to provide  responses to common questions and statements about testing from a  context-driven perspective . It's being edited by  Lee Hawkins  who is  posing questions on  Twitter ,   LinkedIn , Mastodon , Slack , and the AST  mailing list  and then collating the replies, focusing on practice over theory. I've decided to  contribute  by answering briefly, and without a lot of editing or crafting, by imagining that I'm speaking to someone in software development who's acting in good faith, cares about their work and mine, but doesn't have much visibility of what testing can be. Perhaps you'd like to join me?   --00-- "What's the best format for a test plan?" I'll side-step the conversation about what a test plan is and just say that the format you should use is one that works for you, your coll