Provenance & Profiling

Is your car German or Japanese? Are your chocolates from Belgium? And your wine, which country might that be from? There's a good chance you know the answer to some of those questions. Our culture places value on provenance. That is, we care where our possessions originate. It's something we tend to notice.

Warning label?

Furthermore, we ascribe, often without our notice, characteristics to things because of their provenance. For example, that's a Japanese radio - its reliable but not cheap, etc. I often do this un-empirically, without measurement or examination. (that's a flaw)

For software testing, our automatic identification of provenance can be both a useful tool and a distraction.

Noticing where or from whom a feature originated can be enlightening. You may learn over time that a particular team or person tends to implement certain things well, and others things not so well.

This has a tendency to help me to find some bugs relatively easily with individual teams. The first time it may have been time-consuming to see an issue. On subsequent releases, annoyingly easy.

That emotion is useful. Its an indication that you have, maybe subconsciously, profiled the team. You can direct your response to that feeling, in constructive ways. For example, searching for a route cause or suggesting the addition of some unit tests.

It can be useful to think and deliberate over how you may have profiled the teams or people. Again, this is valuable 'intelligence,' the profile can help with planning your time and focusing test automation efforts. Though, the pattern also embodies a form of bias. You should be aware that you are subject to this bias, and routinely double check your assumptions.

It would be easy to concentrate too long on easy to find - known unknowns that were easy to spot thanks to your biased view. To increase our opportunities for discovering new types of issues, set aside time for investigating the app in other ways.

Comments

Can Gen-AI understand Payments?

When it comes to rolling out updates to large complex banking systems, things can get messy quickly. Of course, the holy grail is to have each subsystem work well independently and to do some form of Pact or contract testing – reducing the complex and painful integration work. But nonetheless – at some point you are going to need to see if the dog and the pony can do their show together – and its generally better to do that in a way that doesn’t make millions of pounds of transactions fail – in a highly public manner, in production. (This post is based on my recent lightning talk at PyData London ) For the last few years, I’ve worked in the world of high value, real time and cross border payments, And one of the sticking points in bank [software] integration is message generation. A lot of time is spent dreaming up and creating those messages, then maintaining what you have just built. The world of payments runs on messages, these days they are often XML messages – and they ...

Text to SWIFT - making data from prose (What possible use could Gen AI be to me? - Part 2)

As I write this, my dog is grumpily moving around the room pausing intermittently to give me disappointed looks - looks that only my elderly mother could compete with. She (my dog) is annoyed by the robot vacuum cleaner. Its not been run for a while in that room - and its making a noisy foray into dark corners in a valiant effort to cleanse the mess. Its grinding gears and the cloud of dust in its wake is not helping to ease the dogs nerves. The dog's pleading puppy dog eyes & emotions have of course been anthropomorphised - at least a bit - by me (My dog is 7 years old and weighs over 20kg - so has little to fear). That is - I've taken human feelings and mapped them onto my dog. I know she has emotions - but she lacks language - or at least a language that (1) we humans understand, (2) maps to the same phrases or concepts I'm using. But I'm human, That's how I think and how I interact with people and sometimes - machines. Deciphering the problem and representi...

Don't be a Vogon, make it easy to access your test data!

The beginning of the hitch-hikers guide to the galaxy leads with an alien ship about to destroy the Earth, and the aliens saying we (mankind) should have been more prepared – as a notice had been on display quite clearly – on Alpha Centauri the nearby star system, for 50 years. Seriously, people - what are you moaning about – get with the program? The book then continues with the theme of bureaucratic rigidity and shallow interpretations of limited data. E.g. The titular guide’s description of the entire Earth is one word: “Harmless”, but after extensive review the new edition will state: “Mostly harmless”. Arthur Dent argues with the Vogons about poor data access This rings true for many software testing work, especially those with externally developed software, be that external to the team or external to the company. The same approaches that teams use to develop their locally developed usually don’t work well. This leads to a large suite of shallow tests that are usually h...

investigating software

Search This Blog