TestinGil - Agile SW Testing Consultancy

TestinGil - Agile SW Testing Consultancy Exploring the magic of testing? Trying to perform automation wizardry? Put your Testing Hat on, and I'll help you!

Tomorrow I'm running a webinar on flaky tests. And then I'm going to do that again, just to make sure it passes successf...
02/06/2026

Tomorrow I'm running a webinar on flaky tests. And then I'm going to do that again, just to make sure it passes successfully.

One thing I'm going to talk about, which I haven't in a while is what happens when you've got some AI brains behind the API, and you've been tasked with making sure it works.

Because, if you thought my joke was flaky, wait until you see tests for AI behavior.

AI is the newest recruit for the flaky suspect gang. Tomorrow I'm walking through seven of them. Live examples for what can go wrong, and what to do about it.

And a tool I built that does this for me!
Free. With me.

Bring your cornflakes.

https://us02web.zoom.us/webinar/register/8517677800361/WN_Wo6ezTHfR3Smru0VRXxsSg
June 3rd, 3PM CET / 9AM EDT.

No software is an island.It has a lot of parts we don't need to write. Luckily.We can do whatever we can inside our soft...
01/06/2026

No software is an island.

It has a lot of parts we don't need to write. Luckily.
We can do whatever we can inside our software's borders, but can't really control what's happening outside them.

And we understand reality, and plan for it.

But when it comes to our testing, we're in a virtual reality. It's a different environment than production, and we can do things we can't over there.

It gives us the feeling of control. We assume we have it.

But that's not always true, is it? When our software calls a 3rd party service, we assume we're in control. But it may, or may not answer. And we assume we control the configuration, which is mostly true. But then, our friends from DevOps don't automate everything to be ready when our test starts running.

I have a webinar on Wednesday discussing the limits of control, which leads to flakiness.

But until then, tell me when this feeling of control has failed you. What were you sure will not happen, until it did?

No software runs in a vacuum.We assume our tests run the same way everywhere. Same machine as ours, always at the same t...
31/05/2026

No software runs in a vacuum.

We assume our tests run the same way everywhere. Same machine as ours, always at the same time we ran it the first time.

But then, time strikes back. It may be midnight, or a time-zone we never visited. Our test just wasn't prepared.

Sometime we make assumption explicit. But with time and date, we don't even notice making them.
And then: Would you like some flakes with that test?

My latest video talks about this. And a cleaning crew story.

https://youtu.be/yE5hnvk2VT0
And if you want all seven suspects in one session - my Fighting Flakiness webinar is this Wednesday.

Register: https://us02web.zoom.us/webinar/register/8517677800361/WN_Wo6ezTHfR3Smru0VRXxsSg
June 3rd, 3PM CET / 9AM EDT.

How do you handle time in your tests? Freeze it? Mock it? Pretend it doesn't exist?

our tests pass every morning. Every afternoon. Like clockwork.Then...

I promised you a story. And there it is.A real story, that happened at night, and has shaken our perception on reality.O...
28/05/2026

I promised you a story. And there it is.

A real story, that happened at night, and has shaken our perception on reality.

Ok, it wasn't that dramatic. But, we were young, and didn't know that the universe has played a joke on our confidence.

But it is a cautionary tale about belief, trust, and a cleaning crew.
All the good ingredients for a flaky test discussion.

Check out the video: https://youtu.be/yE5hnvk2VT0

Want to get a handle on reality again? Join my free webinar — Modern API Testing: Fighting Flakiness. June 3rd, 5 days away.

Register: https://us02web.zoom.us/webinar/register/8517677800361/WN_Wo6ezTHfR3Smru0VRXxsSg

June 3rd, 3PM CET / 9AM EDT.

our tests pass every morning. Every afternoon. Like clockwork.Then...

27/05/2026

In my examples in unit testing class, I always show an expiration calculation code. Checking if the current date is before or after a set expiration date.

And I ask about edge cases. And the people look at the code, and discuss and they come up with interesting cases.

And they write tests and review them, and run them, and everyone's happy, because now we have tests that will cover us in case of a code change. They will alert us if the code no longer does what it intends to do.

And you look at those tests and you want to almost hug them.

Until one test starts getting iffy. It mostly passes. But sometimes, in the dark of night it fails. And you look at the code - it didn't change. And the test - didn't either. And you run it again, and it passes, of course.

The only problem, is that in the dark of night, dates tend to change. And that may happen as our test runs, although mostly it doesn't run around midnight.

But who thinks about time, at the time of writing the tests?

There's a reason we mock dates and times to test logic. We want control and consistency. But system tests - API, UI - they don't have that luxury. And when they run, even if we don't intend it, may have an impact on the result.

Let me turn this to you. What's your craziest time related testing story?

What happens when AI generate tests for you?First, you feel joy - So much time saved on something I don't like to do.The...
26/05/2026

What happens when AI generate tests for you?

First, you feel joy - So much time saved on something I don't like to do.
Then, you feel dread - I need to read all that?
Then you say - tests look fine, ship it.

And most of them do, and they pass. Until they don't. And you run those pesky things again. And they pass.

Stupid idiot bot got me flaky tests.

I talk about assumptions we make when we write tests, which cause the flakiness. Now, bots don't assume, right? They are not biased. They were just trained on good tests by other people.

Who had their assumptions.

Yes, using AI to generate tests, comes with assumption baggage. Turns out, weeding out assumptions in tests doesn't go away, even if we didn't write them.

How do we do that? Join my webinar "Modern API Testing: Fighting Flakiness" on June 3rd, and find out. I'll also show you a tool I built that helps me do that.

Regardless who wrote the tests.

Register: https://us02web.zoom.us/webinar/register/8517677800361/WN_Wo6ezTHfR3Smru0VRXxsSg
June 3rd, 3PM CET / 9AM EDT for free.

25/05/2026

What makes a flaky test flaky?

It's the surprise and the repetition. You're surprised to see it, and even more surprised when you run it again, and it passes.

Why the surprise? Because we expect order and consistency. We like that in our automation. That's what we have it in the first place.

Ok, but where does the surprise come from?

Think about it - we're surprised when we expect something, and get something else. In fact, we assume something is going to happen, and it doesn't.

I have a video coming up on Thursday, that tells a story about how my team was hit by a "no one will ever do that." Like unplug our CI server during a run.

Each test we write has assumptions baked in. We block out any possible interference, because - who would interfere here?

But then something interferes. Another test, another operation at the same time. And then we spend the afternoon digging through logs.

What's your "no one will ever do that" story?

One week left.You know that Monday morning feeling. The weekend run is red. No new code. Those flaky ones again.Let's ha...
24/05/2026

One week left.

You know that Monday morning feeling. The weekend run is red. No new code. Those flaky ones again.

Let's handle them once and for all.

On June 3rd, I'm walking through all 7 suspects behind those morning debugging sessions. Live examples. And an AI tool I built to help spot them.

Register for the webinar: https://us02web.zoom.us/webinar/register/8517677800361/WN_Wo6ezTHfR3Smru0VRXxsSg
Watch the video: https://youtu.be/672LPe1HTRQ

You know how Monday morning's going to look like the minute you see...

You know that feeling. You open your laptop Monday morning and the weekend run is red.You know those tests. No new code,...
21/05/2026

You know that feeling. You open your laptop Monday morning and the weekend run is red.

You know those tests. No new code, it's those flaky ones.
You rerun. They pass. You move on.

But you know you should find out once and for all why their happening. And how to get rid of them.

Well, here's your chance.

A whole webinar about fighting flakiness. Yes, it's possible.

On June 3rd, I'm walking through all seven suspects - those that trap us in those morning debugging sessions. With live examples and an AI tool I built to help spot them.

Register for the webinar:
https://us02web.zoom.us/webinar/register/8517677800361/WN_Wo6ezTHfR3Smru0VRXxsSg

And here's the promo video.
Watch the video: https://youtu.be/672LPe1HTRQ

You know how Monday morning's going to look like the minute you see...

Address

Hod Hasharon
4529546

Alerts

Be the first to know and let us send you an email when TestinGil - Agile SW Testing Consultancy posts news and promotions. Your email address will not be used for any other purpose, and you can unsubscribe at any time.

Contact The Business

Send a message to TestinGil - Agile SW Testing Consultancy:

Share