Started with an AI agent, now doing a thing that won't scale (opens in new tab)

(medium.com)

7 pointsvkweb1y ago6 comments

6 comments

About a decade ago, I had success using a computer vision package for UI E2E testing. It was called Sikuli.

This seems like Sikuli taken to the next level.

vkwebOP1y ago

Man, Sikuli. My mind just blasted to see that people did similar stuff in 2009!

When I saw a few months ago, Open Interpreter used OpenCV to interpret GUI. Don't you think Sikuli was way way ahead of its time?

Please tell me more about the success part, if you could tell me more about what steps did Sikuli performed? how fast was it? Because when I last tried Open Interpreter that used OpenCV, it felt way too slow for UI e2e testing.

jnwatson1y ago

Sikuli was at least a decade ahead of its time.

It was slow; I just threw bigger computers at it.

My use case was complicated. I was testing HSM-like workflows across multiple hosts using native UIs. It worked really well.

1 more reply

egamirorrim1y ago

TL;DR Guy tried to write an AI E2E acceptance test running service based on existing Gherkin, it was harder than expected. Now he's a contract traditional QA Engineer. No big ending, just a snippet of a story.

vkwebOP1y ago

Yep, no big ending because that's the starting of something great I believe :)

j / k navigate · click thread line to collapse