At VMware while looking for systems level engineers our team would give out a take home programming assignment and it was the most accurate measure of how good someone was. We’d give everyone the same test so it was easy to compare and it was quite niche so you couldn’t google an answer or ask someone else to do it. Not everyone has time to do it, but enough were that we found great candidates and didn’t hire any duds.

There was never a question (by us) about it being ethical. There was an initial engineering phone screen before we asked people to do this so there was serious intent to move to the next stage before the ask. We were also so specialized that we’d only get a couple of candidates per month get to that stage.

From an employers perspective I wouldn’t hesitate to do it again, but now you have to find things chatgpt can’t easily do, which is getting harder to find. someone who knows how to use chatgpt/claude well could be a good find if they know the fundamentals underpinning it.