Interviews exist because employers need a way to quantify and qualify your ability. Typical computer science problems are a (flawed, but concrete) way of doing that. No reasonable interviewer expects you to recollect breadth-first search flawlessly, on demand, onto a whiteboard. But they do expect you to be able to reason from a problem statement to something approximating a solution. That's fundamentally what programmers do. You should have the chops to think in this way, and you should be eager to try. Emoting "what the fuck?!" and claiming you can't, or won't, because you're not a recent graduate is an excuse and a cop-out.
A few popular open-source projects don't necessarily speak to your talent as a programmer. A 960 day GitHub streak is trivia, not a signal of anything useful. (If anything, it marks you as a target for burnout!) A few Hackathon wins and a couple hundred GH stars are the artifacts of a successful hobbyist, not a proxy for professional ability, or a gateway to employment.
GitHub stars are worth much more IMO. It shows that other developers value your work. That says a lot.
In the end, we have to realize that most developers are just average. Why go through the ridiculous process of finding average developers who by luck (or some homework) happen to solve the problems you throw at them perfectly?
If you think that AT LEAST one part of the hiring "process" isn't broken, you're living in lala land.
Lets just pick one: recruiters. You're telling me that every single tech recruiter you've come across is excellent at what they do, an amazing and decent human being and has amazing communication skills?!
(Generally/Most of the time) Recruiters don't--and yes, they should--care about candidates. They're interested in pocketing their cut of the candidates salary, so as soon as the company says they're not interested in the candidate, the recruiter is done. Most people don't get call-backs even informing them that they're out of the running, much less a reason as to why they weren't deemed qualified.
Recruiters--especially tech recruiters are NOTORIOUS for being bottom-dwelling scum. I actually know a few good recruiters, but they are--by far--in the minority.
The fact that you don't recognize this indicates that you've either had extraordinary/atypical results, or aren't very familiar with the "process". Dude.
Edit: spelling, puncturation
How do you know his skills aren't useful to the market? That seems like a terrible thing to say.
Maybe I am conceited, but I can't convince myself I am an inferior programmer because of it. I can make money for your company. I can work well with a diverse of group of people. I take pains to conduct myself with integrity. Shouldn't all that be the central measure of how people are hired ?
In under 45 minutes? Are you really concerned with their ability to even naively solve an algorithmic problem in that time frame? I would think not. No, this is not only flawed, but it's so deeply flawed (and easily exploitable), that you're not even interviewing for skill set anymore, simply either 1) someone's luck for having been exposed to the problem before or 2) their ability to remember things they don't use day to day.
Congratulations, you're hiring lucky people or idiot savants.
If having source code and demonstrated traction for a few open source projects to review don't speak to one's talent as a programmer, then what does?
The author seems to have a chip on his shoulder...
Wait, really? I've had to do more than that just for internships, the bar for perfection at many companies is just that high or higher.
I agree with the rest of what you're saying.
Heck, what if I picked 5 problems from a national level math-Olympiad. You've surey studied high school math right? Should be able to solve them in the 5 hour interview I invite you to!
I didn't even want to go to the interview which landed me my new job. In my previous phone screen they were looking to hire a single person.The perfect fit. Probably not me - what the hell do I know about video players? And it's one of those interviews where they'll boot you to the curb if you do poorly in the first half. Whatever, I'll go anyway. And as luck would have it, I didn't get booted. I did damn well. And in my final phone screen with the CTO, I got asked how to find the Nth last spot from the end of a linked list.
I really wasn't good at interviewing for a long time. And from the outset, I didn't know everything I needed to get the job I wanted. It was consistent studying and a buy-in to the bullshit that interviewing is that landed me a new job.
So while I lined up clients and started transitioning from the current job I applied for a couple positions (note that as an executive I did this by contacting other executives (when possible) at firms, not filling out forms on the website).
I had a few phone interviews, and these were fine.
But a couple times it would get kicked to HR and they would send links for personality tests - before I ever talked to anyone.
I guess if I was desperate for a job (really glad I didn't take one) I might have complied, but I decided I didn't want to work for a firm that approaches recruitment like that.
What country was this in? In Ireland that qualifies as employment discrimination on the "civil status" ground.
There is another side to this which leads me to ask why companies feel they have to be so defensive? My wife is a registered nurse on a cardiac critical care ward. If she doesn't know what she's doing actual people can actually die, something that is a rare outcome for even the worst software developer. Nevertheless, she has a BS, and work experience, and when she interviews they don't require her to stand up at a whiteboard and prove she's a nurse all over again. They respect her experience, and the questions are more about process, work habits, personality, etc. In the software development world we appear to have zero respect for experience, and I wonder why that is? Have employers been burned so often? Or is this more of a geek cred gauntlet thing?
There is no such regulation in the tech industry. One bad hire I made faked his technical capabilities and I regretted it a lot when I had to work with him. I hope I've now learned how to spot that type of candidate (without resorting to interview hazing).
I don't doubt for a minute that there's some kind of alpha geek thing going on with a lot of interviews. But it's also a reflection of the fact we don't have a widely-accepted accreditation body that can vouch for people.
Reciting the implementation of some obscure algorithm from memory is entirely irrelevant to the daily job of a software engineer. Being able to do that does not make you a good software engineer, and most good software engineers cannot do that.
They do these "programming trivia" style interviews because it makes them feel clever and superior to the interviewees, and because it's a lot less work for them than conducting an interview that actually probes what level of software engineering talent the candidate has.
On the one hand: the interview processes this post describes are hilariously broken. Stand up at a whiteboard and implement breadth-first search from memory! You know, like no programmer at their desk staring at their editor ever does. I think "that's the one where you use a queue, right?" is a fully valid and complete answer to that dumb question.
I also think you're within your rights to demand that your interviewer implement Kruskal's minimum cost spanning tree from memory at the same whiteboard before you have to do BFS. That's an extremely simple and important graph theory algorithm that nobody memorizes either.
These interviews are nerd status rituals. Really good candidates know this and game them. If you know anyone like this, ask them for stories. I've heard some great ones. But obviously, this isn't a good way to select software developers.
On the other hand...
The idea that "front-end developers" shouldn't need to be able to implement a BFS (at all) bothers me a lot. If you're a software developer, you should grok basic conceptual computer science. You should be able to work with a graph. If you're doing web work, you're working with graphs all day whether you grok that or not!
I've been doing front-end work for the past month, and I've had to do more low-level profiling and performance work here than in the previous 4 years of low-level systems work.
Frontend devs can do many tasks that systems engineers (who can supposedly whip out algorithms in their sleep) cannot do: - Make pages render properly in all popular browsers - Make responsive UIs - Align text of variable length in the vertical center of a page - Know when to use tables and when not to - Understand when to use a SPA app and what not to - Make SEO friendly pages
etc.
All this has nothing to do with said algos. I really think that people who don't understand this should not be interviewing frontend engineers.
They were disappointed, they wanted to see runnable code right there on the whiteboard.
I think you're right, you should know basic conceptual computer science. I felt like I did a good job of explaining that I understand enough to do a real implementation if I had to, with man pages and my IDE and so on. But nope, they wanted a piece of acrylic to be a compiler, and that's just wrong IMO.
What do you do if you have a nested data structure (like a tree) and want to print it in order? You write a simple BFS on it.
It's not even a question where you need prior knowledge on the algorithm, it's just logical. He could've easily asked "Print the contents of this tree to screen" and it would've been the same.
I can see how some questions like implementing quick or merge sort can be annoying, most libraries have a sort() function that usually implement either (or similar), you don't often have to write them yourself, but a BFS does not fall into that category in my opinion.
As a self taught programmer things like binary search trees and linked lists are a foreign concepts (especially as a self taught frontend developer). When I am asked to solve a problem in a way I've never encountered before, people are pretty open to explaining how the problem works.
I don't get frustrated if a problem seems arbitrary or obscure because that's typically not the point. The point is, if you're going to join my team, how do you approach a difficult problem; do you get upset? do you clam up? I don't want someone like that on my team. I'd say most people would prefer a teammate who is resourceful rather than one who only wants to solve problems they're comfortable solving.
This is a great, great point.
I'd like to add one more: Admitting when you don't know the answer. I've been in a number of recent phonescreens where we'd ask a technical question of a simple "good/bad" sort. My advise to those reading: If you don't know, just say so. "I'm really not sure." or "I knew at one point, but I'd have to go look it up again." Perfectly acceptable. No one's a walking encyclopedia, and to say you don't know show's humility. I'm much more comfortable with someone who says they don't know and will go look for the correct answer than someone who might stand in front of the customer and try to poker face.
To those reading this and taking notes for an interview, I'd say instances like these are a good opportunity to discuss. If you don't know, ask what the correct answer was. Ask why. See if you can build off the answer, sometimes you might get asked a question you couldn't recall the answer for, but once given, you can expand upon and demonstrate your knowledge in other ways.
OP sounds like someone who will rage quit and have tantrums. Those aren't employable qualities.
But is that an accurate impression in context? He obviously has a practical background, likes to code, and can solve problems.
How do you tell if he'll be a net benefit or a net loss to a team?
I don't think asking anyone to improvise a BFS tells you much about that.
For experienced people, it's not what you know, it's who you know. You tell your connected friend that you're looking for a job, he tells you who's hiring and gives you a recommendation.
You still have an interview, but it's no longer adversarial, it's a formality, it's friendly, it's just a screen to make sure you're not faking it. One of the people on the other side of the table has seen your work before, so is on your side. So when you get those stupid questions, it's a joke that you all laugh at. You handwave at it, and it's enough.
There are obviously problems with the above process -- it leads to hiring friends rather than the "best" candidate, but I'm surprised that we've moved so far away from it that the obviously well-connected OP is having so much trouble.
When I interviewed at Google after working for a small company for 13 years, it was my first "newfangled" tech interview. I didn't know anybody in the room. And it was more than a formality. I'm a fairly terrible interviewee, and although I got hired (finally, after a very long process), I was hired at least a level below where I should have been. I blame my fuzzy memories of algorithms I haven't had to implement in 20+ years. I finally got promoted to the correct level nearly 2 years later.
Contrast this with Netflix, where I found the opening via my network. I knew more than half the people who interviewed me, and the interview itself felt like it was basically a formality. Days later they made an offer that I accepted.
Those went smoothly so I was asked to fly out to Los Gatos, CA.
On-site I was supposed to talk first with the senior engineer I had already interviewed with over the phone. He was out sick so they changed at the last minute.
In walks a guy in a fedora with full tattoo sleeves. He glances at my resume and laughs saying he hasn't looked at it at all and really knows nothing about me.
He proceeds to ask me detailed questions about Node.js. I told him that I was very clear with them on the phone, that I've played around with Node, but I hadn't used it to any serious degree (at that point in my career).
He continued with the Node.js questions for a while, some of which I knew because they were the same as the browser (console) some of which I wasn't familiar with at the time (EventEmitter).
He then asked me some simple JavaScript, Backbone, CSS questions all of which were easy. He then asked me a C# question and I knew that too.
We shook hands and after he left, the engineering manager came back in and I was basically escorted out. He said I was good but that I wasn't what they were looking for.
I've had some retarded interview experiences but that one took the cake.
I'm totally serious: I really wonder how many of these baffling interview experiences where seemingly highly-qualified candidates get turned down is really about non-technical and non-work-related factors, but no one wants to actually admit it. How much of it is due to personal biases by the interviewers, who may discriminate against people for various reasons? A lot of people want to surround themselves with people just like themselves, so if you have a company full of hipsters wearing fedoras and someone comes in for an interview and they don't look like that, they could easily be passed over because they're "not a fit for our company culture".
I don't think I'm half as competent as the guy who wrote this article, but I've had a much easier time getting jobs in general. My background isn't even CS, it's EE, so I totally suck at all the algorithm questions. But OTOH I generally apply for embedded programming positions where knowledge of algorithms isn't that important anyway. I even interviewed at Google (one of their recruiters contacted me) and had pretty much the same experience as him; I won't waste my time with that company again. A bunch of recruiters have tried to get me to interview at Bloomberg LP, but I would never work in that crappy open-plan environment that they're infamous for. But I frequently wonder how much of my success is just from being tall and in-shape, not having any obvious personality quirks, and "fitting in" with the look and the company culture (I interview with more stodgy places, not places with hipsters with arm-sleeve tattoos), rather than due to my technical proficiency.
I wish Sahat had reached out to more of his network before responding to random recruiters. Tech interviews as Sahat experienced them are broken, but tech hiring is slightly less broken especially when you leverage your network.
Has his network moved forward in what they do? I've found with my own network that so many of them are in the same (or equivalent) spots they were when I left to advance my career. Not precisely positions of power which I can take advantage of for the next step forward in my career.
> To be fair, I already knew about Google’s idiotic interview process that is optimized for hiring book-smart academic candidates who know their algorithms and data structures cold, so my expectations were rather low to begin with. I also did not get much sleep that day, so my problem solving skills weren’t at its peak.
The author is already annoyed, antagonistic, and planning for failure. He knew what he was up against, but didn't adequately prepare to succeed by studying. And didn't sleep the night before.
And none of the reasons for not succeeding are the author's fault, in his mind.
You can claim that the screening process is dumb, and in some ways you're right. But at the same time, this process does select to some extent at least against the people who make excuses instead of bringing their A-game when it counts.
If you want a job at a place like this, you can do it: commit yourself to a plan of action for success that involves real work and preparation. Wanting to change the industry practice of the top tier firms is interesting and all. But if you want to get in, work and preparation will reap more rewards than complaining.
That being said, though Google has contacted me a few times for an interview, I've never gone through with it mostly because I'm not that interested. I hear from a good friend who worked there that Google is full of "algorithms walking around looking for a problem" and as much as I like programming and problem solving I hate it when its lost sight of serving a human need and I skew strongly toward the experimentalist side (https://www.cs.purdue.edu/homes/dec/essay.criticize.html) of this whole thing we do.
If Google wants to ask crazy algorithm questions, that's at least sort-of reasonable. There's at least a hypothetical chance your work will involve that knowledge.
But I've interviewed at companies who's entire tech stack is a simple CRUD web app, or a simple RESTful mobile app, who's so-called "big data" is less than a few gigabytes in total, and they still want to throw algorithms and brain teasers at me. These same companies then post some inane blog post about the "developer shortage" and how "we can't find talented people".
If these companies could actually find the candidate they're testing for -- this hypothetical hyper-intelligent developer who had a IBM-Watson-like memory of every CS algorithm and it's application in every language, that person would get completely bored working there and quit in 3 months or so. These companies could never retain the type of person their own hiring process exclusively selects for
---
Hiring doesn't need to get fixed, companies need to get honest about what they are and what they actually want. To restate this in 1-10 scale : Many companies delude themselves into believing they are a 9 or 10, and are trying exclusively to hire 10's (and hypothetical 11's that don't exist).
When in reality, most companies are in the 4 to 6 range, they only need people in the 4 to 6 range, but are rejecting 7 and 8s type candidates, because they aren't a 10.
This process itself isn't broken, so much as the businesses holding the power in the process are delusional about...everything (what they are, what they need, who could provide that, etc).
I would however disagree with your handwaving statement that 'they only need people in the 4 to 6 range'. Sometimes companies need some highly skilled types to try and rein in the chaos being creating by the 4s and 6s.
It probably isn't the "right" way for programming interviews, but once you identify the rules of the game, it behooves you to play the game accordingly, no?
Perhaps OP should try avoiding recruiters and big sexy firms.
They report having a positive interview experience but were disappointed for being passed over.
"How is this possible — I have received emails from people all over the world, who praise and give me thanks for the work I’ve done on my open-source projects and tutorials (#humblebrag)"
Perhaps there was simply another qualified candidate? OP could use a little actual humility.
I do understand OPs point that the interview process can feel disconnected from the actual work. However writing software is only part of being a software engineer. Communication / working with others is also important. This is where attitude fits in. Being a professional isn't just about wearing the right clothes/etc.
Don't mean to beat up on the OP. Perhaps they would be a great employee and are feeling a little discouraged. Still, seems like all the praise for developers (e.g. being solicited by recruiters) has gone to their head.
That seems like a reasonable interpretation, emphasized by when he got through all the programming questions without a problem, and still didn't get the job.
One thing I've found when I'm interviewing, I try to be enthusiastic and act like I really want to work at the company, even when it's a boring company. Attitude makes a huge difference.
> I do not consider myself to be an excellent programmer, maybe an average at best (who can’t even pass a single tech interview), and a GitHub commit streak has absolutely nothing to do with one’s competence, skill or ability to code...my job at Yahoo was my first and will likely be my last one. From this moment on, I would rather be unemployed and homeless rather than do another tech interview. Enough is enough. I’ve hit my limit with this broken hiring bullshit in tech. No. More. Interviews. Done.
This comes off more as a "Oooh, I have a great post idea that will pick up traction on Medium!" move than anything else, unfortunately.
vs:
> At some point during our conversation I casually mentioned Webpack 2 and tree-shaking, which was followed by a question on how would I implement a tree-shaking algorithm. How the hell would I know?
Attitude cuts both ways.
I sort-of agree that these specific tasks shouldn't be used as an indicator of programming skills, but a breadth-first-search is really quite simple. It's mode of operation is in the name, and even if you haven't implemented one in a while, you should be able to derive some valid pseudo-code after a while. Especially if you do as much coding as this person claims, and thus are confronted with problems to solve on a regular basis.
A) Has good experience
B) Has the ability to reason about problem domains even if they can't scribble out a perfect implementation with all edge cases considered on a white board in under 30 minutes.
C) Has good interpersonal skills.
For example, Lifion interviewers who wanted me to write fibonacci couldn’t tell me what the sequence definition was, they ‘taught’ me that C++ classes default visibility was protected or that REST was a protocol, they didn’t like when I said they should use a relational database if mongodb lack of multi documents atomicity was such a problem. That was so mind blowing that I started writing down on my phone all the stuff they said.
I might write an article about all that too actually.
During my interview, the interviewer asked me where I was getting my CS degree from, and I replied that I wasn't getting a CS degree — my major was chemical engineering. He was silent for a few seconds, so I'm pretty sure that wasn't the answer he was expecting.
What I remember about the interview process is that I was asked to implement some kind of odd search/sort algorithm. I remember thinking "why would I have this memorized off the top of my head when I could easily Google the best algorithm suited for the task?"
In high school, I don't think there was ever a chemistry or math exam that I didn't get a perfect score on, but I would also take much longer to finish than the other students. I frequently ran over the allotted class time and worked well into the lunch period (luckily, I had nice teachers who allowed me to do this). In college, I remember perplexing the physics professor, because I got 70s-80s on the quizzes throughout the semester, then I got a 113 on the final exam. I told him the only difference was that I was given 20 minutes for the quizzes, whereas I had 3 hours to complete the final exam. The extra time made all the difference.
So I wonder if a lot of companies are missing out when they look for 1) people who have a lot of simplistic CS algorithms memorized and 2) people who can work quickly on the spot. I may not be able to write a FizzBubbleRedBlackSort algorithm on a whiteboard in ten minutes, but give me a week and I'll have you a parallelized implementation of quantum monte carlo that runs on a hundred thousand cores.
It isn't a question of whether you can do it, it is whether you can find a 'good enough' solution in an optimal amount of time. It is testing your creativity and problem-solving abilities.
Google studied their own interview process, according to Lazlo Bock, examining tens of thousands of hiring decisions. The study concluded that their process was no better than random chance at finding good candidates. They continue with that process nevertheless.
I have a rich network of Silicon Valley connections, built over 29 years of working for Valley companies. What I hear time and again is that many highly-qualified and productive people have a terrible time finding work.
Simultaneously, Silicon Valley companies testify before congress and complain to the press that there is a serious shortage of technical hires.
If companies can't find enough good candidates, and good candidates can't find enough offers, and one of the most prosperous companies in technology, with the most famously rigorous hiring process in the industry says that their own process is bullshit, then yeah, I'd say that hiring is broken.
Of course, if you happen to be prospering, then it doesn't look broken to you. You're prospering, after all.
And of course, if some joker comes along and says that the process that hired you is broken and gives results no better than random chance, of course you aren't likely to agree. After all, if it was luck that gave you your prosperity, then luck could just as easily take it away again.
The story we like to tell is that the technical interview screens out bad candidates. It's just a story, though. Google's research says it doesn't.
Is that such a big surprise, though? How many times in my three decades in software has a product launch depended on someone being able to solve a brain teaser in front of a critical stranger? Zero. How many times has a company's success depended on someone writing the right code on a whiteboard? Zero. How many times has the bottom line depended on someone coming up with the right algorithm or data structure off the top of their head in a conversation? Zero.
Technical interviews, if they measure anything at all, measure things that don't have much to do with technical jobs. So it shouldn't be a big surprise that they don't do better than chance at predicting someone's performance.
If technical interviews don't work, why do we still use them? Why does Google still use a hiring process that its own research says is bullshit?
Maybe it's because we don't have anything better.
I think it's because on some level we realize that we don't actually know how to distinguish good candidates from bad ones, but we don't want to admit it to ourselves. We want to think that we can pick the right candidate, because it can be so costly if we don't.
So we ritualize the process. We rely on a bullshit hazing ritual. We wave a dead chicken over it and tell ourselves that we are screening out bad candidates and hiring only the best.
Only we're not. If we were, then maybe companies would still have a hard time finding enough candidates, or maybe good candidates would still have a hard time finding jobs, but not both at the same time. And the company with the most 'rigorous' hiring process in the industry wouldn't be concluding that their own process is nonsense.
Yeah. It's broken.
Once I found a company that actually _needed_ me, the experience became a positive one - they went out of my way to make me feel comfortable.
I wish there were a way for candidates to pre-screen companies, rather than the other way around. It's a waste of time on both parties if the company isn't actually in need of a new hire, but just dabbling in the option pool.
To each their own on their personal time, but you can't seriously expect that being associated with a stigmatized hobby is going to gain you anything.
There are three attributes you need to select for to identify performing employees in intellectual fields.
- General mental ability (Are they generally smart)
- Work sample test. NOT HAZING! As close as possible to the actual work they'd be doing.
- Integrity (The first two won't matter if the candidate is a sociopath).
This alone will get you > 65% hit rate. [1]
http://mavweb.mnsu.edu/howard/Schmidt%20and%20Hunter%201998%...Hell one of these companies should hire me to do data driven recruiting.
Every employer I've worked for has made the experience farcical. If not at the start, then over time. You interview for one job, and eventually end up doing something else.
A full time career that doesn't pay enough to buy a home. And they say software developers are overpaid.
I think the end-game for me is to just go camping with a laptop or something. I'll code for fun, rather than trying to meet this 'market demand' which provides people with studio apartments, temporarily, in exchange for ~all of their productive hours.
LOL yeah, that's what happened to me for my last job. A recruiting process that lasted 4 bloody months for an electronic designer position, and when I was finally hired they put me on software testing; not only I had never done this, but I had never heard it was a thing. Anyway, after less than 2 months I was better as this than the CS graduates who had been doing it for several years and they were asking me for help in their work.
But now I have been unemployed for 2.5 years, I made it to the interview stage only once during that time, and I have given up on even just applying to any job offer for the last 5 months because it is absolutely pointless and humiliating to be repeatedly discarded by people who are clueless, who don't give a flying fuck about the persons they "harvest" and lack the basic respect in social interactions (like spending 2 minutes of their precious time answering a question, not blatantly lying, doing what they said they'd do, or even just showing up at the very appointment themselves fixed!).
So yes, in a way, I've quitted and I am getting ready to become a street beggar when all savings are gone. In the blogger case, his situation is too fresh, I don't think his mood of the day will last long for this time (and after all, he got plenty of interviews, at least), but I am really really tired of these completely nonsensical recruiting processes and their humiliating consequences.
As for "eventually end up doing something else" isn't that career development? We can't bemoan having non-technical senior managers if some developers don't go on to do that.
The average salary for a "software developer" job posting in my city (Charlotte, NC) is $101k. The average income in Charlotte is $53k. The median home value is $167k. 60% of the value of a home in a year is pretty good.
I've also lived in Sydney, Mannheim, San Francisco, and Seattle, and I noticed similar economics in each of these places (where the salary of software developers tended to be quite high relative to the average income). Do you perhaps live somewhere with a very different trend?
Sources:
- http://www.indeed.com/salary?q1=software+developer&l1=charlo...
- http://www.bestplaces.net/economy/city/north_carolina/charlo...
If you knew the correct answer to e.g. the BFS algorithm, you'll get thrown another question that they hope you don't know.
When interviewing, the thing I want to see most is how someone works through a problem: can they solve from first principles? do they go via trial and error? do they ask for a computer to google things up/a book?
Picking raw CS problems is an easy option, as its something that you should be able to solve, and it means I don't have to require you to know Angular/React/Flavour of the month (new tools are easy to teach the right candidate).
You're not going to immediately know the answer to everything that comes up in your job; so evaluating how you solve the unfamiliar is very important.
It absolutely includes talking to people. But not people you don't know, in a very high stress situation, under the pressure to solve the problem in thirty minutes :)
That is sometimes required, definitely. But I'd say that situation only applies to the .01% of real-life programming situations.
Almost all are simply playing "programming trivia." They name an algorithm or a data structure, and then evaluate whether you can recite it from memory. That's it. There is no problem-solving element involved. It is purely a test of whether you can memorize and recite.
This requires a lot less effort on the part of the interviewer than the style you describe, and also bolsters their ego and makes them feel clever when they find a candidate who can't recite properly.
Seriously there's a job with your name on it if you're interested.
When I interview candidates I sit with them for half an hour or so to get to know them. Then I give them purposely broken, poorly written piece of code which I tell them to pull apart. This proves incredibly effective as even if they miss some of the more obvious errors I can at least point them in that area and then see if they can see the problem on their own. There are about 100 different things to talk about so it really gives me an idea of the level they are at, and also the type of programmer they are; passionate, lazy, smart, meticulous, inexperienced, confident etc. Then if I feel they are worth a second interview, I get them back to sit with me and my team for the day to see how they fit in with the team. Then all being well I offer the job.
But seriously, I do the same thing. Have them look over some broken code for 10 minutes to collect their thoughts then have a discussion about the issues they found and various tangent topics relating to it. I'm amazed how uncommon this is.
But do you think this is easier to do if you get less candidates (looking at your location, I am assuming you only get a small fraction of candidates than if you were located in, say, London) ?
I've never had a web-app that failed due to performance. I can't recall any that ever have, except Facebooks' attempt to use HTML on mobile.
UI performance has little to do with algorithms, and only occasionally requires opening the profiler to hit 60fps with some tweaks to bone-headed nested loops. Or maybe reconsider your use of Angular!
Front-end apps fail because long-lived mutable state is a powerful engine of complexity, and algorithms do not solve complexity. I am constantly telling my team (CS back-enders prepare yourself!) to ignore performance concerns. O-whatever has zero-impact on delivering simple, extensible, bug-free web apps that please its users.
But admittedly, crafting good software isn't as objectively clear as implementing a mathematical function that makes your server code perform. The proliferation of front-end frameworks and compile-to-js languages indicates that writing FE software that works remains a far greater challenge than writing FE software that hums.
To that point, maintaining a popular github repo for a library or app that demonstrates your ability to write, maintain, and extend FE software is still the best sign that you know what you're doing, and that you like what you're doing. Conversely, knowing a lot of algorithms as a FE candidate tells me nothing about whether your first PR will be your last.
On a happy note, Netflix didn't ask me a single question regarding algorithms! Their interview's focus on OOP made sense, even if it didn't fit with my own focus on ClojureScript and FP.
That said, it's perverse that there's a cottage industry around software engineering interview training on both sides of the table for the crazy questions that are being asked. No one wants this, but sadly, once you're in the door at these places that do these sorts of interviews, the motivation to affect change approaches zero.
There are some companies that have tried to make this a fairer assessment though, e.g. Foursquare http://engineering.foursquare.com/2016/04/04/improving-our-e.... Putting this sort of effort into an interview process is time-consuming, but if the software industry is going to make its interview practices assess candidates more fairly, it's going to take effort.
I don't object to an employer wanting to see a background in data structures and algorithms, sql, binary, and a few branches of math. This is why I agree that hiring is broken but also understand that it isn't easy to fix.
Some of it stems from something very wonderful about our profession - we are flexible about how people can acquire this background. In law, you must do a 3 year JD[1], and you must typically pay way over 100k for it. Alternate paths toward learning this material are pretty much illegal (as in, we'll put you in jail if you try to practice law if you haven't done the 3-year degree, regardless of your master of the material).
For instance, I was a math major, and I only took a bit of formal CS. However, when I did self-study to try to plug some of these gaps (partially for interviews, partially for my own education), I was surprised with how much I actually had covered from a different angle. Many of my math (and later, in grad school, Industrial Engineering) professors ran "labs", some for a bit of extra credit, others as an optional set of assignments. I took graph theory through a math department and stuck around in the lab and so forth to implement some of the algorithms, to learn about how some types of proofs actually contain an algorithm. BFS, DFS, minimum spanning set. That all involved building trees, lists, using pointers. In numerical analysis, I did a lot of matrix algebra manipulations. And so on. If CS were run like law, it would be illegal for someone like me to work as a programmer, because my degree isn't an ABET accredited CS degree.
The downside to all of this, though, is that there is no recognized credential. I don't object to being taken through my paces, I object to how random, capricious, and redundant the process has become. I read a blog article about a programmer who took the bar and studied for 100 hours and passed. Think on that for a second and compare it to the amount of time people spend preparing for and taking what are essentially white board exams in technical interviews. The bar, an exam that is considered one of the most brutal rites of passage for a learned profession? In some ways, we go through that every time we do a new round of interviews when we change jobs!
Actuaries have to show understanding of relatively advanced math, but senior actuaries don't (to my knowledge) get grilled on integration by parts or some specialized set of partial differential equations when they interview. Why? Because there is a proper exam for their field (and unlike law, actuaries are free to obtain this background through multiple educational paths, they often major in math, but hardly always).
Another problem is the capriciousness of the tech exam/interviews. I believe that a "bill of rights" so to speak slowly evolved between examinee and governing board over time in true professions. The nursing and medical boards, the actuarial exams, the bar - these fields have a tough exam (or series of exams), but they are consistent, there is a clear study path, there is a commitment to grade them fairly, there is a clear study path, if you fail, you get feedback or at least a score (the bar doesn't write you back and say they "decided not to pursue your candidacy further at this time"), there is often a second (or additional) change at the exam, and, most importantly, when you pass you get a lasting, public credential respected by your peers in the field.
People often describe these exams as the most brutal, anxiety ridden, stressful events of their professional lives. This is why, I believe, they slowly evolved that "bill or rights" that protects the examinee.
Unfortunately, in tech, I believe we experience these exams over and over, but without any of those benefits.
I am a-ok with requiring people to show competence, but the way we go about it is, I think, badly broken. I believe that this process accounts for a great deal of attrition in the field, as well as people deciding not to enter the field in the first place.
[1] yes, a bit of handwaving, it's not quite that simple in some states.
Coding contest skills are very unfair to senior developers because they are out of school long time and do not have the time or motivation to engage in coding competition. And this also creates different incentive models. I have seen people who flunked very elementary CS courses (OS, networking etc.) to spend more time coding competition to get hired in big companies. This is really weird because they have to learn these things to become a real developer and they are gonna learn these things in company's time which they should know already. That being said, I personally think, problems like maze solving and inverting binary tree are fair questions. These are not exotic DP problems, these are just simple problems.
OTOH, the whole years of experience thing is unfair for new developers who do not have the experience but smart enough to learn and outperform many developers with experience who just memorized APIs over years of experience. There must be a healthy compromise between these two types of hiring.
Developers like to think they're on top of their game straight out of school and are able to design and develop 100k LOC apps off the bat. They could use a healthy dose of humility, because those that can are few and far in between.
The sorrier reality is that most of them spend their first couple of years learning how to work in a team, and then next 5-15 years picking up good habits and design patterns, and subsequently learning to not systematically use them once they know better. (I can't say first hand what comes after, but I would imagine yet more of the same.)
Yes, if you need such a thing and it's not immediately obvious how to do it, off to StackOverflow you go to find some example code, but these are basic "do you understand fundamental data structure / control flow" type questions. It's not like they're asking you to implement a theorem prover or something.
The "Technical" part was just trivia. Never-mind that I was sat in front of a computer and could have googled everything asked, I chose not to do that.
So yes, I stumbled when asked "what does the using keyword do". I explained how it relates to IDisposable, disposeing the object at the end of the block scope and avoids needing try/finally blocks.
But clearly that wasn't the script, because they kept asking "Are you sure it doesn't do anything else? Are you sure isn't used anywhere else?".
Eventually I realised they were talking about "using System.Linq" etc, and all they wanted to hear was the word "namespaces".
Talk about interviewing by numbers, had I wanted to I could have googled every question and given them perfect descriptions.
What could they possibly have learned from that interaction? I learned I didn't want to work there, so it helped me I guess.
But I find implementation things more helpful (in person, not by phone!), because it's not about whipping out the right answer, it's about watching how the candidate thinks and approaches problems. It's about how they work not the end result.
I like the "write a function to multiply" because it can be extended to any level. If someone aces the positive numbers case you point out negative numbers, if they ace that you can talk about efficiency, or bounds checks, exception handling, efficiency or whatever else you think they'd like to talk about.
I just googled it. Oh, I know what it is now.
If you haven't been exposed to it, it's just jargon. That's the point. You are testing for jargon rather than ability.
It is the distinction between saying 'implement FizzBuzz' and going silent, and actually explaining what it is. As an interviewer it is easy to forget that whilst you may have asked a question 20 times, this may be the candidate's first encounter with your terminology.
Steelmanning as applied to interviews, basically.
Oh, you think you're a front-end dev and will never need to do anything else? What happened to striving for growth (personal and professional)? Why not learn how to write a BFS instead of writing a rant about your pride in not knowing it? Are you really just proud of doing your one thing, doing it well, and have no interest in ever branching out? If so, it is not surprise nobody will hire you (who needs a single-use tool?). If not, then also no surprise as you've shown a complete lack of desire to learn (who needs an inflexible employee?).
I am further sorry to tell you that your github history is irrelevant. I've seen _my_ code on github under 10 names. None of them mine. I'd never trust anyone's github profile - no reason to believe they wrote the code, they did it themselves, and how many attemtps of guess-and-check they needed (or not). You know what I do trust? Your ability to prove your "skills", in person, under realistic pressure, on demand, and on a schedule. You know, by solving a problem perhaps a bit out of your comfort zone. Maybe a simple maze?
And if you're hiring a front-end pay him as such. If you want him to know more than front-end beforehand, pay him extra.
Which is absolutely OK. If that's what you're going to do - regardless whether it's sensible or not - then potential candidates can either ignore your ad, and save everyone's time, or apply to you knowing what to expect. If a large enough number of desirable companies do this a candidate might decide to brush up on CS 101 and interview practice.
That's honest and courteous, instead of ambushing candidates in the interview stage - when they've taken a precious vacation day and taken the time flying out to see you. And it saves you time - any candidate you get should know what to expect.
I as a developer can't understand why anyone skilled wants to be employed.
I was employed for about 7 years and now I'm a freelancer. I don't have to discuss with my customers that I want to work from home, I just do it. I get more money than before, I spend less for health insurance and taxes, I start working when I want and not when some manager wants me in the office. And job security seems a bit odd considering that everyone is searching for devs and the demand seems to increase every year.
And the best thing is, I don't need to do dumb interviews anymore. When I freelance people just ask me for solutions and give me money for them. When I look for employment for doing exact the same stuff I do as a freelancer, suddenly they want to know the weirdest stuff and ask me to do dumb tests.
I'm mostly scared of the lack of a "guaranteed" salary. I'm a consultant for IBM Watson. My skills are in demand. I could probably go on my own for about $150 an hour; work less and make more. I'm afraid to take that leap though. I have a family I'm responsible for and live paycheck to paycheck now.
I also have similar experience in my job search but I attribute it mostly to me just being a failure at interviews.
Not being able to do write a basic BFS algorithm suggests a) you didn't do any interview prep and b) whatever you've been working on hasn't involved any non-trivial algorithms.
It doesn't mean you're a bad programmer but if you can't answer a basic BFS algorithms question I wouldn't trust you to touch code with any non-trivial algorithms in it.
My immediate thought is that if I have to implement a breadth-first search from scratch it probably means that I or someone has made a terrible mistake someplace.
Also, I'd want more information. Am I just getting some values then doing some recursion? How large is the maze? The stack? Are these spherical frictionless chickens or do I need to worry about real-world constraints?
Or for someone else's mention of the Nth from last item in a linked list, my first questions would be "Do I know the length?", "Is this going to need to be repeated?" and possibly "Do I have enough RAM available to create a ring buffer of N addresses?"
I'd been writing lots of mathematically intensive code for building and solving large scale linear programs for about a year, and I interviewed at a job that was doing lots of math-ish business analysis. Code would certainly be written.
I was incredibly busy, and mainly spent my interview prep on math I thought would be relevant, though I really didn't adequately prep for the interview.
One of my interview questions involved some simple (really, I must be honest there, it was simple) recursive tree traversal. I blew it, and I'm pretty sure this is why they didn't hire me.
Six months later, I had to use quite a bit of tree traversal to model a series of conditions that had to occur in several possible patterns for a manufacturing system. Because there were various combinations of events that would "pass", I used trees to model the system, and I needed to recursively determine, in the event that the system didn't pass, what possible paths (including the least cost path) existed to bring the system into compliance.
I picked up my old reference books, reviewed for a couple days, and started writing code. As I did this, I started to feeling kind of embarrassed about the questions I had failed, since I was now reminded of how basic they actually were. I was chatting with a coworker about it and mentioned the interview, and told him that I could see why they didn't want to hire me.
He's my buddy, so he tends to say nice things, but he said (paraphrasing from memory): "but wait, doesn't that prove the opposite? The moment you needed to do tree traversal, you knew exactly where to go look. You know about these algorithms, you've done them and taken exams on them in the past, you just don't walk around ready to implement these algorithms on the spot."
So ok, BFS is so basic that I'll probably never forget how to to it again. But right now, this moment? I'd have to reason back through it. To get really sharp (especially since I won't know the questions in advance), yeah, I'd have to hit the books for a while.
Just how many times do I need to re-take my Data Structures and Algorithms midterm?
If you ask and your interviewer gets glassy-eyed or gives you the laughably generic "it shows how well you think algorithmically" you know that you are being interviewed by someone who has little clue what they are doing. It is a great way, from your side of the table, to understand if your time is being wasted right out of the gate.
1: http://blog.benroux.me/4-steps-to-making-your-interview-suck...
The only way to really see how someone thinks is to just hire them, work with them for a while, and fire them if they can't do the job. You can either pay the costs of hiring and firing (like on-boarding, benefits, administration, severance) and get useful signal about their performance, or you can spend the same money by throwing it away on useless shit like HackerRank-style trivia tests. Per applicant, the HackerRank thing seems cheaper, but you typically have to spam it across many more applicants, endure losses due to great candidates who won't agree to your bullshit hiring process, and still end up firing people sometimes when they pass the trivia but (surprise) it didn't mean they would be good at the job. So overall, it's just as expensive.
You spend the money either way, might as well get useful signal out of it.
The first thing that jumped out was that you are trying to fit programmers into a bell curve, when they're really distributed by the power law, see: http://blog.benroux.me/4-steps-to-making-your-interview-suck... That was kind of a side piece to your blog, though.
Secondly I wanted to give you some ideas I've had on a similar topic, just to throw them out there:
Apple has a three-step interview process that I found interesting. First they ask a question about a language (your choice in language) to see that you know at least one language well. Then they ask a question about an algorithm, then they ask a design question (how would you design a chess game? What classes would you use?)
Another thing I've found is that programming skill is the low bar. It's important, but what you really want in a candidate is someone who can self-manage, who knows how to get things done. Can I assign this person a task, and they will be able to finish it on time (or let me know as soon as they realize it will be late)?
So in an interview, I ask questions to figure out if the person can get the computer to do what he wants. Then I try to figure out if he's a good self-manager. Unfortunately I haven't figured out a way to determine that in an interview, but I'm still working on it :)
That seems like a pretty quick way to end an interview. Although if they are asking dumb questions, they probably won't be a huge loss.
I kind of get what you're saying but it could easily be construed as openly challenging the interviewer. And I'm sure some small set of interviewers could appreciate something like that. But I'm willing to bet most people would find that to be an uncomfortable position to be in.
I have actually noticed that most tech companies(at least they ones I've had to deal with, namely Facebook, Google, Amazon, and Microsoft) are doing all they can to take the guess work out of interviews with training sessions, resources, etc...
All the OP needs is to change his attitude from cynical to optimistic and I promise, things will change for him.
Also, BFS (and DFS) are as basic as you can get with algorithms. Either of them is not longer than 10 lines of codes; just remember that BFS uses a Queue and DFS a Stack...
"You are in front of PC/Mac/Mobile screen, type www.cnn.com into browser, and press enter. A fraction of a second images show up on the screen... How? What happened? Tell me all you can from key press interrupts to underwater fiber cables".
This question never failed me. It always shows how deep does one go in their computer science adventures.
Are you serious? This is your one interview question? Do you realize this is the kind of thing the Sahat was writing against?
Instead of actually asking them about their relevant skills, experience, and capability you think it's fit to judge a candidate on what amounts to curious information on how a computer works.
Is that what you're hiring for? Someone who's spent more time reading wikipedia articles than actually coding? We're in the business of creating things, not harvesting trivia.
Yes it doesn't matter if someone's written and maintained code, documentation, tests, and has collaborated with dozens of other individuals for a repository used by thousands. All you need is to do is ask him your pet trivia question.
It always shows how deep does one go in their computer science adventures.
Knowing about the adventure of one electric signal from keyboard to underwater fiber cable has nothing to do with computer science. By your own words, you're testing for the completely wrong thing.
I am a VP at a medium size company and I do plenty of interviews
Here's a secret then. The candidate, whoever he or she is, will always try to answer your question. In fact, they'll try to satisfy whatever problem you put them up to.
"What's your favorite method of tying shoelaces?"
"How many golf balls can you fit between the earth and the moon?"
"What do you do for fun?"
The candidate will take their time and rack their brains trying to provide an answer to please you.
Some will give a good answer and some will give a bad one, but that doesn't mean your interview question is a good one.
"Let's see, I guess the wifi radio is going to have to do an RSSI measurement..."
It actually gave me goosebumps when I realized that I was so caught up in it and how excited I was getting.
Many companies require this as a first step, before even talking to the candidate.
Apart from the problems being totally unlike what your future work will be like, the time constraint proves .. what ? That a candidate can "think fast" ?
What about code quality, architecture, design patterns, build systems, concurrency, etc ?
Here's what I've decided to do when they reply with a coding interview task:
I charge my clients 50 EUR an hour. If you want me to spend 3 hours on a coding interview as proof that I can code, then I'll expect you to pay me 150 EUR as proof that you can pay.
I think this is fair. Otherwise, I'm going to knock on someone else's door, were I can talk programming with an actual person, share "war stories" and get excited about building something cool together.
Instead of standing there with nothing its better to be straight up and just say "No idea mate" and then name reasons why that is but how you'd solve it in a normal situation. It is a lot about human psychology, showing them that they want/need you, not vice versa.
Sometimes all it takes is balls and a good amount of "I don't give a fuck" attitude.
I wouldn't let anyone treat me like Sahat got treated.
But luckily I'm usually in the hiring manager's chair these days and my interviews aren't easy but they're not a stupid game.
God, happened to me this year, highlights:
- "Do you like to wear a tie to work?"
(perhaps because I'm 40-ish)
- "Tell us about your worst boss."
(from three guys with frowns and folded arms)
- "Do/talk through this sorting problem on the whiteboard/webpage..."
(With people watching, clock ticking over $100k in suitcase, gun to head)
I gave up as well, am now writing a book on software, unsure it will sell.This is an absolutely awful way to interview. However, the author should learn some patience & attack the problem. You deal with the cards you're given - it took me 2 1/2 years of applying to jobs before I lucked into get a job in the tech industry after grad school, and lots of wtfs in many interviews after I entered tech. Learning how to take it on the chin and keep going is an important skill for success - he could learn something from sales in that respect.
My one piece of advice: read Nick Corcodilos's Reinventing the Interview:
http://www.amazon.com/Ask-Headhunter-Reinventing-Interview-W...
The basic idea is demonstrate you can provide value to the company, and you have the skills to do the job. If you're stuck with a disinterested interviewer asking irrelevant questions, make it about the job you'll do and your ability to succeed in the job. He has concrete suggestions. I say, if they're not open to that and it is clearly not working, tell them you it is not going to work out and stop the interview rather than enduring another miserable experience.
I almost want to joke that it's Sahat should have done a bootcamp, since that seems to have been Haseeb's advantage; he learned everything about CS very recently and freshly, in an environment where he would be absorbing material that's tech interview fodder. Coupled with Haseeb's intelligence and quickness in absorbing said material, he must have impressed his interviewers. Whereas, an experienced developer like Sahat is worse off- ironically, by not being new to the field, he lacked the advantage of seeing like a fast learner. It's almost like ageism but specific to how long one has been programming.
And on the subject of hacker bootcamps- I've heard a lot of them not only teach programming, but how to optimize one's interviewing skills. If bootcamp graduates are doing well because of that, does that mean there should be bootcamps for experienced devs who want to switch jobs, just so they can ace interview questions? And is that really what this industry has come to? Memorizing algorithms and strategies for passing data structure logic puzzles in cram schools just to get a job?
Sometimes the questions aren't even related to data structures or algorithms. I'm OK with those because at least you can somewhat prepare for them. I've once had an interviewer ask me obscure questions about Netscape 6 (this was 2016 btw).
> I much prefer “homework” projects, even if they involve me working “for free”, because I feel like they ask for actual programming skills rather than the “guess the algorithm” lottery of phone screens and whiteboard coding.
Me too but when you're interviewing with 3+ companies at the same time while working at your current job, it gets difficult. There was one time where I had spend my Saturday afternoon maybe 6-8 hours completing their "homework" project. I got a call back from them a few days later for a follow up interview and they flat out didn't even bother to ask about the project I had completed for them. What was the point?
Tech interviews suck.
It's worse when they give you an easy project that takes you ~30 hrs to complete, they state it "doesn't have to be finished," then disqualify you because "why didn't you use a graph database for this problem?"
Oh well. Same company was using Mongo+Node on a new startup from when they were still in year one. Wish them the best..
Vimeo, Facebook, Google, ... they hire elitists and those design the interviews. And honestly I doubt their work is at the end of the day more efficient then that of most other "regular" companies.
Sure, BFS is 'easy' but it's not really something that stays fresh in your memory after years of not having to use it.
I completely agree with his point that it if you have to study for an interview, the process is broken.
OTOH, I totally agree with the conclusion of the article: long interviews of technically complicated stuff is just BS. The last time I had to do this, I started refusing to answer questions after about two hours.
Well, OK, throw in a sociability / not-a-psycho score using LinkedIn or twitter or whatever.
I'd outsource this to gild.com who seem to know what they're doing.
Methinks management will be surprised at how well these 10% do despite not passing the usual "What happens when I flip all the color bits in a red-black tree" or whatever shibboleth is being used these days. Admit it : most work, even at Google, doesn't involve knowing how self-balancing trees work. On the other hand, getting things done matters everywhere.
Everybody can't work for Google, and there may be some that could work for Google if they were better at interviewing the way Google does (and these other companies do).
The author harbors some hostility towards the recruiters that have landed him these interviews. I'm a recruiter, and I too harbor some hostility towards recruiters when they behave badly.
The recruiters in all of these situations seem to have done the author a service, and there are no explanations of the recruiters behaving badly (other than the going silent/no feedback scenario).
Telling recruiters to "F* OFF" is just blaming the messenger. They didn't design the interviews, they didn't conduct the technical interviews being complained about, and they didn't make the decision not to hire. They simply facilitated the process and relayed the message.
Blame recruiters when they behave badly. Lying about salary ranges, 'bait and switch' jobs, etc. Don't blame them when they do their jobs, just because you didn't like the outcome.
I guess I'll go back to building my own projects, because none of this sounds enjoyable.
Dev jobs outside of that little bubble tend to have very different interview techniques.
It is definitely a broken process in many companies.
My recommendation is to apply to smaller, lesser known companies. Much much less bullshit and time wasting. There are enough jobs out there that you don't have to deal with this bullshit.
Time spent on learning extraneous knowledge solely for the purpose of passing interviews for jobs that don't actually utilize such knowledge is a massive waste of society's resources.
There is a school of thought, baffling to me, that suggests that knowledge is mere rote memorization of facts, so the best way to test people in anything is to check their memorization of the relevant material. This interviewing style derives from that school of thought.
This is, of course, utter bullshit, especially given that the details of the topics chosen are almost entirely irrelevant to the actual job of a software engineer. A working programmer who re-implements a red-black tree from scratch is almost always doing it wrong. Someone has already built that and debugged it and optimized it, and you should be using that implementation, not redoing it from scratch yourself. The "programming trivia" interview style is like interviewing an architect by handing them some iron ore and asking them to smelt high grade steel out of it. That's not what architects do. They buy premade steel smelted by experts, then use it to build other things.
The solution? Real-world programming as an interview. Either give them a toy problem, or pay them to do some minor bit of actual work on your system for a day or two, if that is feasible. Then get out of their way. Give them a laptop and the Internet, leave them alone for a few hours, and see what they can do.
Afterwards, do a code review. Then discuss their programming and engineering philosophy.
Why don't people do this? It takes a lot longer, and requires the interviewer to think more. It's much less cognitive load for the interviewer to memorize some obscure data structures and ask candidates to recite their construction.
And that's not even going into the salary/H1B issue, the problem is much deeper than that.
- I was an advocate at first, but take home exercises are pretty much useless. Because they at best won't fail you. And of course you could have written a new sorting algorithm that works on O(n) but what you'll get back is a complaint about coding style
- Having a github might be nice but as the article says it seems to be also in the category "won't fail you". It seems to barely matter
- And of course companies like Google ignore everything and make a test out of your interview, fail/pass grade, period.
People are probably missing an empathy component or working outside of the "SV tech clique" where if you don't code for 12h per day and doesn't know all libraries and algorithms by heart you're not even considered
So just who the hell is passing these inquisitions? What's really necessary?
It worked. He's working at a top company for several times his former salary, he had several competing offers with HUGE bonuses and equity offers.
However, I don't know if I have the commitment to do that, and I'm not sure if everyone SHOULD have to do that.
I think it comes from a decade of experience of being asked to jump through increasingly ridiculous hoop sizes over time, and complicity cooperating with this nonsense system in an otherwise analytical logical calling.
The challenge is finding these. Careful filtering can help, but it seems to be largely a numbers game.
This becomes increasingly difficult, as more companies are infected with these faddish processes every day.
And there's a cost, of time and money and contentment. To help reduce this, consider spending increasingly less time on opportunities you deem unlikely to work out, based on past experience.
I often prequalify jobs--sometimes companies respond, sometimes not, but that also provides me with useful information.
Once you bring someone in for an interview, you owe them a phone call, with email as a backup.
I was rejected twice by a large company, which both had a much saner interview process (take-home excercises and much better in-person interviews), and I still think very highly of it (and I know the people that did get in and they were indeed very good).
I'm 100% self taught, having never set foot in a CS classroom, and this is what I do for every interview process: 1. Find everything you can about company and their interview style; 2. skim over Algorithms in a Nutshell; 3. Take an hour to refresh Big O notation; 4. Read up on "best practices" for the technologies the company uses.
Finally, after the interview always follow up -- say something nice and memorable, be humble and express interest in learning their technology stack _before_ your first day on the job.
I find it takes 2-3 company's before I hit my "interviewing stride".
I wonder if just writing a brute-force maze solver, and then explaining that you are aware better solutions exist...but that you didn't have any memorized, would have sufficed.
Point out that in a real life scenario you wouldn't do this because it is so more efficient to use the work of others, but then solve the problem so they can measure your problem solving skills.
A recursive implementation of depth-first search should only take ten minutes to write. OK, here, I'll do it without looking anything up. Start time 8:55pm.
#include <stdio.h>
#include <memory.h>
const int WIDTH = 32; // adjust to suit
const int HEIGHT = 32; // adjust to suit
const bool WALLS[WIDTH][HEIGHT] = {
// enter maze layout here, true = wall
// this isn't a test of file IO knowledge
// make sure the outer perimeter of the maze is
// fully closed with walls
};
const int START_X = 16; // adjust to suit
const int START_Y = 16; // adjust to suit
const int GOAL_X = 16; // adjust to suit
const int GOAL_Y = 16; // adjust to suit
bool search_maze(bool **searched, int cur_x, int cur_y,
int start_x, int start_y) {
const int DIRS = 4;
const int DIR_X = { -1, 0, 1, 0 };
const int DIR_Y = { 0, 1, 0, -1 };
searched[cur_x][cur_y] = true;
for (int i=0; i<DIRS; i++) {
int new_x = cur_x + DIR_X[i];
int new_y = cur_y + DIR_Y[i];
if (WALLS[new_x][new_y])
continue;
// if moving in this direction lands us on the start
// point, or searching starting here returns true,
// then we're done and our current pos is on the path
if ((new_x == start_x && new_y == start_y) ||
(!searched[new_x][new_y] && search_maze(
searched, new_x, new_y, start_x, start_y)) {
printf("Go to %d, %d\n", new_x, new_y);
return true;
}
}
return false;
}
int main(int argc, char **argv) {
bool searched[WIDTH][HEIGHT];
memset(searched, 0, sizeof(searched));
printf("Starting at %d, %d\n", START_X, START_Y);
search_maze(searched, GOAL_X, GOAL_Y, START_X, START_Y);
printf("Goal at %d, %d\n", GOAL_X, GOAL_Y);
return 0;
}
End time 9:12pm. So 17 minutes (what's that rule about estimating software dev time?), and I haven't run and tested it yet, but it should show what the interviewer wants.Is this Hacker News or Script-Kiddie News?
If you are a company and have to select between two front-end developers where one has a vast portfolio of production apps that you find impressive and the other knows BFS by heart (but has never shipped something to production), who would you choose?
They treat you like hobo that came to their kingdom begging for a cookie.
They are the kings and queens and you are nothing just a pathetic beggar.
It's really exhausting and painful to go through it again and again especially when you know that most of the companies are just wannabe hipsters or the same corporate hellholes.
They pretend they are on the same level as Rob Pike and alike but what most of the people do is they write shitty code, shitty UI and shitty everything.
Google is definitely worse they cannot really make a compelling product that would DIRECTLY earn them money .It's all about ADS.
A typical adult has the spare time to study 3-5 algorithms prior to an upcoming interview, and the algorithm question lottery has room for several hundred.
This means that the practice of trying to stump them with algorithm questions provides a strong benefit to hiring managers: can this candidate read my mind even before I've decided what it is I will ask of him?
They're selecting for psychic powers and do-what-I-want-ness. Which is what most management in the United States (elsewhere probably, but I'm an uncultured redneck type... wouldn't know) values.
Gives you an intuition of the proper way to implement something before you know the big picture.
This isn't what interviews are testing: they are testing if you can implement the algo. That is rarely important.
The two job offers I did end up getting went something like this:
1. "Show me a project you worked on. Tell us about it. Tell us about future features. Okay, implement one of those features right now."
2. approaching me after an event I spoke at "Hey, are you by chance looking for a job? We'd love to have you with us." at "interview" "tell me about your past experience, some projects you worked on, and how you learn new things."
I feel like both of these "interviews" tackle two very important things as a software engineer--can you use what you currently know to add a new feature? And if you don't currently know it, do you know how to find it out?
I didn't know a lick about React, SVG, animation, databases, lodash, es6, or trees, before I started working at my current job. But because they were able to see how quickly I could learn new things, I started as a contractor (to "test the waters" so to speak) and impressed them by proving them right.
And I think that's exactly what companies should strive for--hiring people who can pick things up quickly. Of course, consulting firms may not have this luxury, because they need to deliver now now now, but for SaaS companies, I don't see why this method wouldn't work.
Some areas of programming will require specialized math knowledge of course i.e. basic linear algebra for general game programming, and various algorithms depending on your specialty. But in any programming field you will almost never be expected to research new algorithms from scratch - this is the job of scientists - and your job is just to implement those, and know enough to choose the right one for the job.
This is just a long winded way of saying, I think a lot of HR departments need to clear up for themselves what it is they are trying to recruit. If they want people researching, you are going to need the algorithm/math/physics chops inside and out, but if you are building 98% of the not so super theoretically revolutionary products out there in the world, you really just want to hire people who know how to pick the right tool and then use it i.e. code with it. And to know how to pick the right tool, you do not need a PHD in CS.
HOWEVER. One candidate had a PhD and was very agreeable, had lots of experience in other companies in our field. So I skipped the programming test, since I figured a PhD with loads of experience must be able to code...
A colleague of mine saw the candidate as they were leaving and ducked. I asked them why. "Well, I personally lead to them getting fired a few jobs ago." Turns out Colleague worked very closely with Candidate and Candidate can't code worth shit: Colleague ended up personally redoing a ton of Candidate's botched work, Boss noticed Colleague working way late for no good reason, and after several chances, had to let Candidate go since they couldn't do their job.
Anyway, I've come to the conclusion that I need to ask in-depth technical problems, but I'll phrase it like this: "I'd like you to describe an A* path-finding algorithm the best way you can (pseudocode, diagrams, assembly, whatever). I'm not looking for a 'correct' answer, or syntax or class diagrams. I want to watch how you solve problems of which you only have a vague knowledge. If you'd like to refer to some resource, feel free to ask, and I'll tell you if I know, or I'll find out."
I suspect this is the point of the technical question, but it's hard to tell what interviewers actually want.
Now, about the real problem -- It has to be solved by both the parties, for instance, somewhere in the middle of the article the author mentions he was asked to write the BFS algorithm. In this particular scenario, the interviewers should NOT expect the candidate to actually remember the algorithm and write the solution right away like a bot (or a human who has used it very recently) would. Here the interviewers can be more humble, more human. They should check whether the candidate holds the problem solving skills which is what is essential and NOT whether the candidate has a computer-memory. Here, they could explain what BFS is, how it works, and then give the candidate some time to come up with a solution.
Again, interviewers shouldn't expect a correct solution for the problem, it's the attitude of the candidate towards the problem, and the way he/she thinks about it -- that should be enough to give some idea about the skills he/she holds for problem solving.
The idea is simple. Don't just drop some Dothraki (or some language the candidate does not know) algorithm names, and ask what it is instead, skip the names, explain the problem in simple words and ask for solutions.
> it has been a long time
> I vaguely remember
> this would have been a trivial problem to solve from memory, but that’s besides the point
> Do I remember how to implement those algorithms? No
> I am not a recent college graduate anymore who has breadth-first search memorized
> I haven’t implemented BFS in years, there is no way I can come up with a solution right here and now
> If, and when [...] I will go look it up
I normally wouldn't point it out since it sounds really condescending, but after https://news.ycombinator.com/item?id=11554894 I don't know what to assume anymore:
They don't want you to remember or memorize solutions, they want you to be able to implement it given just an informally explained approach (which you may also be responsible for coming up with).
Converting ideas into code without having seen the code before is a realistic, desirable and not at all uncommon skill.
I don't think it's unreasonable to expect a candidate to be able to write code given the description "These objects have a value and links to similar objects. We want to find a certain value by first looking at all our nearest neighbors, then at their nearest neighbors, then at theirs, and so forth.", even if they had never heard of graph theory or BFS, or seen code for it before.
The real issue is why is a front end developer expected to have an education in algorithms? Part of the problem is that programmers doing the interviewing like to show off, instead of focusing on the requirements of the position. I remember the first time I interviewed someone. His resume said he knew C++, so I asked him about the intricacies of templates. That revealed that his knowledge of C++, like that of many people in the early 2000s, extended only to "C with classes." Gave a negative evaluation. But in retrospect, all our code was C with classes so what did it matter? I was really just showing off that I had read TCPPPL.
What discipline are you hiring, and what do you define as "familiar with"? If I am hiring an electrical engineer, I expect them all to know what Maxwell's equations are and what they represent. I would only expect an analog, mixed-signal, or power systems engineer to know how to apply them. Even then I would expect them to look up the equations.
Engineering has been standing on a foundation of reference books for as long as the discipline has existed. Engineers are expected to know what the principles are and how to apply them. They aren't expected to do all this from memory. The PE exam is a mostly open book test for that reason.
If you evaluate two similar candidates, candidate A on their github and candidate B on their performance on Hackerrank then it's incredibly hard to fairly compare those two candidates without adding subjective bias.
In practice what happens is the company goes "oh well the person with a github clearly has more initiative". But is initiative part of your evaluation process ? - have you ensured you've fairly allowed all candidates to demonstrate it, or have you ended up evaluating candidates unfairly on totally different metrics.
If you're hiring you can vastly improve your hiring process by doing two things: (1) Adopting a standardized structured interview where questions map directly to your needs and (2) using a work sample test (getting candidates to do a small piece of work that resembles real-world work as closely as possible).
I've been tested on code, but it's never been these inane tidbits everyone went through getting their CompSci degree. Anecdotal, I know.
1. If they just went by open-source contribution and prior experience, the pool of "qualified" people would be immense. You need some way to narrow them down, and it's fine for a company to pick their way, be it CS questions or how handsome someone is (joking) or how easy they are to talk to and interact with (charisma). It's not just about pushing code--lots of people can do that.
2. Questions like these are not totally unnecessary. Even though you won't be dealing with CS questions regularly at work, they still show that you put the effort in to learn them, and that you can think critically and on the spot to solve problems.
I don't think hiring is as broken as people make it out to be. Just learn the science and study up on it a lot before... I even bought a book that is a summary of common CS problems that interviewers ask. It's not a big deal for me to just read it up for a couple hours a day for a couple days before my interview. Good companies are looking for people who are ready to put a lot more effort in than just brushing up on Dijkstra's algorithm.
Note: One of the greatest things I learned from 5 years of undergraduate school has nothing to do with coding or science. It's the ability to just shut up and get some work done. Even if it's hard, unnecessary, or it's difficult to understand the motivation behind being assigned it, it's a useful ability (for growing professionally) to just crank out some work when you're told to do so. Many times, it takes doing the work to understand why you should do the work. Then that lightbulb turns on and you realize how much you've benefited from learning Dijkstra's algorithm and applying it to something; it's pleasant.
I've been rejected many times. And every time, I come away from the process annoyed and disappointed, but certain that I would have been useful to them had they hired me. I research companies thoroughly before going into interviews, and don't waste time interviewing for positions that I don't think I'd be interested in / qualified for.
I also have decent GitHub activity, handful of open source projects that demonstrate my abilities. When I started my new job search I assumed that this mattered, but in my experience it really doesn't. I still get asked extremely basic questions that I'd hoped my GitHub would eliminate. In some instances the company that rejected me had some open source projects, and it made me feel better about myself to see their poor code quality.
Nevertheless, I am also starting to have doubts about the industry. I've wasted a lot of time on take-home challenges, introductions, technical phone screens, on-site interviews, etc. to be rejected without explanation. As an introvert, it's all very exhausting. Why should I, as a computer programmer, have to be an amazing socialite that my colleagues would like to vape & play air hockey with? I just want to work on interesting problems. I'm not stimulated by extravagant team lunches or interrupting meetings to play with the company dog. I'm not stimulated by fancy windows and games and snacks and toys. I'm happy to have technical discussions all day long, but I really don't want to work in a frat house.
I feel like there's a lot of pressure from the industry to be someone I'm not. Also, it seems like the Joel Spolsky idea about only hiring exceptional programmers (at the expense of risking a merely /good/ hire) has seriously penetrated the industry, making the system highly risk-averse in terms of hiring. I feel like no amount of prior job experience or open source work will make a difference. Every time I interview, it's a clean slate, and if I don't nail _everything_ it's a certain no-hire. Even if I did well in prior interviews with the company, they simply won't risk it. I would really like to know what the reasoning is, but they never provide feedback.
I will say that I've been hardened by the experience. I'm better at pitching myself, making appointments, talking to people in a structured way, preparation. I think if any startup founders lack experience as sales(wo)men, there's plenty of opportunity to dial-in your skills by pretending to be a job candidate strictly for practice.
1) Simulate a real work environment. This means a dev machine with full access to the web. One thing I'm looking for is how good the candidate is a finding information they don't know.
2) Customize the questions for the job at hand. A software tools dev is a very different position a firmware dev. I wouldn't, for instance, expect a firmware dev to know much about regular expressions. And I wouldn't expect someone interviewing for a scripting job to know much about alignment on ARM.
3) Test your questions on coworkers and friends. You need to get a baseline. Is there enough time to answer the question? Are people coming up with wide spectrum of solutions, or do you keep seeing the same response over an over? Are there parts of the problem that people find unclear?
Companies simply cannot give a reason for rejection. It is a "fake/legitimate" legal liability HR says exists opening the door to discrimination lawsuits.
My advice is never interview at a company at which you do not have some prior professional introduction (network, friend, foaf, etc). These people will be able to give you the real feedback on why you were or were not hired.
Some recruiters with longstanding relationships at the companies they are placing at will also be able to find out, but may or may not be honest with you.
Not to mention that I would feel offended if I'm asked by a hiring team to solve complex logic task while visiting an office for a first time.
Usually what I do as an interviewer is to select a bunch of questions out of [1] github frontend developer interview questions and make a productive conversation, by asking for opinion on different ways of writing front-end code.
1 : https://github.com/h5bp/Front-end-Developer-Interview-Questi...
Kudos to the author for being so forthcoming about his experience. Maybe if enough programmers start making a big stink about this problem, something will actually get done about it.
Having a great resume and stellar github is why you get the call back, an inability to conduct yourself in a professional manner is why you didn't get the offer. Especially in newyork, a medium post from an employee could affect stock prices, you can't have a lose cannon working for you.
What's bugging me about the author is that he dismisses everything that doesn't have direct relevance to the position.
Projects get finished and you still want to work there. Projects get reshuffled and you're placed elsewhere. Your role in the organization changes.
If an interviewee showed such a myopic view of his future work I wouldn't be thrilled. He basically says "let me show you that I'm a one-trick pony", while the interviewer tries to ascertain his capabilities across several potential jobs.
Yes it’s stupid. Yes it’s not something you’ll ever actually do on the job. No it’s not a real indicator of your actual programming ability. But it’s what you have to do to beat this part of the game and move on.
And, yes it sucks, but it’s not THAT hard in the grand scheme of thing. Basically what’s happening is someone is saying “we’d like to hire you for a job that pays significantly above the national average, is safe, low stress and generally pretty easy when you think about it. All we ask in return is that you brush up on some things that you have already had to learn anyway.”
I would also argue that it’s at least partially about seeing how driven you are. Everyone knows that you’re probably going to get asked Algorithm and DS questions in an interview. There are literally several very popular books entirely dedicated to that fact. So you can either have a self-centered, egotistical, “I don’t think I should have to know this and I know better than everyone else so I am not going to learn it” attitude, or an open, eager “I really want this job and I know they will probably ask me some of these kinds of questions, so if I have to take a week to brush up on these concepts I am more than willing to do so attitude.” Which do you think makes for a more attractive potential employee?
Essentially that's what is going on. Easier to exercise your biases when the default is "don't hire."
If you know your stuff you usually can separate bullshitters from good people.
This has worked pretty well for me so far.
Since then I think one of the best approaches is to come up with work related problem, leave person to solve it with computer, keyboard, internet etc. with no time limit (if candidate can't solve the problem, they will give up and just say it after 2h or so). Quick chat about the code afterwards will tell you in 1 minute if person understands it and didn't copy pasted solution etc.
I spent a few minutes trying to recall how it would work and I couldn't, and it seems like a fully working Math.pow is a little complex for a gatekeeper question – or maybe I just forgot the trick.
Even for a front-end developer, I think that algorithms matter, because developers have to understand what they do.
And the OP's solution in O(N2), as well as the other one with hash maps, seem quite bad (it can be done trivially in O(Nlog(N), and optimized to reach O(N))
Interviewing should be about finding a fit between a worker and work that needs to be done. The best predictor of that is past success doing similar work. It's not about imitating Google's process, and except in increasingly rare situations, it has very little to do with academic computer science.
And there is never a need to treat anyone rudely. So don't.
crontab -e
30 9 * * * cd /mycode && git add . && git commit -m "Woo!" && git push
service crond restart
Ta da!The best approach to getting hired (especially if you know you are good) is to reach out via your personal network. Get in via contacts and recommendations. Always keep pushing your existing coding profile at every point of interaction.
Is that really necessary?
I was going to turn down the position in the end due to cultural differences. In the end I didn't get the position due to lack of technical proficiency though I was only asked behavioral questions.
Waste of time.
So many factors go into hiring someone. Often it comes down to little things that have nothing to do with someones ability to do the job. Maybe a particular member of the team really didint like you or the manager and you went to the same high school and you have a connection.
It's crazy how often I will have a developer flat out rejected after a technical screening from one company only to go to another company who loves them and everything they do.
I believe the biggest misconception is that just because someone COULD do the job means that they will or should get the job. A lot of intangibles affect the final decision.
Your frustration is understandable. But you also have to ask and understand how our industry has come to this point. There are concrete reasons for it, and despite this process not being the best, it's the least evil when hiring is done at scale.
The process is here to stay. If you want to work at some of those companies, don't overthink it. Just prepare for interviews. It'll also give you a refreshing perspective to software development.
PS: The startup's not American, American startups have an inflated ego.
def findSum(array1, array2, sum)
complements = array1.map{|x| sum - x}.reverse
i = complements.count - 1
j = array2.count - 1
while i >= 0 && j >= 0
return true if complements[i] == array2[j]
if complements[i] > array2[j]
i -= 1
else
j -= 1
end
end
false
endHiring is Broken: Yes it is,but not the process,but the people. When you interview in a big company(especially a profitable one) you need to realize they are not looking for a typical skillset. Big (for profit) companies tend to keep their softwares behind closed doors. Hadoop was open sourced by google atleast a year after internal usage ,the same goes for Bazel(Blaze internally) .These were open sourced because they had much better versions of the same software that were consumed internally.When you reach such levels,performance factors are as important as
- ability to ship fast - writing clean/testable code - and all the other things that we programmers/coders are good at.
I am not saying that we aren't good at optimizing. But they are not really looking for the horde. This could also explain poaching college professors/PhD candidates for jobs.They need to people to push boundaries,not implement/build things from existing technologies.There is only so long that you can spend in a domain without having the need to extend that domain which you have been working in the past 20 years for.
Regular start-ups and other companies need a product.They need to make a mark in a field by pleasing the customer who would be using their products/technologies and who are looking for a service alternative mostly.
That is my justification for such interviews.This changed the way how I even handled interviews.
If I am asked these algorithmic questions,I generally smile and ask them if they want a Computer[1] or someone who can use a computer.I Immediately steer the conversation to what do they expect from me and explain to them what I can do.Often this clears the air and helps me(stress on the me) decide if I would like to join them. What you need to realize is that its you who is joining them.The impact that the organization will have on you is normally a much larger of magnitude in comparison to what you will have on the organization. The environment you end up working in will mould you in ways that you cannot anticipate.
PS: There are a couple of people who do the job hunting for the massive salary hikes and those sort of factors.I guess none of my arguments apply for them .
Corporate feedback is mostly BS. And the rare line from bozo recruiters offer little of substantive value. It's safer for him to say nothing at all.
However, I was taken aback by the author's refusal to try to solve BFS. To me, it feels like someone should be able to reinvent it relatively easy - that it's akin to a linked-list, palindrome or FizzBuzz question.
The typical answer is that they don't :)
The risk of choosing the wrong person is so great, that it's often better to not choose anyone. If there is any doubt what-so-ever, it's better to not make a a hire, it can be too damaging to a team, manager, company.
I've tried so many different "coding interview" scenarios. But I found the best one was a real task that a real staff member would be expected to do, extract it out into its own example, and before I talk to someone, they present their solution to the task, and the only thing we talk about, is their solution. If they can dissect and discuss their solution eloquently, and reason about trade-offs, short-cuts, talk about what they may have done better....
Of course, it can also be a simple case of, "is this person an asshole? are they going to rub my team up the wrong way? yes? fuck them."
While I don't interview for engineering jobs, we do bid on municipal contracts which are dominated by this concept (cover your ass, hire the big guy). A different animal indeed, but in a employment hierarchy where employees are held accountable for performance of new hires, it seems similar incentive would exist.
[0]: http://jsfiddle.net/5g7se8qL/7/
[1]: http://stackoverflow.com/questions/16173259/javascript-maze-...
You seem more than capable enough to get a good job but in my experience, interviewers are looking to see how you react to being stumped. If it's anger/frustration/clamming up then that's a turn off for a lot of employers. They're looking for more than the right answer.
I wish Sahat had reached out to more of his network before responding to random recruiters. Tech interviews as Sahat experienced them are broken, but tech hiring is slightly less broken especially when you leverage your network.
*note this is the same comment I made in the other thread. I stand by it. https://news.ycombinator.com/item?id=11579757
Read a single user's Tweets going back a month and even your best friend starts to look a little nuts. Do it with their git history and you'll sometimes get a very different impression of their work habits, too.
In my experience, these services tend to make people look worse, not better. But I can't always give the benefit of the doubt when I'm making a critical hiring decision.
The thing I learned about applying to jobs last time I went through this is that if your primary goal is obtaining a source of income, you need to send your resume to ~10 people a day, every day, and go on every possible interview, and do every possible thing people ask you to do.
You'll still lose a lot of jobs to these techniques, because they're effectively random, but since it's random, your odds of success increase with volume. Eventually you'll hit a position that you do just randomly happen to know the algorithm they're looking for, or they don't ask CS theory questions (I'm self taught, so theory is a weak point for me as well), and you can talk about/demonstrate your actual job qualifications, rather than some contrived talent that's entirely irrelevant to the position.
There are a few companies that make it a point to mention they avoid the kind of interviews you've been getting. Perhaps try to seek them out rather than rely on recruiters
https://gist.github.com/ericlw/16b55e038028e1e4768e
Because Hired.com prescreens companies and have a limited pool of both types of companies and types of candidates, it is easier to get a better sample size based on type of role.
I primarily talk about some of the arbitrary offers, instead of the interview process. But you might find it interesting too.
When I hired a programmer for our doomed to die VC life support funded fart of a project, we put her through numerous rounds of comp sci bingo and algorithm hell. Why? Not sure. Everyone else does. I mean, hiring in IT is shit, why should we break from the industry norm? Why should we want to care about the candidates? Right? I mean if Google can do it...