That said, I think a hiring process that puts engineers in control (no ghosting, get data on when a recruiter looks at your application, search ranking by whether companies lie to candidates) is something that should exist. I want to try to build it!
However, I dropped out completely because TripleByte wouldn't let me see companies without entering in a desired comp number. My recruiter at triplebyte said I could just put in "$1 or $1,000,000" to get past it, but that just feels like the same kind of corporate HR bullshit that people have complained about for years. Just Google "recruiter won't proceed without desired salary" and you'll understand how many folks dislike that question.
The experience made me feel that Triplebyte wasn't interested in putting me in control of the process at all if they have such a user hostile requirement and require me to work around it by putting in fake numbers. I understand that many people will have no problem providing this info, but I prefer to see what companies offer me because it tells me how they value me and the position they're hiring for.
There is a large pool of people who think that they are programmers, but are not. This is exactly what the infamous fizzbuzz test was intended to weed out. I personally know a top notch recruiter who credits her success due to learning early in her career how to filter most of the junk out. For example a "Perl programmer" who listed Microsoft Word as a skill was probably not worth looking at. (Note, this is an example from 20 years ago. But the principle remains.)
If you create an engineer focused site and DON'T find a way to segment engineers by ability, you'll find that your negotiating power is based on the average of your candidate pool. Which means that you'll discover why traditional recruiters kowtow to companies and not the other way around.
The trick here is you need to figure out a business model where you don't take money from employers, because once you do its just the long slide to becoming a shittier LinkedIn.
As CEO, you:
* Grossly expanded profiles without user permission.
* Laid off tons of staff right before the COVID lockdowns. (What has been your personal returns since April 1, 2020 by the way?)
* You have been privy to discrimination happening in client company on-sites yet did nothing to the client companies.
You’re a CFO, an investor. You’re not a CEO, and you certainly do not have my trust as a developer.
Sure, having metrics on how often a company ships code, etc. would be helpful, but frankly I have about 10 companies on my list that I'd work for, and I doubt any of them would give you this data.
What I'd really like is not having to practice leet code problems for 3 months before I interview. The older I get, the less motivated I am to do this. I've worked in senior engineering roles at big tech (FANG) with 3+ years tenure. I don't think I managed to not be able to do my job and fooled people for that long.
I've interviewed people I KNOW could do the job, but they didn't get the optimal solution, or were nervous, or N things in the loop, and we ended up not hiring them. There must be some incentive to create a system that lowers these false negatives.
This is a space that unions fill well compared to for-profit recruiting agencies. The organizations give engineers control and leverage in hiring, and can help them up-negotiate. They also allow employers to hire from pools of skilled talent.
Whereas with recruiting agencies, the customers are employers, not the candidates. Incentives are not aligned to give candidates control.
But the transparency you need to extract is mainly financial, that’s the big asymmetry. I think people care more about money than they say they do, and less about release cadence or test coverage or whatever than they say they do.
So triplebyte should be called “get me a raise.com”. I tell you what I’m making, smash all your tests, and you find me somebody who wants to offer me e.g $50k more or $100k more, and that WILL be the offer I get. And if the company reneges on that offer then it’s flagged to warn others, and if they do well by their employees they are rewarded as well.
I am looking forward to progress toward a hiring process that puts engineers in control, such as by allowing them to accurately record their current role in their profile.
In 2015, candidates with the same schooling scored about 20 percentage points lower than 2020, the last candidates I used the test for. The number of questions doubled, and then the test got much easier, by eliminating more challenging programming questions and replacing them with questions with giveaway context. By comparison, according to my data, about N=43, until about 2018 being a senior versus a junior in college CS programs is worth about 10 percentage points on the test; going to Harvard instead of Berkeley is also worth about 10 percentage points. In 2020, the last tests had no predictive features.
I stopped using the test, because it became too easy and too noisy to be informative.
I recognize some of the coded language in the blog post. There are definitely more lucrative opportunities in recruiting for DEI. I don't know if it will last. If you're still jittery about the public-profile-by-default thing, which by the way, was totally irrelevant and overblown IMO, this may not be a pivot for you.
One thing I see in the data is that at MIT, women and men performed the same, controlling for seniority. This wasn't true at the 3 other universities that produced enough data to measure.
That said, what really is the best way to hire candidates? I'm not convinced having binders full of engineers is special, there are almost always more candidates than jobs, at least 5:1, in every non-credentialed industry vertical. Anyone who has worked at a jobs (or indeed any matching platform, like the Common App or Tinder) knows that.
Then there's this long thing about asymmetries or whatever, warble garble about missing information... It has never, not once been my experience that someone seeking a subordinate role at a typical private company with preferences like "pair programming" or whatever have ever been better than someone with no preferences at all.
Maybe it helps to engage in the vanity of whatever trendy workplace trend is hot for whatever vertical. But like, if you're being intellectually honest, if you thought pair programming was important, you'd pair program at TripleByte, but you don't, you know in your heart of hearts none of that shit matters, so why are you putting stuff like that into your search system?
Indeed and ZipRecruiter are ad arb companies. They don't care. Private universities lead, not lag, DEI at giant companies, so it's hard to see how to compete against them in that core business. It will still come down to a real defensible opinion.
Do you have more valuable inventory than ZipRecruiter for DEI candidates? Who knows. What an uninteresting question. Apple also hires people who just make shit up on their resumes, I know two - though they weren't engineers.
how do I reply to recruiter contacts? applied to a job, received a request for interview from company. Nowhere to reply on the platform? How do I get in contact with them?
Should there not be a reply button right there with recruiter's message?
p.s. I already emailed support but, my past experience tells me they won't reply.
To be clear, I'm only addressing the comment about how people thinking highly of them are gullible. I had a great experience, twice, within a few months, and that included going through a time of huge uncertainty.
That being said, I was not happy to see each of the changes they've made over the last year or so, and this does not strike me a good direction for engineers. I suppose I have to agree that they are not doing this from a position of market leadership. Perhaps they were providing asymmetric value to engineers, and at the end of the day the engineers are not the ones paying for the service.
This is a very good insight. Unless candidates pay more than companies, the incentives are off.
> We got jobs for over 1000 engineers
Given how many years Triplebyte has been running, "over 1000" seems surprisingly low. I wish them luck with their pivot.
$25k*10k = $25M / 10 years = $2.5M / year. That is peanuts compared to how many people they employ. Plus the ads they run...
One. The problem domain they are in is on its way out, and they've decided to defect instead of being the ones left holding the bag.
Two. They hate what they do for a living.
The first company to stop making buggy whips probably did not do it because they weren't selling any. The fact that they ceded market share to their top competitors probably sunk the barb in deeper for them: Yeah people are buying cars but our sales numbers are still going up so why should we change?
In tech we see companies all the time end up being complicit in the destruction of their own industry by reducing its relevance in some manner or other, and by exiting early they have more options of destination. If I jump to the same industry as a competitor a year later I just look like a copycat. While some copycats copy other people, only better, they are the exception to the rule. Most churn out uninspiring derivative work, and if they can't at least do it cheaper then they end up on the scrapheap of history.
At that point, you can either keep going with what you're doing (and run into an inevitable wall later on) or you can foresee the future problems and pivot before they become unmanageable (which is what we did). Relatively few startups find their final model from minute one.
Funny but whenever I think of Triplebyte, all I remember is seeing their ads everywhere. I am personally a fan of Indeed and they do a good job sending leads and applicants other than good old Linkedin.
When I was fresh out of university, I had trouble finding a job. I had worked part-time at a small company through the last few semesters, but that company blew up just before I graduated. Every interviewer I ever met with was impressed because I really knew my stuff, but had trouble getting in the door due to an unimpressive CV and awkward mannerisms.
I did very well at Triplebyte, scoring in their top bucket and getting top marks in several of the sub-categories. Those metrics are relative to all engineers, which would put me even higher amongst recent graduates. I also did very well on every software project I worked on and scored top marks on several other objective tests, like the Major Field Test.
I was exactly the sort of candidate their system should have been able to help. I never even got an email out of it, let alone an interview.
Waste of time.
Fortunately, most of the dirt thrown at recruiting teams is wrong in the first place. I don't know any hiring managers who make lowball offers that have a low chance of acceptance - the costs of the process, the risks of hiring someone who starts mad at you, and the value of winning someone who is actually worth hiring, are all way more important than some incremental cash saved.
Well, presumably the idea is that engineers, especially high quality ones, will be drawn to the recruiting platform that has more pro-engineer policies. And so if you avoid using it, you lose access to that subset of engineers.
It's still a chicken and egg problem, though, because engineers have little incentive to join until there's enough companies.
And as a HM, I was never interesting in using them, and we continue to use our own internal recruiters or local recruiters who know the market.
Having worked at a startup that was trying to disrupt the hiring/recruiting market back in 2010. I'm curious to how effective they were....if at all.
Edit: update, maybe I'm super skeptical because of all their cheesy ads that were all over Reddit for so long?
On related matters. I know several companies that have pivoted out of the "hiring/recruiting" space because apparently that space is not easy to scale/automate.
I guess they didn’t hit product-market fit with candidates. Two sided markets are tough.
My experience is different. I've been through the TB process three times, back in 2017 where they flew me to SF from Asia for Flexport, Mixpanel and two smaller startups, and then again this year where I went to the final stage with FB production engineering and TB itself. And in between as well i created yet another profile on the system after shelving prior ones for a fresh start. I have a non traditional background, (ie, an "outsider" developer, chem degree and self taught hobbyist programmer since young), i take my craft seriously, have a bunch of popular open source products and a successful low touch indie business. But i don't consider future success guaranteed so i like to keep talking to companies to find that great opportunity for me. I know my tech skills in some areas are not the best so i like to stay in the loop, stay up to date and relevant and stay in touch with what companies are looking for. By far the best hiring process experiences I've had have all been through the TB platform. And my "open rate" for applications and inbound interest on TB is way higher than any other methods I've tried (SO jobs, WWR, HN). The quality of companies, hiring process and level of interest I've received via TB has been epic and, at least in the past, even the TB support staff are super helpful going so far as to provide personalized feedback on profile improvements and resumes. I'm not an expert at getting hired but i couldn't have asked for anything more from them. They were fantastic. I only have great and wonderful memories of the time i spent in hiring processes of companies i "met" via TB. So this is my experience of it, and this is despite the fact that i have never ever received an offer from any company I have met on TB, including from TB itself. I don't blame them. I just consider my own skills are not at the right level, and the fit is not right for the companies I've met, while i work to improve myself and my skills. That's all. It's a simple and beautiful experience I've had with them. Soooo different to hiring through other platforms (where funnily enough i have recieved offers). I've met and talked to ammon and many other TB team members and they have all been cool, friendly, passionate people. From what I'm reading of this pivot, they're being vulnerable and open to learning, and using what they've learned so far to create something even better. I'm not gullible, I'm not saying they will succeed. But they're trying. And they're earnest and sincere. What more can you ask for? This has been my deep experience with them. I think the most vocal critics are talking merely theoretically without any experience of TB nor deep nor accurate understanding of who they are, what they do and what they stand for. To them i say, give it a try. Investigate before contempt! ;P ;) xx
I've been wishing for something like this for years. Especially for early-career engineers or people from non-traditional backgrounds, this is insanely valuable because it helps you to know avoid wasting time on applications that will never go anywhere; avoid typing in your resume, line by line, into another form after already submitting your pdf. Avoid writing a cover letter to a job that's already been filled. Avoid applying to a posting that's really just out there for a company to "gauge" interest, not for filling a real role.
If an application is rejected, fine. But getting a follow-up request 7 months after submitting a resume into a black hole is ridiculous, and I think any system that decreases the information asymmetry between the applicant and the employer that allows people to intelligently approach their career search is going to be tapping into something truly valuable.
Like you, we thought (correctly, as it turns out) that it would appeal to people early in their career. What surprised us is that very senior engineers also told us they loved it - we didn't think it was as much of a concern for them, but sometimes your users surprise you.
It's also a great example of how obvious low-hanging fruit gets missed until you start thinking strictly about "what can we do to make job seekers' lives better?". It's not a particularly innovative or difficult feature, and yet major job sites with a dozen times our engineering resources still haven't done it.
I wouldn't charge for the service, however, unless building it as a freemium model.
/economist hat
I'm in this industry and doing well because of recruiter reaching out to me (multiple times) and not vice versa. The whole idea of applying for jobs just doesn't seem to work at all.
On the other end a recruiter reached out to me and I'll be doing the final interview with their VP next week.
I don't think we can draw conclusion at that stage (we are a dataset of 2..). But I'd love to have access to the LinkedIn dataset to figure out if applying for jobs is broken at scale.
Often enterprise HR is paranoid of honestly evaluating anyone for anything, to the point that many HR teams tell one another and engineering hiring managers that it’s “illegal” to assess candidate abilities on the way in the door, at all.
If you think about joining a dev team where no one checked if any candidate could FizzBuzz, you can imagine the workplace environment that can end up with.
Triplebyte is able to provide engineering managers with a stack of pre-vetted resumes so an enterprise can interview by its lowest common denominator HR policies, while still having a prayer a team will at least be made of candidates who can code.
The value of this to an enterprise stuck in this position is hard to overstate.
Hopefully along with expanding the talent pool per this post, Triplebyte can figure out a way to get well paid for this ability to help land actual coders on actual dev teams despite enterprise HR.
The need for this is huge.
// I see a comment below from a Triplebyte PM about score matching: https://news.ycombinator.com/item?id=27542621 … That would be slick: land candidates that genuinely raise the bar, but aren’t so far ahead as to be speaking a foreign language to the team. Of course, this would require also assessing the target team, and oops, we’re right back up against that HR policy…
There's an old quote: "Nobody ever got fired for buying IBM."
Large companies tend to be more risk-averse, so if there are two companies you can use for a service — $PromisingStartup and IBM — large companies will generally make a decision that's optimal to the specific decision-maker, not optimal to the company.
There are two options if you, as the buyer, choose either $PromisingStartup or IBM: success or failure.
If IBM or the $PromisingStartup succeed, then you've done your job.
If IBM fails, you can tell your manager "Who could've guessed! It's IBM!"
If $PromisingStartup fails, you'll have a harder time explaining your decision, and the fault will be with you.
The "Nobody ever got fired for choosing IBM" idea is useful to look at every decision large companies make, whether it's pivoting, choosing a SaaS product, or hiring.
TripleByte, in its current form, has been beneficial to candidates as well by giving enterprise employees a justifiable signal towards hiring them regardless of pedigree.
From the position of a candidate this sounds like a poorly run company I'd have no interest in working for. I wouldn't want to interview with them.
That sounds hilarious How could a dev team not be able to write 5 lines?
I got shitlisted at one place for being the only dev with the mathematical insight to know that multiplying pesos by a dollars:yen ratio doesn't yield a correct conversion of pesos to yen. They let that one slide without fixing it, but the final straw that got me frogmarched was refactoring an if-else to a switch.
They saw me as a god for fixing their shit and offered to hire me. No thanks!
Which turned out fine. I found a job where my pre-computer programming work experience was relevant, and here a couple jobs later I'm working heavily with and on parsers.
So. Count me as one engineer they rejected who doesn't hold that against them.
I'm pessimistic about this pivot though, for a couple reasons. One, it smells desperate. Recruiting is sales, and in sales, desperation is the kiss of death. I can't read that blog post without coming away with the strong sense that if this doesn't work, it's over for them. If I can see it, anyone can see it.
Two, companies aren't going to want to work with a firm that's allowing engineers to collect detailed information on douchey behaviour that the company might engage in. Does Triplebyte have the leverage and moxie to make them engage anyway? Probably not, see point one.
I wish them well, because recruiting is awful, interviewing is broken, and engineers deserve to have a better time of it given how demand-driven the market is, and likely will remain for quite some time.
Can't help thinking they'll be writing about their incredible journey within a year or two.
On the other hand, if a company does not engage in douchey behaviour, then using Triplebyte could be a way to signal that.
This fails a bit if companies can be credibly accused of douchey behaviour when they haven't been engaged in it. I don't know what Triplebyte's plan is here.
> Does Triplebyte have the leverage and moxie to make them engage anyway? Probably not, see point one.
Indeed. They labour the point that programmers have the upper hand in hiring, but that doesn't translate to Triplebyte having the upper hand!
I would think big tech companies wouldn't touch companies who might fold in the next 6 months with a 6 foot pole.
I have a total of 6 profile views. So you’re truly not missing much.
The most friction when switching jobs is the interview process -- and the question is why? I've been writing code for a decade+ now, working on startups, for known tech companies, public open-source, and have written a freakin' book! But, oh, my bad, I couldn't figure out a solution to your optimization question. I forgot how to implement the zig operation in a splay tree. I might simply not function well under pressure. Maybe I'm having a bad day.
Companies are missing out on literal geniuses by using outdated hiring practices. And, I get it, Google doesn't care. Amazon doesn't care. (There's an argument that they should.) They're huge and get X,XXX applicants daily. But why are small startups using the same hiring methodologies? It quite literally makes no sense. They're shooting themselves in the foot. I'm very passionate about this, and I'm working on a book on how to hire engineers. Maybe I'll actually finish it one of these days :)
Past companies and open source contributions are not perfect indicators. I've seen people with stellar resumes fail to even know the syntax for an 'if' statement in any language of their choosing. I've had people absolutely ace takehome exams, yet in person don't know how to write a function.
False positives are also much more expensive than false negatives, so companies would rather accidentally weed out good candidates than risk hiring bad ones.
If this is actually true, which I highly doubt (I've interviewed people, too), your process is terrible at preselection. I've heard so much about this "programmer charlatan" that lies on his resume and ends up blowing up million dollar systems, but have yet to see any tangible proof.
> Past companies and open source contributions are not perfect indicators.
This is self-contradictory: how/why would any open source project let someone that doesn't know fizzbuzz contribute to their codebase? I run a tiny throwaway open source project (~600 GH stars) and even my reviews are pretty stringent. This point of view is not consistent. It's like saying "I know people that ran in marathons, but couldn't even run for half a mile in my interview."
That's maybe a little unfair (plenty of people who aren't engineers take our quiz out of curiosity), but the basic point here - that companies are frustrated because they keep getting fizzbuzz-incapable applicants - is more-or-less accurate. That has been (and continues to be) a big part of our offering on the other side of our platform: in the same way that we can provide data about company behavior to engineers, we can provide independent verification of an applicant's skills to companies.
Wow, sounds like you either need to change your sourcing or improve your early screening. If that many poor candidates are making it to the interview stage something is wrong with the process.
Of the people that turn up late to the interview, what percentage pass fizzbuzz?
And yet they will still email you, year after year… as a dev that's worked in finance/academic research labs and for low funded/bootstraped startups all over the world for the past 10 years… I'll never get into these big companies because I simply try to find companies that need work done yesterday, see my experience (maybe reach out to past corps i've done work for), and give me an offer for at least a short term contract (and these big companies will never do this).
The worst is when I've think I found an interesting company (that on more than one occasion, publicly likes to complain about not having enough devs… lol), start talking a bit and they send me a triplebyte link… maybe it will be different this time, but I doubt it because these behaviors are too ingrained in a lot of corporate processes (even if its mostly "big co does this, me small co must copy"-NPC type thinking)…
I have Github repo. I have my own portfolio. I have wrote flutter app deployed to play store to demonstrate I can function individually and still can write production ready code. And All the above just on my own spare time.
But every company I have applied told me my skill set doesn't aligned with them. I get response from them that there is no traction on my resume. While some friends get interview after interview and others don't.
I am not saying that I am the best but we need different process where entry is given and now show me what you can do.
I moved from engineering to management over 5 years ago now and still in interviews for positions like "head of" in 100+ people companies or other management roles in bigger companies I got asked the usual algorithm questions.
I just have zero interest to prepare for these interviews, I don't have the time or the motivation, and I honestly just don't care about the answers. Most of my job, and my team's job, has nothing to do with them.
The world might be different in FAANG, and admittedly I have not worked there (though I have worked for other top companies) – but most companies are not at that scale, and they should not use the same metrics, particularly for management roles.
* The blog post complains that even experienced engineers they interviewed couldn't write some simple code on paper. Did anyone stop and think that maybe it's writing code on paper in an interview setting that's the problem? Stop and think about this. Imagine writing code like you usually do in a text editor. And then writing code with pen and paper. Backspace? Can't do that. Copy/paste some line to move code? Can't do that. Add some newlines? Can't do that. Run the code using the compiler? Can't do that. Of course most developers, even experienced ones, will do poorly under these conditions, this is not how code is normally written. On top of the already stressful situation of an interview, there's this suddenly completely foreign and limited way to write code.
* Even the blog post only mentioned fizzbuzz as a quick, easy question to filter out zero coding ability. Another way to say this, it was meant to filter out coding skill <= 0. Not skill <= 50 or skill <= 90. Zero. After that, the interview was supposed to move on to things that actually matter for software engineering. The present day interview has strayed extremely far from this. These days, you get asked two leetcode questions during an interview and even if you perfectly answer the first one, if you don't get the second one then you're an automatic fail. That was certainly not the intent of the original fizzbuzz, since answering any leetcode clearly shows coding ability. And the interview never has a chance to move on to the part that actually discusses software engineering skills. Or even if it does and they do very well on those interviews, the failure of only getting 1/2 leetcode questions correct overrules everything else since they must avoid "false positives".
(N.B. I was being a bit hyperbolic, but, yes, for example, I highly doubt Steve Jobs could.) The spirit of my point is that most smart people don't care about the kind of idiotic minutia typical hiring panels ask. They care about interesting/creative problems.
Our principles at the time were very similar to what Triplebyte is trying to do now: give power back to developers.
We build a version of "hired" (did they die?) before "hired" even exist. A matching platform that was matching people with companies that was sharing both their desires and values. Small/big company. Consulting/Product company. How much $$ do you want? What technologies you're interested in? Where do you want to work? All of this anonymously of course.
It was all fine and dandy, the company actually still exists and generates revenue, but I'm overall very bearish on the recruiting space.
It's a sales game. It's a numbers game. And on top of this the people top companies REALLY want to hire aren't hanging out in these recruiting platforms. So as a platform you're only feeding average/average low candidates to companies, and in the meantime, companies that have in house or externalized sourcing resources get better results by going over linkedin and their employees network.
It then becomes a financial game for companies.
And platforms that are not linkeding rarely win.
Maybe I'm wrong here, but it gives me the impression that Triplebyte doesn't believe in it's ability to get candidates into jobs. If companies pay (a not small sum) when candidates actually get hired, then I feel that incentives are aligned. If it's an annual fee (with no option for contingency) then I wonder what incentive the company has to make sure what I care about (making a hire) is the thing they care about.
90% of the other major players (AngelList, Hired, etc) in the market offer this... so why not Triplebyte? Perhaps I'm missing something.
Then the company is incentivized to use you for junior hires. Maybe you'll get a few freeloaders who only want to hire juniors, but even those will eventually be seniors who love your platform, and at the same time, will boost your stats on the number of juniors you got jobs for.
"But it means that once a company signs up, they want to make as many hires as possible through us.", right, but as a hiring manager that doesn't make sense to me... I don't care that we're making hires to justify where we spend our sourcing money. I care that we're making great hires, so I want to cast as wide a net as possible. I'm not going to shut my eyes to other sources because I've paid for triplebyte. But maybe in bigger companies I wouldn't be the one making purchasing decisions? And the folks making those decisions would be pushing HMs to use Triplebyte?
It is interesting, how the incentives align and don't align sometimes. Hard to say if I'm even in the target market (raised $15m, hiring a few folks this year in the "hardest" category, #1 problem is qualified folks at top-o-funnel).
Maybe I also have a personal penchant for seeing companies who bet on themselves and clearly align incentives :shrug:
I wanted to use triplebyte - but I only want to make 3 hires per year.
We have a big problem in the culture of employing developers that is closely related to how the startup market operates. The market is willing to shovel money at a problem rather than spend time, therefore the market will pay someone with specific experience in their problem far more than pay someone less and have more time to learn the domain. This results in siphoning of experienced developers away from new developers, which artificially reduces the number of experienced devs. The market is creating the problem for short term profit, and then turning around, lying and saying "there's not enough devs".
Yeah I don’t think this is true. I teach undergraduate CS and our data shows (which we publish at admissions so is public) we regularly have close to 100% job placement within 6 months, with 90+% of that being CS related. I know many of the students personally and they are almost all landing good software development jobs. I think we have a good program but I hear the same from colleagues at other schools.
“Good software development jobs” of course is a relative term. CS related does not mean Amazon at >$100k, although a few achieve that.
There's good programs out there, but they are in the minority. If you run a good program, that's great. In my experience most places offering compsci are there to take the federal loan money and hand you a piece of paper.
The reason we didn't talk about it as much in the main post is that our approach to the problem of credentials hasn't changed all that much. We still have quizzes, and someone who is having a hard time getting their foot in the door (a) is likely to be willing to put in the effort to take them and (b) will benefit from doing so. That's not a complete solution to the problem (it helps people with skills get hired, but doesn't in itself help people get skills that you only get on the job), but it's better than the status quo.
We haven't forgotten about people struggling as they look for their first job. (And I certainly never will: to get personal for a sec, my first job search was a miserable multi-year affair that nearly killed me.) We've got some experimental irons in the fire here (e.g. a program that basically highlights people who haven't gotten as much attention as they 'should' based on their skills) that we're not quite ready to talk about in great detail. If they work, you'll hear more about them soon. If they don't, we'll try something else.
This was me when I tried Triplebyte. I wish it had worked out. I don't really blame TB for the failure, but I think there was a lot of optimism on the part of TB that wasn't shared by the companies I interviewed with. TB was just another placement option for every one of them, and I found it challenging to overcome what felt like walking into several onsite interviews completely blind to what was expected of me.
Sorry, but I call major bullshit on this. Sure, if you have a D average at a low tier school, perhaps. But if you are a competent coder who got good grades in school, I see many companies ready to hire new grads left and right (obviously folks who graduated during the height of the pandemic had different issues to deal with). I don't know if we're quite at the "anyone who can fog a mirror can get a job" stage like we were in the original dot com boom, but we're not that far away.
Companies advertise they're hiring. Like they advertise that they're profitable, make the best products, and are better than their competition. That doesn't mean it's true. Many positions are "nice to have", so they will stay there until they get someone with far more experience on paper than they actually need - someone willing to get paid less of course.
People lie, especially companies. That's the nature of the market. Even if we had 5x the devs than employers, employers would still say otherwise. This is because more competition between applicants means you can pay people less.
Infact even during the dotcom boom my sister actually got a degree in "web development", and nobody wanted anything to do with her. I don't know who comes out with these lies about "high demand" employment but so far all I've seen is confirmation bias by those already employed - ignoring all the rest of the people who can't get anywhere, leave it behind, and go work at something else.
* Reluctance to move / restrictions on where they want to move (only SF, Seattle, NYC)
* Extreme focus on product development (and not applying for the operations jobs that keep many large orgs running).
* Focus on working for a high salary at a big tech company (and not applying to jobs at companies that aren't seen as big tech... say... this job - https://csx.taleo.net/careersection/basic_faceted_search/job... )
I believe that there is extreme saturation in certain desirable sectors of the field and "where is everyone?" in other areas.
If you allow everyone in, regardless of if they are qualified to be a senior level engineer, will this not just be another job hunt platform where (when I look for another job) I'd still have to do another technical interview at the company itself?
How will companies know now who has been vetted as qualified and who is just lying on their resume? Maybe it's shitty to think this way but there is already a ton of sites out there that allow me to send my resume (or allow a company to view mine) before starting a traditional hiring process that Triplebyte prevented, allowing companies to connect with qualified high level engineers and know the person would fit their skill needs. The way it was companies mainly were just testing for cultural fits, etc.
To be clear, we still have quizzes and the ability to show your performance on them to companies. The fact that they’re not completely mandatory to use Triplebyte doesn’t mean that they’re not important or that we won’t build further features around them.
Right now, companies can offer an expedited process as part of their reach-out. We’re working on ways to productize this a little bit better. We didn’t announce the feature in this post because it isn’t done yet, but one thing we’re looking at is allowing companies to set individual score thresholds for various types of expedited process (e.g. “if you scored a 3 on algos and a 4 on back-end, we’ll definitely get on the phone with you” or “if you have a 5 on python we’ll skip tech screens for you”). We certainly recognize that FastTrack was valuable to a subset of engineers, and we want to recreate the value it offered in a way that is a little bit more sensitive to the specific company and specific engineer in question. We imagine, for example, that less-prestigious companies (who are more concerned about attracting applicants) will probably set lower thresholds than the Apples of the world. Under the old system, we had to set a single threshold, which would necessarily either be too low for prestige companies or too high for everybody else.
And just to lean a little bit back into the pitch we’re trying to make here: if you’re concerned about interviewing process, wouldn’t it be nice to be able to search companies by how their interview process works? That’s not an axis on which companies meaningfully compete right now, but with the right incentives, companies will cut a lot of the annoying hassle that they currently have no reason to get rid of.
If a company asks me if I have questions, and I ask them, and they ignore me, I'm done.
I wasn't looking for a job, but thought the test results would be interesting. Who takes a test and doesn't get results?
I tried TripleByte and wanted to like it, but mostly it didn’t seem like anything special. The whole concept of getting pre-screened, getting multiple offers, and jumping straight to final interviews just didn’t pan out. The last company I interviewed with basically treated my application like any other pipeline. I had a standard recruiter call, hiring manager call, and several technical interviews before getting an offer. And the experience with other companies was similar. From the outside looking in, it appeared that there was no special track for TripleByte applicants. In the end it felt like the TripleByte process simply made the interview process longer, not shorter. Eventually I found it faster & more effective to pursue companies on my own.
TL;DR — companies I met through TripleByte ran me through the standard process I’d experience through any third party recruiter without the personal touch one might get from a good third party recruiter.
TripleByte wants that growth rate more than anything else: therefore, this.
I used them two times. The first one was very early on, where I was given a home assignment and interviewed on it by Aaron himself, if I am not mistaken. The dude was awesome at interviewing, and knew exactly how to probe to get a better understanding of your skills.
That was when they were promising that you can interview with them so you don't have to do technical interviews with the companies. I thought it was an awesome concept and could really reshape hiring in the tech industry.
Second time was a couple of years ago, where the model has already changed a bit. Passed the first round and one of the companies that I could interview for was triplebyte themselves.
What a disappointment! The only difference in the interview process than the rest of the companies was that they gave you a laptop and asked you to do practical coding instead of whiteboard generic algorithm solving.
Some of the interviewers themselves were junior members of the stuff with 0 experience in interviewing.
Scheduled a practice interview and the only slot available was ~6AM my time. Nobody showed up and I wasn't informed that they wouldn't be showing up.
After reaching out about it -- they tried to tell me that my interview scored poorly, and that I would need to retry again in a few months. After some back-and-forth they realized both that it was practice interview and that the person didn't show up. So they rescheduled the practice interview.
When the interview did happen -- this was for ML stuff -- the interviewer was just no great. We spent so much time discussing the differences in terms we used -- mine largely coming from University, there's from I'm assuming their formal education -- that much of the interview was wasted. It literally came down to me deriving what we were not agreeing on for them to understand we were talking about the exact same thing.
I then had to reach out several times for my results, I'm assuming due to the fact that you're allotted one practice interview, and technically I had two(?). When I finally got my results I was again informed that my results were not good enough, and I'd need to wait to reapply. I gently informed them that it was practice interview, and the representative apologized their mistake.
When I reviewed my results... the interviewer didn't rate me too well, largely due to our differences in terminology. They also didn't like my coding style -- even though no one has ever complained to me before -- and rated the coding exercise poorly even though I was able to perform what was asked of me.
I just gave up.
Then several months later, I got an email about being TripleByte certified or whatever.
The whole thing was a really bizarre experience.
is that they say they have companies like Apple and TrueCar posting job listings and hiring but they actually never respond and all you get is offers for companies between 10-200 people in size (aka, startups)
People hate overly abstract/CS-focused whiteboard problems (mostly for good reason), isn't practical coding the obvious better alternative?
Also, dissing those who have passed the bar as "engineers who like tests" is disrespectful. When they first launched, passing the bar makes you (in their words) a highly qualified engineer, and now passing the bar means nothing except that you only "like tests"...lol
Fundamentally, I think this invalidates Triplebyte's business model. Companies don't really care if someone passes your tests. They still put you through LC type interviews onsite. They simply save a phone screen.
So while in theory I like the idea of this meritocratic minimum bar granting special privileges (I liked it enough to join Triplebyte!), in practice we seemed to be fighting an uphill battle with all but a few candidates each month.
On the other hand, I have wasted a lot of time in conversations with recruiters only to be let down at the end by mismatched expectations. I'm interested to see if this new approach can make a meaningful difference in that problem.
We still have the quiz, and we still show performance on it prominently on your profile (provided you've chosen to share those scores). In fact, we've put a lot of energy into improving the trust companies place in our quizzes over the past year precisely because we think that skills data is important.
> Also, dissing those who have passed the bar as "engineers who like tests" is disrespectful. When they first launched, passing the bar makes you (in their words) a highly qualified engineer, and now passing the bar means nothing except that you only "like tests"...lol
Heh, yeah, that's fair, at least to a point.
Our quizzes are predictive. We know this from a lot of objective data, it's what you'd expect subjectively, and companies do tell us that they trust and value that data. That does not mean that our tests have no bias towards certain personality types. Different people respond differently to testing, and that does have a differential effect, not because our tests are bad but because testing is inherently somewhat artificial.
I actually taught test prep before joining Triplebyte years ago, so I've been this first-hand: it was not uncommon for a student who'd been doing well in practice sessions to crumple under the pressure of the real thing. That doesn't mean the test is bad, it just means that some people fare better on tests than others for reasons other than just their raw ability. When we say "likes tests", that's more what we mean: not that that's the only reason someone does well on a test, but that people who perform well in isolated, pressured environments do better relative to their skills than others.
I think that goes to another ability. If we need a candidate to gracefully handle a 3 AM production outage, we should expect them to handle an interview.
Tell HN: Interviewed with Triplebyte? Your profile is about to become public (1543 points) https://news.ycombinator.com/item?id=23279837
Tell HN: Triplebyte reverses, emails apology (1030 points) https://news.ycombinator.com/item?id=23303037
Because she fucking nailed it with Triplebyte.
I used Triplebyte. I really liked it. The leads were not as great or as numerous as I was hoping, and I felt like I still had to do pseudo-technical interviews anyway. Fucking COVID, man.
I hope this pivot works for them.
> Triplebyte has hundreds of thousands of engineers on our platform, and that means we can flip the script on companies. The collective power of thousands of engineers is enough to change their incentives in a way that individual engineers cannot.
> We can change their incentives directly by rewarding or punishing certain behavior. For example, companies aren’t normally incentivized to provide salary and culture data. But we can force their hand by promoting transparent companies in our search rankings. When a company’s access to thousands of engineers is on the line, their incentives are very different. The same goes for honesty: a company often has no reason to be honest with any one engineer, but we can disincentivize lying by making their behavior with one engineer affect their access to the next.
So... a union? In digital, online format?
I'm glad that someone there is now realising the advantages of joining forces to negotiate workers' conditions. It was about time high-tech engineers noticed this.
So hiring through TripleByte would be conducted in some fixed-length time intervals (e.g. 1 month). Companies specify skills they're hiring for, interested engineers interview for the skills that TripleByte can screen for and supply a minimum salary (invisible to companies), and companies hiring that month bid starting at the min salary for the engineer with all other hiring companies.
If the market determines the hiring timeline, recruiters can't put you on hold if they're interested-but-not-sure, and can't use exploding offer tactics. It also pushes companies to be more honest about salary ranges and required skills. TripleByte would be responsible for providing feedback rather than the companies.
I found an awesome startup to work at. And now, years later, I work at a FAANG company, working on tons of interesting problems. Thank you triplebyte, and good luck with the pivot!
I love this, but I'm curious about the incentives here. Triplebyte only makes money from companies, not engineers. In the long run, can engineer-centric intentions override a business model based around companies and recruiters staying happy? I hope so!
https://news.ycombinator.com/item?id=27501675
Our bet is that LinkedIn is going to fragment. They are just not creating a hiring process that most engineers like. People tend to either get ghosted, or overwhelmed with low-relevance inbound (almost no one gets the "right" amount of attention). Companies need to go where the best engineers are, not the other way around. So I think our long-term incentive is to fix these problems.
In any case, I'm committed to giving this a try. There is danger that we get pulled toward building for companies. I want top guard against this by being public about what we're doing, and "showing our work" as we go.
Triplebyte has always seemed scummy and this obvious--and unacknowledged--contradiction makes me trust them even less.
On the other hand, when I applied to TripleByte, their feedback to me was "we think your skills are fine, but we want somebody who can perform well in an interview". Which is exactly the opposite of the value you're attributing to them here.
Quoting them, for reference:
> We really appreciate you taking the time to work on the take home project. We're aware this requires a substantial time commitment and we are really grateful that you invested the time in completing it. We thought you wrote a great, very full featured regular expression matcher. It was especially impressive how much you dug into the academics behind regular languages.
> However we made the decision because we felt that while going through the project together during the interview, we didn't see the fluency of programming when adding to it that we had hoped for. While we specifically designed the take home project track to help overcome the difficulties of coding under time pressure with someone watching, we do still need to see a certain level of programming during the interview.
Edit: just saw the comment that TB is keeping the quiz. Would consider using the platform in the future as long as that pre-qualification track is available and that this new direction is just a superset on the existing TB features.
Do not believe anyone who tells you they can force employers to change their methodology when it comes to salary and compensation revelation. Recruiting agencies are so far outside that wheelhouse that it's damned near scandalous to even pretend the statement has any validity.
Also, I think it's important to differentiate staff recruiters from outside recruiters.
Staff recruiters are HR people. They're on the job to shove square pegs into square holes.
Outside recruiters are salespeople. They're on the job to explain why a round peg can reasonably fit in a square hole.
This is your career. So act like it.
If 10 different people were each going to give you a hundred dollars if you described yourself to them in a way that would obviously ingratiate yourself to them (person with cat photo, person with dog photo, person with photo of their kids, etc) most would immediately come up with reasons to make themselves1 appeal to their tastes.
But people keep on submitting the same dumb resume over and over again and expect a different result. Accentuate the things in your resume that matter to the company you're trying to get a gig at. Yes, for each of them. If you would do it for a grand, you can do it for a career.
1) Look at relative data, not raw ratings. Written reviews or raw numerical scores are what show the nightclub effect the most. What we care about is a ranking of companies (showing the better companies first in search results). This may not be as impacted by the problem. If sour grapes from people who failed interviews overwhelm other signals, we can only look at the scores from people who pass (or normalize the two groups separately).
2) Ask very specific questions (and maybe provide dummy options to attract sour grapes). I suspect that questions like "did this company say they could meet at $250 salary and then offer you less?" will get more accurate answers than "does this company have a toxic culture?". (We do actually want to get culture data, but I want to be really specific about the culture questions we are asking).
3) Use objective facts, not subject opinions. For example, we can tell when a company ghosts a candidate (because they reply through a proxy email that we control). So we're listing the 'ghost rate' for each company.
Maybe this would be useful for folks just starting their career, but on the hiring side of this, in the last year I haven’t made an offer to a candidate who didn’t already have at least one other offer on the table.
Overall I think there are a lot of misconceptions about how people are hired from the recruiter side — which is why most of these platforms see the recruiter as the target customer, not engineers. I get that y’all are trying to change that, but without insight into the hiring practices at any given company (e.g. my company gives a lot of latitude for salary negotiations but every hiring manager negotiated differently) it’s going to be hard to pull a signal from the noise.
That being said, the experienced engineers who can get that kind of attention have other desiderata in their job search beyond just "get an offer". "Get -an- offer" is a goal more typical of a new graduate or someone trying to break into the industry than it is a goal of experienced engineers.
To people who are sure they can get a job, there's a big difference between a 150k offer at a company that has none of the workplace traits they want and a 200k offer at a company that they'd genuinely love to work for. And right now, they can't necessarily tell the difference between those jobs before going through a bunch of application steps. The example we mention in the post - of a highly credentialed and very senior engineer who kept having his time wasted by recruiters who refused to admit that they couldn't offer what he was worth - wasn't cherry-picked. It came up organically while we were doing user research, because it's a really common problem, and was echoed further by a number of other senior engineers we spoke to.
(Of course, we care about the folks just starting their career, too, so I don't want to totally ignore the importance of solving problems for them. But I think we are solving an important problem for senior devs here, too!)
Anecdote: Recruiter R from Company A reaches out to me, we have a conversation and she says HM (hiring manager) loves your profile and wants to talk couple of days later and so we schedule a time slot to talk to HM. Next day, R calls and says HM wants to know why I left a previous employer X and I just blurted out the truth which was that X made it very difficult for me to take FMLA when my kid was born and I got pissed and left. Shortly after this I received a rejection message. This is classic discrimination as defined by EEOC.
I replied to R and said this is discrimination and she denied it. I posted my experience on Glassdoor and my post was flagged and removed. Nowadays I am honest but not truthful.
No response after getting the "wow, nice quiz result" email. No further emails. No replies for months to my gentle inquiries. Eventually they did reply, saying they were sorry but they didn't need help.
I have significant doubts that they were hiring tech interviewers in the first place. I think instead they were gathering market data at our expense.
Furthermore, there were detailed stories from users on Glassdoor about their internal policies and attitudes, mostly painting their leader as lacking scruples and leadership ability. Perhaps this was all fake, but if so it was really convincing and thorough.
I'm curious if anyone has had legitimately good experiences with them.
I have started to re-write my resume for each application and that has yielded much better results in terms of quality of the company and number of interviews.
If you are submitting the same resume to multiple companies, you are doing it wrong.
But glad you figured out an approach that worked for you!
The hiring manager side of me on the other hand continues to remember that mishires are expensive. I've also very skeptical in that once a month some staffing agency comes along, tells us they have some fancy heuristic for matching good candidates to our jobs, and then unleashes a tsunami of mediocre leads into our recruiting database. They'll then proceed to act upset and surprised when we don't want to intervene sixty percent of them and most of those we do interview wash out. I guess TB can somehow promise that a certain baseline technical competence is present, but even that's of moderate value. If I really need a candidate who is skilled at X, I might be willing to sacrifice some skill in Y because I already have two engineers strong in Y. I never found TB sufficiently granular in how you configure the automatic screens to allow for that. Secondly, it's totally useless in soft skill assessment.
The cynic in me just sees a lot of this TB now trying to force you to expend internal resources to rank the unqualified people or people whose skill sets don't align with what you want (forcing you to respond with data on how you handled the application) because they can't crack the nut of doing it themselves. So they're going to leverage the customer's recruiting teams to code the data for them.
I had some bad luck. My nodejs build broke after a recent update on my machine, which I didn't realize until right before the interview. During a test with a different language, I tried to define a constant with the same name as a built-in function and ran into a vague compiler error (something about missing parentheses, ugh). This language has case-insensitive function names to compound the confusion. I unfortunately looked up how to define a constant in the docs. Their conclusion was that "I was uncomfortable in the language," despite having used it for 10 years. There was some other feedback which I felt was inaccurate, I think I just had a bad day, and obviously didn't convey my knowledge and experience well. I could see why a recruiter would hard pass on me for some of the stumbles, since their main goal is to forward candidates who interview well. It hurt to get rejected.
I mean, you went into a combat scenario, and chose a weapon absolutely notorious for jamming.
If a company has a bad interview experience, a bad culture, or the management is impopular, if the work life balance is bad, or anything... you'll be able to read about that in those websites.
For example, a recruiter contacted me last year regarding an opportunity for a fancy senior role at a large company (Sr Staff engineer)... I checked the Glassdoor reviews for that company and found many testimonies from people who were contacted with the exact same narrative, but at the end of the interview process they were offered vastly lower levels, so clearly that was their intention all along. Because of that, I assessed that interviewing there was going to be a waste of my time and I ghosted the recruiter. Developers win.
Of course, you need to take some reviews with a grain of salt, but if everyone is saying the same thing, you will at least have a sample of what you are getting into.
Having said this, I am not sure Triplebyte will ever be able to effectively solve or mitigate the problems Ammon is describing. It is possible that he needs to continue talking to developers, and I am not trying to say this in a rude way. There are also many more problems that need help fixing that Ammon did not describe.
Having a conversation with a developer about different topics can give you some insights on the breadth and depth of the knowledge of a developer, and many interviews omit this. I think interviews should be "adaptive" tests, that get as progressively more difficult until you reach your limit.
I recommended TripleByte to several friends whom I considered reasonably skilled and currently undervalued. None of them passed the test, however, so they got little value out of service (except for the interview feedback, which at the time was unusually excellent). And I ultimately needed TripleByte less than they did, since someone who could pass the old TripleByte test also has a high chance of eventually passing on-sites at Google, Facebook, etc.
So I understand the pivot, although it will certainly be harder to differentiate yourselves in this new space. Good luck.
Triplebyte has existed for, what, 4 years? That actually doesn't sound like very many.
> Triplebyte has hundreds of thousands of engineers on our platform
Hmm.
For unemployed candidates, we should do away with interviews altogether and do paid 2-week trials instead. After the first 2-3 PRs it's pretty clear if someone has the skills you need and to what degree. It would also help the candidate decide if they like the company.
Employed candidates are harder to evaluate and I don't think there's a single formula that will work for every company.
My takeaway from my experience finding a SW engr job was that actual technical capability was really only a second- or third-tier consideration in companies' hiring decisions. (This is often misaligned with the companies' actual business needs, but that's not what materially drives hiring decisions either.) So, although TB nailed TFOO the competence assessment & pre-screening problem, Amdahl's Law still applied to the whole enchilada.
What TB should do is monetize their experience placing candidates over the last 5+ years and just sell training & maybe some standardized SaaS products to HR departments -- especially at startups! -- that regularly need to hire SWEs/SDEs (yes I'm a FAANG-er now). Because the real dysfunction in tech hiring originates & thrives in those departments, and...something about robbing banks because that's where the money is...
That capable people failed to make one solution work, doesn't mean no solution can work. Now they're going to try another.
That's a lot less than I expected.
What am I looking for?
1: I want my skills evaluated in a standard way by some neutral licensing board, just like engineers who build dams or surgeons.
2: I want job interviews based on mutual interest, not proving competency.
3: I want my colleagues to be certified, just like me.
4: I want legal standards in place that give me leverage against employers who are cutting corners, or managers who "know enough to be dangerous."
Example: My wife, a doctor, had to go through an intense process to be certified. The vast majority of medical school graduates pass certification. She only applied for a handful of jobs. The interview was based on mutual interest because the certification process proved she was competent. All her colleagues are competent, and her hospital is well run. There are legal guidelines that make it hard for her hospital to cut corners or make her do something unethical.
For most developers, the worst they can do is bankrupt the company they work for, and even that usually requires multiple compounding screwups and a bad luck roll.
I personally think the gap between our standards for doctoring and our standards for software development makes a lot of sense.
I do think people building life-sustaining software should be held to a higher standard, but that's pretty rare.
Also, are we sure there is a shortage of engineers, or simply a shortage of engineers that can pass the hiring interviews and qualifications?
I think a lot of companies don't always mind waiting to find someone who passes there test, be it a newer grad, or an existing engineers that has now prepped up better.
I still don't understand exactly what benefits it brings to me as a programmer though. I'm about to start preparing for interviews with 25+ years under my belt, after not working for 2 years and I've accepted the double-edges nature of these interviews. I know I need to LeetCode for 3 months to be competitive and memorize as many of the answers as I can. I know that some companies will ghost but others will be forthcoming. I know that in big companies, different teams have different recruiting processes, so it's hard to put an entire company in a single basket.
I have friends at all FAANG, and they are very open with their salaries and TC, so I don't know what Triplebyte would bring to the table besides friction, so be perfectly honest.
In addition, as my username suggests, I really like the idea of a representative for Engineers during the job search process, but I also want to make sure I'm the customer of this representative. If I'm paying TB then I think the incentives are aligned. If they're just a job board then their new stance is opposed to the interests of their true customers (hiring companies) and that won't work out too well for them.
My firend cracked interview and joined one of this and for others like me have no traction (6 months in) on the resume at all after using hired/linkedin/direct careers/cold emails. Doesn't matter you have github with real projects/portfolio with good responsive design .......
If this process is broken and we also don't know what are we doing wrong then how all them are going to find all these talent they need??
The interview itself was nice and ok, the feedback was really appreciated (after all this more or less reflects what high paying programming recruiters are looking for). But I felt like there was no place for people with my background.
I was rejected when I did the quiz at university, trying to get a job.
What made me a bit angry is how happily they rejected me with an automated email, after I put effort and time into doing their quiz... I didn't feel like recommending them, or even visiting the site ever again.
Glad to see they're finally aware of how this approach doesn't benefit them as much as it could of if people were still invited into the system.
What Triplebyte is trying to do is give more information back to job seekers. But it will be limited to the companies they actually work with (and punishing your own clients sounds like a peculiar business model...)
Why not build a Glassdoor for hiring, that would cover the entire industry? Anyone can go and describe the hiring process they went through, if they heard back or not, etc.
Does such a thing already exist? If not, why not?
I felt like Triplebyte worked hard to create a good experience for me, but that overall the companies I interviewed with just viewed TB as another placement company. Other than getting to skip the fairly easy phone screen phase, I didn't feel like I got much value from the experience at all, and I had to put a lot of work into it.
Ever thought of building a recruiting recommendation software product, instead of just selling people? You have the data.
edit: I want to be more constructive with my feedback. You have four years of data on hundreds of thousands of candidates. I don't know what the legal implications are regarding using that stuff as training data, but.. embeddings. doc2vec. Thank me later.
The quizzes weren't quite a fit for ML, nor was the interviewer or job density there for the domain, but the immediate half-hour call with the promise I'd passed a technical screen was extremely efficient, even if Triplebyte lacked any basic level of market liquidity.
I can also report I haven’t received a single TripleByte email since the issue was last brought up :) Thank you for standing by that.
Copying this from the article. Doesn't this sound like a union? Unions generally lead to mediocrity though.
Does this not mean that even if you apply from TripleByte that you now still need to go through FizzBuzz and all that?
So it sounds like the hiring manager can choose to skip a fizzbuzz call when they know you already passed.
Long story short I bear no ill-will towards the people at Triplebyte but will not attempt to use them again.
It's a tricky situation because you have to balance being accepting of people with non-traditional backgrounds while also making sure they can do the basics. I liked that TripleByte could condense DAYS of interviews into a few hours.
In general, long tech screens are hard on people that can't afford to take off a full day, so it's tricky for people already working in crushing jobs that need a change. The TripleByte quiz worked nicely for this.
On the flip side, if their tech screen is filtering people for reasons other than ability, it's removing possibly good candidates who deserve a shot at something.
The new approach is sounding like it's trying to satisfy the latter, which is good for improving inclusivity, but won't be to everyone's liking.
"Triplebyte, to my mind, did an admirable job of trying to solve the credentialing problem. But their approach was not without shortcomings: 1) not everyone wanted to take their lengthy quiz, even though the quiz was well done, and 2) scaling up an army of interviewers, all of whom had to be trained in exactly the same way, was non-trivial and not cheap. These challenges were surmountable, but the challenge that wasn’t arose from the second issue that all companies had to face: lack of candidate autonomy, which was driven in part by a lack of faith in the credential.
Once you passed Triplebyte’s assessment process, just like at Hired, you had to interact with a talent advocate (Triplebyte labeled them “talent managers,” but again they’re just recruiters). The talent manager would examine your background and short-list you for some companies of their choosing, where you’d then go onsite. You could have some input into which companies you spoke to, but it was limited, and if you didn’t meet the company’s (often somewhat arbitrary) criteria, no matter how well you did on the assessment, its doors were closed to you.
As with Hired, having an army of recruiters AND interviewers working for you makes achieving SaaS margins impossible, and then, you’ve essentially become a tech-enabled recruiting firm (albeit this time one with much better performance data!).
Just like Hired, Triplebyte eventually moved away from the auction marketplace model, fired most of their talent managers and interviewers, and fulfilled their destiny, becoming a glorified LinkedIn Recruiter clone. Recruiters could search for candidates, just like on LinkedIn Recruiter, based on their pedigree, languages known, and so forth. One thing Triplebyte still does differently, however, is to leverage their aforementioned coding quiz to annotate candidate profiles. (Presumably, they are using their historical interview data, from when candidates had to do BOTH, to predict how people will perform in interviews.) The limitation, of course, is that great people will be unlikely to take the quiz in the first place, especially now that it no longer fast-tracks them to an onsite."
https://blog.alinelerner.com/ive-been-an-engineer-and-a-recr...
“ In short, there is more demand for engineers than there is supply, and that makes engineers powerful.”
This statement is very telling that TB leaders got tunnel vision, a very SV, startup, software centric tunnel vision. Let me rephrase your statement to what you really meant.
In short, there is more demand for “experienced Software” engineers “in startups “ than there is supply “in Silicon Valley”, and that makes engineers “,with pedigree of FAANG or top schools or well connected,” “very” powerful.
Not that there's not room for another player in the space, but it's just a good example of how to do it well.
So unless there is a simple business model shift to charging the candidates, all of their words are empty. THIS is why they made the mistake of making profiles public, because they were thinking about their customer (THE COMPANIES) and not their product (THE CANDIDATES)
"If you're not paying for it, you're not the customer; you're the product being sold." Tim Oreilly Tweet
Sidebar: Take the Quiz!
Maybe they should rollout the update before announcing it?
The biggest problem with engineering job searches is that they're a huge time sink. I'm a senior engineer with Google on my resume, so I don't have much trouble getting in the door or passing interviews, but the process is such a slog. If I were to take PTO for a week and cram my schedule full of job search, I could probably get 3-4 interview processes done per week. That's not a lot, considering that it's good to line up offers and that many people have limited PTO. Even if your PTO is "unlimited", it looks suspicious to be taking random days off for on-sites.
What this means is that I try to keep doing my job and schedule phone screens and recruiter calls in the gaps when I know I won't get meetings. I try not to have to block time on my work calendar for these in case someone wonders "why does Troy suddenly have so many random meetings all of the sudden". The scheduling process with companies is a pain, they ask for 2-3 time windows for the phone screen, then often take a couple days to pick one. So I have huge time blocks reserved for them that I can't give to other companies I am interviewing with. It's stressful to try to slot all this in. Add to that the fact that recruiters want to do everything over the phone (which is very unnatural for me), so I have to also schedule little interruptions for 15 minute "chats" to "check in" and prepare me for the next round. I appreciate these things but at the same time, I'd appreciate fewer of them.
When it comes to the actual interviews, some companies seem to be fine with one phone screen, some need 2-3. Sometimes they are an hour, sometimes 45 minutes. Some companies see that I work at Google and deduce that I might be competent enough to skip the phone screens entirely. I appreciate that.
It's the same with on-sites. Some are a half day, and some are more of a full day. It's not a big difference in practice because I couldn't really take a half day off from 11-3. Many companies have a "no interview day" which is great for their employees but hard to work around, particularly if it falls on "non-suspicious" PTO days like Monday or Friday. Sometimes I wish we could just do several phone screens instead to make scheduling easier.
I'm not sure how to solve this, but it's the biggest pain point by far and if someone could solve it I would absolutely use their platform. I want fewer phone calls, fewer hours of interviewing, and a clear understanding of the time commitment ahead of time.
I also wish companies would be up front about WLB so I don't waste time interviewing, only to learn they work "maybe 50-55 hours a week". That's not a "little more" than 40 guys, that's more than 6 full work days every week. You can't just ask at the outset because some people perceive that as a red flag.
I can't believe this. I must be a garbage engineer then, because I found the US job market for software engineering roles to be absolutely soul crushingly difficult. I am not the only one, my friends did too.
I have given up several times and then restarted job search. I have been grinding leetcode but companies want nothing less than complete perfection.
I actually thought something like triplebyte would be useful, give a test once and have the score be valid for a couple of years, like a GRE for algos and data structures.
I really don't get it.
The "solution" to the big problem might be a 10 page PDF (for reasonable fee or free) to engineers on how to play the game to their own advantage. Of course no one really profits big from this enough to keep a startups lights on. But if all developers played the game well it helps everyone, even the few that don't play it (like a vaccine).
I wonder what 'fad-diet' solution this company I've never heard of is pitching for either (A) getting me an engineer or (B) getting me a job as an engineer. Oh, let me guess, you're going to find those magical engineers who come from non-traditional backgrounds or magically making it possible to both "identify the top 5% of Ruby on Rails developers with no fewer than 2 years of React Devops Cloud Experience"[0].
Going from that, if you RTA -- I was pretty horrified to hear what they thought would be effective in this space. I realize you'll have to take my word for it that there were literal sentences in there spoken as "good ideas" that would have literally had me thinking "oh, so this company's some form of scam" had I happened upon them before they chose to reverse these ideas. I gotta say, public profiles, entrance exams in an attempt to "hack hiring"[2] don't know what this company is. I have to take everyone's word for it that they're somehow big in this space as I haven't looked for a job, nor been responsible for finding viable job candidates[1], so that's probably me.
I was kind-of torn about his apology. It was really un?-professional (I mean that as a compliment but I can't find a way to say 'not corporate-fake' either in 'sorry-not-sorry', 'deflection' or with what appeared to be much concern for what the lawyers have to say on the subject. I don't know that the lawyers would have to say much on the subject but I'm told that this is often the reason why companies manage always manage to communicate "Sorry,... (assholes...)" every time they apologize. There's always that miserable thing, they're going along "We apologize to our customers ..." it's looking good "... for the inconvenience this outage has caused." Seems simple enough, except you've taken no responsibility -- the outage was to your software, or your hardware, running on wires that you pay for which you are supposed to have redundancy for, and all of this stuff is outside of your core competency but there are many companies who can help if you're willing to spend. And I'm sure when the issue happened, there was a key choice that had you spending a large amount of money and me getting a flight home; which you also chose to inconvenience me over.
But Triplebyte wasn't Southwest. I think the author went a little over the top on the apology, almost crossing into the "trying too hard", except that the things he was apologizing for -- basically, being blind to some pretty obvious problems -- were kind of spot on. Please don't think I'm trying to throw some sort of slant compliment; I realize I sort-of sounded like a dick.
There's no malice in that statement; I've been more blind to things I should have know that were right in front of me than a silly business model decision made too quickly. I am certain I have not apologized this clearly/bluntly.
And the thing of it is, if it hadn't been done so well, I probably would have read the first two paragraphs, closed the tab and made a mental note to never touch them -- basically, having them go from "I don't know who they are" to "probably a scam". It's the risk a company takes when their apology gets attention beyond "people who (currently) care". I am not currently hunting, but I'm all around it on the "need to hire someone" side and I have no guarantee I'll keep my current job, forever.
Thinking about it -- I've now read a very long post and written a very long comment about a company that I had never heard of and upon hearing about them, couldn't care less about their services (the space, yes, deeply). They'll probably be the first address I put into the bar if my needs change in the next year or so because I can't name a single other place I'd actually look. This guy might be an evil genius; if I suddenly have a strong desire to change employment in the next three months, I call witchcraft and there'll be pitch forks and hay, or...something. :)
[0] I must have been in a really bad mood because HN has never been a place that promotes that crap to the level of this post, so that should have been my signal that there was something of value here, and I'm glad I stuck it out.
[1] Mostly only interviewing; we have a pretty spectacular individual who has extensive knowledge about hiring for the rather broadly scoped kinds of work that just my tiny team in the 100-or-so company that employs me. I have a process that, though I am always tweaking, the major points are about as perfect a process. I've commented like this on that subject many times in the past if you want to be super bored. :)
[2] I'm confident in my abilities as a software engineer; push comes to shove, there's many, many ways to make enough money to live reasonably in most parts of the US. I've never had problems making money writing software, either directly for an employer or on contract, independently. Neither my wife nor myself have completed a 4-year degree (though I was one semester away; long story), she did a job that does not require a degree -- became a Realtor -- before we met, six-figures in 2003? I think. The most Senior guys on infrastructure pulled that where I worked (they paid a little under average for the role/area but like 1-2%).
i'm not sure about the viability of their "search criteria" though - things like test coverage, release cadence etc are team specific, so it's hard to define it at a company-level, other than maybe small startups
my advice for triplebyte is to partner with leetcode and establish an industry-wide coding certificate, kind of like those SAT or GRE tests that you pass once and apply everywhere.
Take a look at the question they just asked me when I was doing their General Coding Assessment:
What is the output of the following function? (1m 12s)
function foo(a, b) {
a += 1
b.push(1)
}
const a = 0
const b = []
foo(a, b)
console.log(a, b)The only thing that bugs me about that question is that "the output of the following function" is confusingly worded. It's the sort of question that a competent candidate might get nervous about and start to overthink: wait, that isn't a function, it's a code snippet. The function here is foo – so maybe they mean "what's the output of foo"? But then what does "the output of a function" mean? I suppose they mean return value? Is this a trick question to see if I remember what push returns? Damn it, does it return the entire array or just the pushed element?
That's what my mind usually does with questions like that and I'm far from the only one. Since the goal of the test is to screen for basic competence, it ought not to filter out people who could answer the question perfectly fine if it were being asked clearly, but who also perceive corner cases and ambiguities. Such a skill should make you more likely to pass such a test, not less. Therefore the question ought to say something like "What does the following code snippet write to the console?"
That's a tricky question, and if you're not good enough to understand why they're asking that then you fail!