Ask HN: Has anyone made the transition from app development to ML/AI work?

I just made the transition in the other direction. I did a Masters in computer vision, then worked at a startup doing computer vision and machine learning work for 2 years. I recently transitioned into app dev.

There are 2 levels to ML/AI, being a researcher and being an engineer. The researcher actually creates new models, architectures, etc. You're going to need to be talented at math, as well as pursue a PhD to have enough time to absorb some subset of the material to have a good understanding. (A masters was good but not enough time for me personally).

Then there is engineering which is leveraging the creations of the very smart PhDs. At least in my experience, the shallow level is basically fine-tuning models to your use case, which does require an understanding of some things like loss functions, train/validation/test sets, but it's not too complicated.

Everyone that asks me how to learn machine learning, I advise them to read Hands on Machine Learning by Aurélien Géron cover to cover. When I first started my masters I did this and it helped immensely because it was easy to understand, was broad, and was interested usually from an application perspective.

From there, I would suggest learning PyTorch (starting w/ Keras is ok too, but don't stay there too long, and avoid Tensorflow), as it's much easier to develop with. I always learn best with a personal project, so maybe see if there is a real life "problem" you'd be interested in solving, like classifying different pets from each other or something like that.

It'll take a while to build up your skills, so going to school is of course an option, but with dedication I think you can also accomplish this solely with side projects and learning on your own. Best of luck!

From my experience, there are plenty of teams in FANG that will hire you as a backend developer in a ML team assuming you can pass their interviews. 90% of the work in these teams is not core ML and is more mundane work supporting these models, such as data piping, cleaning, feature generation, experimentation, and real-time serving. You'll get plenty of experience in working directly with ML systems.

The jump to core ML is a bit trickier. Competing with people with PhD's is a drag. Wish people could also give me some tips there.

As long as you're interacting with it at a decently high level it's honestly really easy code.

I watched a friend of mine who went from maybe some python courses to writing some really impressive ML stuff as her first project within a few months and with some help from some people who know their stuff a bit, which I found pretty impressive. I think as long as you're building things on top of what's available out there that you can find tons of utility in all the solutions that have been coming up in the past years without a ton of effort. Try dipping your toes into something simple like object recognition and you'll find it's pretty easy.

If you're talking about getting into the field on a level where you're actually developing these technologies themselves then I hope your math is around college-level. Reading deeper into the docs of the tools I'm using and they're showing calculus and linear algebra to me. I don't pretend to understand it very well.

The 'field' is rather big, and as with most tech fields, 80% of the work is the same (sometimes mundane) stuff. Infrastructure, CRUD, business logic, the whole 12-factor thing.

Where it would start to get tricky is if you have to do more than 'consume' ML libraries. Everyone can learn how to use a library or API, and getting some training going isn't all that hard either. But if you have to build said library, or come up with a new modelling method, that's where it's a real transition and gets really hard to simply 'switch'. It's also one of those areas where a PhD really helps, not from a "certification-as-entrypass" perspective, but because this gets down to hard science. For most companies, however, that's a point they never reach.

Quit my job in Fintech to work on my own AI startup.

I built https://FakeYou.com as a side project, and it blew up. I quit my job after I realized the potential, added monetization, and started to broaden what we do.

I've been working on https://storyteller.ai for a year and plan to launch our platform soon.

Both of these tool sets reinforce one another.

I'm hiring folks that were engineers that want to do AI instead. Please reach out! Our stack is Rust / Unreal / Pytorch / k8s.

Could you define what you mean when you say :

> Has anyone made the official career pivot to the ML/AI field?

If you're talking about using ML/AI related tools and algorythms and taking advantage of what they can do, maybe for data processing etc then that's not really too hard an ask, infact these days depending on your role there could probably be a natural progression into these areas.

The problem comes from the core of these types of work, so creating the algorithms, building new model, processing the raw data into something that is useful and this involves even being really close to the hardware level too. I find that it's hugely academic and mathematical focused, for obvious reasons.

It's certainly stuff that flies over my head and for me personally no matter how interested I am in it, I don't think it will ever 'click' for me.

So I did a lot of ML work in grad school and have also built 4 iOS apps and two web apps. I can tell you building statistical models is not a very interesting grind, it’s mostly cleaning data and fiddling parameters. It’s also unlikely anyone would hire non-stat/math degreed person to do that stuff. On the other hand you’re prob goood at turning models into a. Usable product. Here’s a recent library to do that in NODE https://github.com/transitive-bullshit/scikit-learn-ts

Not exactly AI/ML, but I had some years of experience in Android, then RoR and engineering management. Then got an MS in Bioinformatics and now do PhD in Medicine. Which is really data analysis of sequencing data. I use some “AI” models as well. I’m doing a PhD at a company, away from the academic institution where I’m formally enrolled. So it’s kind of like a regular job.

But I’ve also seen colleagues pivot into data engineering. They’ve done it within the same company by simply asking, I guess? When there’s a role available and you do your homework there’s a chance to change the field.

I've been doing "full stack" for many years. Until the new GPT came out I thought that I needed to become an expert in ML and had taken some Coursera classes etc.

But now with the general purpose power of the ChatGPT API / OpenAI Embeddings, things like Stable Diffusion, and Eleven Labs, etc., and the expectation of new models coming out that have visual understanding integrated with the large language model, and quite possibly even more intelligence, I don't feel that ML is a good path for me. It makes more sense for me to just leverage the APIs to build applications.

I get the impression that optimized (multimodal) transformer models are going to be readily adaptable to most tasks and so its much less important going forward to do "real research" in order to get results.

As soon as the GPT3 API came out I started experimenting and moving towards launching https://aidev.codes. So now I have quite a bit of experience with prompt engineering for GPT, and a few other AI-related APIs. I am looking to raise money for marketing aidev.codes. If anyone wants to hire me, see the email in my profile.

How different is the compensation between typical backend eng and backend ml eng? Not including designing the model itself as that seems to be the domain of phds it seems

I have yet to make the transition in a paid role, but I quit my backend job to start a startup developing realistic text-to-speech for long-form content.

My approach has been to start at a high-level, with a specific goal in mind, and to progressively go deeper and deeper. The specific goal part has been really helpful IMO. It prevents sort of aimless shuffling about and provides a good metric to see if you're making progress. When I started I was basically just focusing on producing training data and treating the models, which were open-source on GitHub, as a black-box. At this point I've made a lot of modifications to the actual model code itself and I'm learning a ton. There's of course a bunch of adjacent skills that are similar to traditional backend skills, but slightly different. Like autoscaling for example, there aren't many autoscaling solutions for GPU VMs yet, there are some startups working on this space, but IMO it's good to have a rock-solid hosting solution that you don't have to worry about too much.

I opened up the beta of my product just last week at https://bondsynth.ai/signup

The goal is to either have my startup succeed or to move into an ML engineer position at a small-to-medium sized company.

I work at a large university affiliated research center and this is extremely common in my department. Our software devs have to be at least familiar with bleeding edge ML processes and several just in my group of about 60 have gone on to shift to more of an applied research role. We have a bunch of PhDs in math and CS, but no one cares what degree you have if you can produce.

I made the jump and pivoted a bit. My first gig was in enterprise applications and then I made the jump to mobile apps that I developed for 5 years.

I got somewhat lucky as the feature my team owned was powered by ML. After gaining credibility on the mobile side I worked with my manager to make the transition to backend. Did backend for about a year and was fortunate with the timing that my team was launching a new product with a model it owned. I got to work closely with ML engineers on it and eventually I became the DRI of the feature along with the model. After 2 more years I came to the realization that ML was moving a bit faster than I could keep up reading white papers about and decided to pivot to ML Ops. This let me leverage my strengths in distributed computing that I developed, be very close to ML without having to study math in my spare time

I sort of fell backwards into it about 5 years ago -- in the "Give it to Mike, he'll try anything" sense -- I inherited some mangled Jupyter notebook filled with health data, and nobody could make the model work out. Once I figured out the white paper and algorithm they were trying to rip off, it was easy enough to implement and host out as a PKL file with Fast API.

That's sort of what I've been doing since. It's much more interesting than solving botched up React Hooks, but there is about the same ratio of tedium:interesting work. I happen to like math, someone who does not like math... they're gonna go a little batty I think.

I haven't even raised my rates. I'm having enough fun with it.

So I think the answer you're after is either "Luck" or "Masochistic streak" ? :)

Anything and everything is AI/ML today. A few years ago we used to have a product which would keep track of inventory on display shelf (basically how many items are on shelf) and inventory in backroom and based on that math would generate an alert to the store owner if the number of items in backroom were lesser than a threshold. Basic math. That same product is being sold today without a single line of code change as an AI/ML product.

In short, all this AI/ML stuff is just buzzword, ultimately the work you will do in almost all these companies is regular run of the mill work nowhere related to ML or AI

I'm a full stack contractor. Been following generative AI since late last year. Picked up an AI startup gig in early January. Launched a couple weeks ago. Building out the client, API, server, and orchestrating the AI image generation pipeline plus Dreambooth. Choosing an AI GPU provider (or 3), solving prompt issues, figuring out model settings, making sure it can scale. A lot of the models are all comoditized on providers like Replicate which makes it like any other API based project. AI knowledge is still very useful to know what settings to use with the models though.

OpenAI has their residency program: https://openai.com/blog/openai-residency

One concrete example we're hiring in: We're looking for a cleared security / SIEM engineer in Australia to help build out GPU/AI SOC tech. As long as they love Python and modern bits like scaling detection engineering & automation, they'll be learning the GPU & AI side pretty darn fast :)

you can do anything if you are able to convince your interviewer that hiring you will work out. I transitioned from web dev to data science by getting a VP of data science to work with me as lead engineer on their projects then studying in my free time and doing well on data science interviews to get a lead data scientist position. I went back to software engineering and now I am thinking about the same as you are. I will leverage my Data Science background, study, and do some ML projects. That should make me competitive in interviews and I expect to transition by the end of the year.

I've gone back and forth. On the other hand, I have a Physics PhD.

I've been thinking of this as well, though I'm a Java guy.

Not I, although I tried.

All the ML engineers I have encountered thus far have a Ph.D in physics or math. No way I can compete with that level of education!

> I think I've gotten too bored with the same challenges that app development presents.

Building the thing isn't supposed to be the challenge.

I am in the process of making this transition now.

I joined Grab.com on their Safety team and started working on their face recognition technologies. This got my feet wet in ML. Now I am leading their content moderation efforts.

TL;DR: Find an "ML adjacent" engineering role and take on ML/AI work.

"ML adjacent" roles could be, content moderation, safety, ads, and search.