DidISayTooMuch

Who provides cheapest GPU inferencing and hosting of fine-tuned models (7B size)? I already have the finetuned model ready, just looking for a cheap place to host and run inferencing.

I've looked at Replicate and Together.ai, they both provide really the best tools in this space, but hosting is expensive. Together costs about 1.4/hr to host a 7B model. Replicate is more expensive.

Ideally, I wouldn't be charged for idle time and only active time (replicate does this already, but your finetuned model needs to be based off of a limited set of base models)

Any recommendations?

If it's all just tensors, matrices, and math behind them, then how do these chatbots have distinct personalities?

One possible explanation is that the personality is just an emergent phenomenon. But still, it seems distinct and very human like. Not something random. Could it be that Bing's Sydney personality is just because someone fed it a large data of text which served as the "seed" for that personality? Or did this personality seemingly arise out of nowhere?

The Google engineer who made headlines last year also claimed LaMDA had emotions and a personality.

We're all remote and planning to have a social hour once a week or once every two weeks. Previously we did a life review where people had to walk through some of the events in the life. This was fun.

Any other ideas? No, we are not allowed to spend money on this. Themes/ideas for a recurring social hour would be great. Thanks.

I recently got an offer for senior software engineer (E5) at Facebook. I'm excited, but I'm concerned about WLB at FB. It seems that the consensus is that work life at FB is very demanding.

I'm interested in hearing any personal experience that is counter to this narrative from the folks who work at FB. Are you working 40 hours or less at FB? I wanna know.

Can I expect Google or Microsoft level of WLB at FB? If so, which teams are the best for this?

I've heard that California taxes capital gains if you had ever been in the state even if you don't live there anymore?

I have some stock options for a non public company (series B), should I vest them while I'm in CA or should I move elsewhere first and then vest to avoid some cryptic CA tax?