ericlamb89

I’m interested in how AI progress is currently evaluated and trying to build a list of the major approaches people actually use.

I’m aware that all of these measures have limitations and that many are controversial or imperfect. My goal is discovery and understanding, not to defend or attack any particular framework.

I’d love to hear:

- What measures, benchmarks, or methodologies you think belong on this list

- What you see as their key strengths and failure modes

- How (or whether) you personally use them to interpret AI progress

I’m interested in how AI progress is currently evaluated and trying to build a list of the major approaches people actually use.

I’m aware that all of these measures have limitations and that many are controversial or imperfect by design. I’m not assuming they’re “good” or that they cleanly map to real-world capability.

I’d love to hear:

- What measures, benchmarks, or methodologies you think belong on this list

- What you see as their key strengths and failure modes

- How (or whether) you personally use them to interpret AI progress

My goal here is discovery and understanding, not to defend or attack any particular framework.

There’s no shortage of AI announcements, startups, and benchmarks but less clarity on where it’s making a meaningful difference in practice.

What’s the most concrete, sustained value you’ve seen AI create? Modest examples are welcome.

Could be:

Better outcomes for customers or users

Work that’s now possible (or enjoyable) that wasn’t before

Scientific, educational, or social impact

Revenue, margin, or productivity gains

When I graduated from college, I was completely unprepared to work in the "real world". I had some technical skills from classes, but I didn't have any working experience, so I was quite lost. Things we take for granted like email/calendar/to-do management were new to me. I learned these on the job as well as other things like using excel, working with data, effective presenting, etc. Now I'm managing a lot of new grads and I want to help them learn these things faster than I did.

I'm curious on peoples' thoughts around any of these: 1. Have others had this experience? 2. How did you learn how to operate in the working world? What we were some of the most important skills, mental models, etc that helped you succeed? 3. Has anyone experienced any effective "bootcamp" style training programs that help new grads or even experienced knowledge workers level up in these areas?

Hi! I'm looking for resources or ideas on the best ways to track app reliability (primarily for B2B web apps). I'm not even sure if "reliability" is what I'm looking for, but I want to understand how frequently a user is able to use my app without running into a problem and track over time.

I lead a team that needs to communicate with various stakeholders (usually in writing). I've noticed a number of issues in their writing:

1. Too wordy 2. Filled with jargon or "fancy-sounding" words that obscure their meaning 3. A lot of passive voice 4. Poor logic. Not sure if "logic" is the right word but it goes something like this: failing to see the difference between "the platform cannot do X" and "the platform can ONLY do Y".

Has anyone had any success improving the emails, docs, etc of their team? Any tips, links, etc are appreciated.