I just gave it a screenshot of yesterday's meals pulled from MyFitnessPal, told it to respond ONLY in JSON, and to calculate the macro nutrient profile of the screenshot.

It flat out refused. It said, "I can't. I'm only an LLM" but the upload worked fine.

I was expecting it to fail maybe on the JSON formatting, or maybe be slightly off on some of the macros, but outright refusal isn't a good look.

FWIW, I used GPT-4 to stitch together tiles into a spritesheet, modify the colors, and give me a download link yesterday. The macros calculation was trivial for GPT-4.

The gap in abilities makes this feel non-viable for a lot of the uses that currently impress me, but I'm going to keep poking.