Arcee AI Trinity Mini and Nano – US based open weight models (opens in new tab)

(arcee.ai)

4 pointsBarakWidawsky3mo ago3 comments

3 comments

If the performance is comparable to Qwen3 in practice that's quite impressive.

Half the dataset being synthetic is interesting. I wonder what that actually means. They say that Datology needed 2048 H100s to generate the synthetic data. Does that mean they were generating data using other open weight LLMs? Seems like that would undermine the integrity of a "US based" dataset.

davidsainez3mo ago

Why would that undermine its integrity? AFAICT there are a selection of "open" US-based LLMs to choose from: Google's Gemma, Microsoft's Phi, Meta's LLAMA, and OpenAI's GPT-OSS. With Phi licensed under MIT and GPT-OSS under Apache 2.

sosodev3mo ago

Because at that point you don't know where the data came from. You could be training on foreign propaganda without realizing it.

Presumably they wouldn't be training on synthetic data produced by anything less than a open frontier model and those are almost exclusively Chinese

j / k navigate · click thread line to collapse

3 comments

sosodev3mo ago

If the performance is comparable to Qwen3 in practice that's quite impressive.

davidsainez3mo ago

sosodev3mo ago

Because at that point you don't know where the data came from. You could be training on foreign propaganda without realizing it.

Presumably they wouldn't be training on synthetic data produced by anything less than a open frontier model and those are almost exclusively Chinese

j / k navigate · click thread line to collapse