Just out of curiosity, do you see much difference in quality between the isolated model and the public-facing ones?
But when I had to choose between “2.0 with Google internal knowledge” and “2.5 that knows nothing” the latter was always superior.
The bitter lesson indeed.