undefined | Better HN

0 pointsWowfunhappy10mo ago0 comments

...no? They also use web crawlers.

0 comments

The datasets are collected using web crawlers, but that doesn’t tell us anything about how they are stored and re-distributed, right?

Why would you store the data after training?

Are you saying that you know they don’t store the data after training?

I’d just assume they did because—why scrape again if you want to train a new model? But if you know otherwise, I’m not tied to this idea.

j / k navigate · click thread line to collapse

The datasets are collected using web crawlers, but that doesn’t tell us anything about how they are stored and re-distributed, right?

Why would you store the data after training?

Are you saying that you know they don’t store the data after training?

I’d just assume they did because—why scrape again if you want to train a new model? But if you know otherwise, I’m not tied to this idea.

j / k navigate · click thread line to collapse