Git Version Controlled Datasets in S3 (opens in new tab)

(underhive.in)

2 pointssatuke2y ago1 comments

1 comments

I was using DVC (https://dvc.org/) for some time to help solve this but it was getting hard to manage the storage connections and I would run into cache issues a lot, but this solves it using git-lfs itself.

j / k navigate · click thread line to collapse

Git Version Controlled Datasets in S3 (opens in new tab)

(underhive.in)

2 pointssatuke2y ago1 comments

1 comments

satukeOP2y ago

I was using DVC (https://dvc.org/) for some time to help solve this but it was getting hard to manage the storage connections and I would run into cache issues a lot, but this solves it using git-lfs itself.

j / k navigate · click thread line to collapse