undefined | Better HN

0 pointstudelo7y ago0 comments

Where are you getting this weather data?

0 comments

All over. It's not strictly weather data, either. The majority of the data comes from programs within DSCOVR, LPDAAC, NASA, NOAA, NCDC, USGS, ARGO, CDC, CDIAC ORNL, DOE, EIA, EPA, FDA, EOSWEB, USFS, PHMSA and USDA. The snapshots I have are already around 50TB; I'm working on setting up updates at daily resolution for each of these sources, documenting it all and transforming it into something queryable.

tudeloOP7y ago

Is there a possibility that there is just too much data for one person to handle in a meaningful way?

throwawaymath7y ago

Of course, that may very well be a possibility. In that case I'll have to scale up the effort.

j / k navigate · click thread line to collapse

0 comments

throwawaymath7y ago

tudeloOP7y ago

Is there a possibility that there is just too much data for one person to handle in a meaningful way?

throwawaymath7y ago

Of course, that may very well be a possibility. In that case I'll have to scale up the effort.

j / k navigate · click thread line to collapse