|
Post by Jason on Mar 24, 2022 3:41:23 GMT -8
Sad to report that the PostgreSQL database running on my RPi4 cluster has become corrupted. I had intended to pare down the database to holding only the last 32 days of data but other things distracted me from tackling that effort.
The table holding readings for my WeatherRack 2, SkyWeather2, eight indoor sensors, and SolarMax2 is going to require truncation in order to rebuild. Since I capture all good readings, I have substantially more data than a normal SkyWeather2 setup in MariaDB. The truncation will remove ~8.3M records from the last two years or so of operation!
Alas, the need to rebuild brings my original plans back to the present. Several months ago I setup Hadoop on a RPi4 for the purposes of receiving the archived data. I got as far as standing up Hadoop, but never got as far as actually moving the data over. More adventures ahead as I bring my next monster to life!
Thanks,
Jason
|
|
|
Post by SDL on Mar 24, 2022 7:54:32 GMT -8
Hi Jason,
Sorry to hear that! Loss of data is always bad.
Students up at the University of Idaho are converting SKyWeather2 to use MongoDB for extra spice!
BP
|
|
|
Post by Jason on Mar 24, 2022 9:14:01 GMT -8
Nice! MongoDB is fantastic for JSON data!
Thanks,
Jason
|
|