Prev
Index
Next
centroid_dashboard: Fri Jun 26 13:18:07 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Fri Jun 26 13:18:07 2026 |
No errors
File contents:
2026-06-26 13:16:23,361 main: Processing from 2026:170:17:16:23.360 to 2026:177:17:16:23.360
2026-06-26 13:16:35,123 get_observations: Found observation 30246 at 2026:170:18:40:30.716 with 1 manvrs
2026-06-26 13:16:35,123 get_observations: Found observation 31401 at 2026:171:01:07:52.870 with 1 manvrs
2026-06-26 13:16:35,124 get_observations: Found observation 32393 at 2026:171:07:42:25.675 with 1 manvrs
2026-06-26 13:16:35,124 get_observations: Found observation 30005 at 2026:171:13:33:00.443 with 1 manvrs
2026-06-26 13:16:35,125 get_observations: Found observation 41399 at 2026:171:18:08:30.037 with 1 manvrs
2026-06-26 13:16:35,125 get_observations: Found observation 41398 at 2026:171:19:52:48.715 with 1 manvrs
2026-06-26 13:16:35,126 get_observations: Found observation 41397 at 2026:171:21:35:55.221 with 1 manvrs
2026-06-26 13:16:35,126 get_observations: Found observation 41396 at 2026:172:03:55:40.252 with 1 manvrs
2026-06-26 13:16:35,126 get_observations: Found observation 41395 at 2026:172:05:00:25.498 with 1 manvrs
2026-06-26 13:16:35,127 get_observations: Found observation 30251 at 2026:172:06:10:51.305 with 1 manvrs
2026-06-26 13:16:35,127 get_observations: Found observation 32392 at 2026:172:11:33:00.045 with 1 manvrs
2026-06-26 13:16:35,128 get_observations: Found observation 32396 at 2026:172:14:58:16.569 with 1 manvrs
2026-06-26 13:16:35,128 get_observations: Found observation 30428 at 2026:172:19:12:27.108 with 1 manvrs
2026-06-26 13:16:35,128 get_observations: Found observation 30223 at 2026:173:00:44:32.920 with 1 manvrs
2026-06-26 13:16:35,129 get_observations: Found observation 30132 at 2026:173:09:40:25.170 with 1 manvrs
2026-06-26 13:16:35,129 get_observations: Found observation 30249 at 2026:173:14:32:01.834 with 1 manvrs
2026-06-26 13:16:35,130 get_observations: Found observation 32405 at 2026:173:19:23:39.816 with 1 manvrs
2026-06-26 13:16:35,130 get_observations: Found observation 32407 at 2026:174:00:15:18.040 with 1 manvrs
2026-06-26 13:16:35,130 get_observations: Found observation 30134 at 2026:174:04:50:09.625 with 1 manvrs
2026-06-26 13:16:35,131 get_observations: Found observation 41394 at 2026:174:09:34:39.704 with 1 manvrs
2026-06-26 13:16:35,131 get_observations: Found observation 41393 at 2026:174:12:55:40.252 with 1 manvrs
2026-06-26 13:16:35,132 get_observations: Found observation 41392 at 2026:174:14:55:40.252 with 1 manvrs
2026-06-26 13:16:35,132 get_observations: Found observation 41391 at 2026:174:18:25:40.252 with 1 manvrs
2026-06-26 13:16:35,133 get_observations: Found observation 30061 at 2026:174:21:28:10.532 with 1 manvrs
2026-06-26 13:16:35,133 get_observations: Found observation 31402 at 2026:175:03:30:52.215 with 1 manvrs
2026-06-26 13:16:35,133 get_observations: Found observation 31403 at 2026:175:10:39:35.400 with 1 manvrs
2026-06-26 13:16:35,134 get_observations: Found observation 31405 at 2026:175:17:44:45.401 with 1 manvrs
2026-06-26 13:16:35,134 get_observations: Found observation 31406 at 2026:176:00:49:55.401 with 1 manvrs
2026-06-26 13:16:35,135 get_observations: Found observation 31611 at 2026:176:08:04:17.279 with 1 manvrs
2026-06-26 13:16:35,135 get_observations: Found observation 30512 at 2026:176:10:14:45.557 with 1 manvrs
2026-06-26 13:16:35,136 get_observations: Found observation 41390 at 2026:176:23:41:47.248 with 1 manvrs
2026-06-26 13:16:35,136 get_observations: Found observation 41389 at 2026:177:00:55:40.252 with 1 manvrs
2026-06-26 13:16:35,136 get_observations: Found observation 41388 at 2026:177:03:25:40.252 with 1 manvrs
2026-06-26 13:16:35,137 get_observations: Found observation 41387 at 2026:177:07:25:40.252 with 1 manvrs
2026-06-26 13:16:35,137 get_observations: Found observation 41386 at 2026:177:09:55:40.252 with 1 manvrs
2026-06-26 13:16:35,138 get_observations: Found observation 31483 at 2026:177:13:31:23.009 with 1 manvrs
2026-06-26 13:16:35,138 main: Found 36 observations
2026-06-26 13:16:35,138 main: ********************************************************************************
2026-06-26 13:16:35,138 main: Processing observation 30246
2026-06-26 13:16:35,138 main: ********************************************************************************
2026-06-26 13:16:35,144 obs_link_from_info: Found prev obsid 32394
2026-06-26 13:16:35,148 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,150 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,156 process_obs: ObsID 30246 already processed, skipping
2026-06-26 13:16:35,156 main:
2026-06-26 13:16:35,156 main: ********************************************************************************
2026-06-26 13:16:35,156 main: Processing observation 31401
2026-06-26 13:16:35,156 main: ********************************************************************************
2026-06-26 13:16:35,157 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,158 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,162 process_obs: ObsID 31401 already processed, skipping
2026-06-26 13:16:35,162 main:
2026-06-26 13:16:35,162 main: ********************************************************************************
2026-06-26 13:16:35,162 main: Processing observation 32393
2026-06-26 13:16:35,162 main: ********************************************************************************
2026-06-26 13:16:35,163 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,165 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,169 process_obs: ObsID 32393 already processed, skipping
2026-06-26 13:16:35,169 main:
2026-06-26 13:16:35,169 main: ********************************************************************************
2026-06-26 13:16:35,169 main: Processing observation 30005
2026-06-26 13:16:35,169 main: ********************************************************************************
2026-06-26 13:16:35,170 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,172 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,176 process_obs: ObsID 30005 already processed, skipping
2026-06-26 13:16:35,176 main:
2026-06-26 13:16:35,176 main: ********************************************************************************
2026-06-26 13:16:35,176 main: Processing observation 41399
2026-06-26 13:16:35,176 main: ********************************************************************************
2026-06-26 13:16:35,177 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,178 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,184 process_obs: ObsID 41399 already processed, skipping
2026-06-26 13:16:35,184 main:
2026-06-26 13:16:35,184 main: ********************************************************************************
2026-06-26 13:16:35,184 main: Processing observation 41398
2026-06-26 13:16:35,184 main: ********************************************************************************
2026-06-26 13:16:35,185 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,186 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,191 process_obs: ObsID 41398 already processed, skipping
2026-06-26 13:16:35,191 main:
2026-06-26 13:16:35,191 main: ********************************************************************************
2026-06-26 13:16:35,191 main: Processing observation 41397
2026-06-26 13:16:35,191 main: ********************************************************************************
2026-06-26 13:16:35,192 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,193 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,199 process_obs: ObsID 41397 already processed, skipping
2026-06-26 13:16:35,199 main:
2026-06-26 13:16:35,199 main: ********************************************************************************
2026-06-26 13:16:35,199 main: Processing observation 41396
2026-06-26 13:16:35,199 main: ********************************************************************************
2026-06-26 13:16:35,203 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,207 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,210 process_obs: ObsID 41396 already processed, skipping
2026-06-26 13:16:35,210 main:
2026-06-26 13:16:35,210 main: ********************************************************************************
2026-06-26 13:16:35,210 main: Processing observation 41395
2026-06-26 13:16:35,210 main: ********************************************************************************
2026-06-26 13:16:35,212 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,213 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,222 process_obs: ObsID 41395 already processed, skipping
2026-06-26 13:16:35,222 main:
2026-06-26 13:16:35,222 main: ********************************************************************************
2026-06-26 13:16:35,222 main: Processing observation 30251
2026-06-26 13:16:35,222 main: ********************************************************************************
2026-06-26 13:16:35,224 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,228 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,231 process_obs: ObsID 30251 already processed, skipping
2026-06-26 13:16:35,231 main:
2026-06-26 13:16:35,231 main: ********************************************************************************
2026-06-26 13:16:35,231 main: Processing observation 32392
2026-06-26 13:16:35,231 main: ********************************************************************************
2026-06-26 13:16:35,232 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,233 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,237 process_obs: ObsID 32392 already processed, skipping
2026-06-26 13:16:35,237 main:
2026-06-26 13:16:35,237 main: ********************************************************************************
2026-06-26 13:16:35,238 main: Processing observation 32396
2026-06-26 13:16:35,238 main: ********************************************************************************
2026-06-26 13:16:35,239 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,240 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,244 process_obs: ObsID 32396 already processed, skipping
2026-06-26 13:16:35,244 main:
2026-06-26 13:16:35,244 main: ********************************************************************************
2026-06-26 13:16:35,244 main: Processing observation 30428
2026-06-26 13:16:35,244 main: ********************************************************************************
2026-06-26 13:16:35,245 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,246 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-26 13:16:35,253 process_obs: ObsID 30428 already processed, skipping
2026-06-26 13:16:35,253 main:
2026-06-26 13:16:35,253 main: ********************************************************************************
2026-06-26 13:16:35,253 main: Processing observation 30223
2026-06-26 13:16:35,253 main: ********************************************************************************
2026-06-26 13:16:35,254 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,259 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 13:16:35,267 process_obs: ObsID 30223 already processed, skipping
2026-06-26 13:16:35,267 main:
2026-06-26 13:16:35,267 main: ********************************************************************************
2026-06-26 13:16:35,267 main: Processing observation 30132
2026-06-26 13:16:35,267 main: ********************************************************************************
2026-06-26 13:16:35,268 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,269 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 13:16:35,273 process_obs: ObsID 30132 already processed, skipping
2026-06-26 13:16:35,273 main:
2026-06-26 13:16:35,273 main: ********************************************************************************
2026-06-26 13:16:35,273 main: Processing observation 30249
2026-06-26 13:16:35,273 main: ********************************************************************************
2026-06-26 13:16:35,274 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,275 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 13:16:35,280 process_obs: ObsID 30249 already processed, skipping
2026-06-26 13:16:35,281 main:
2026-06-26 13:16:35,281 main: ********************************************************************************
2026-06-26 13:16:35,281 main: Processing observation 32405
2026-06-26 13:16:35,281 main: ********************************************************************************
2026-06-26 13:16:35,282 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,285 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 13:16:35,294 process_obs: ObsID 32405 already processed, skipping
2026-06-26 13:16:35,294 main:
2026-06-26 13:16:35,294 main: ********************************************************************************
2026-06-26 13:16:35,294 main: Processing observation 32407
2026-06-26 13:16:35,294 main: ********************************************************************************
2026-06-26 13:16:35,299 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,300 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 13:16:35,305 process_obs: ObsID 32407 already processed, skipping
2026-06-26 13:16:35,305 main:
2026-06-26 13:16:35,305 main: ********************************************************************************
2026-06-26 13:16:35,305 main: Processing observation 30134
2026-06-26 13:16:35,305 main: ********************************************************************************
2026-06-26 13:16:35,307 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,308 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 13:16:35,313 process_obs: ObsID 30134 already processed, skipping
2026-06-26 13:16:35,313 main:
2026-06-26 13:16:35,313 main: ********************************************************************************
2026-06-26 13:16:35,313 main: Processing observation 41394
2026-06-26 13:16:35,313 main: ********************************************************************************
2026-06-26 13:16:35,315 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,319 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 13:16:35,326 process_obs: ObsID 41394 already processed, skipping
2026-06-26 13:16:35,326 main:
2026-06-26 13:16:35,326 main: ********************************************************************************
2026-06-26 13:16:35,326 main: Processing observation 41393
2026-06-26 13:16:35,326 main: ********************************************************************************
2026-06-26 13:16:35,327 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,329 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 13:16:35,335 process_obs: ObsID 41393 already processed, skipping
2026-06-26 13:16:35,335 main:
2026-06-26 13:16:35,335 main: ********************************************************************************
2026-06-26 13:16:35,335 main: Processing observation 41392
2026-06-26 13:16:35,335 main: ********************************************************************************
2026-06-26 13:16:35,336 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,339 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 13:16:35,342 process_obs: ObsID 41392 already processed, skipping
2026-06-26 13:16:35,342 main:
2026-06-26 13:16:35,342 main: ********************************************************************************
2026-06-26 13:16:35,342 main: Processing observation 41391
2026-06-26 13:16:35,342 main: ********************************************************************************
2026-06-26 13:16:35,343 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,346 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 13:16:35,349 process_obs: ObsID 41391 already processed, skipping
2026-06-26 13:16:35,349 main:
2026-06-26 13:16:35,349 main: ********************************************************************************
2026-06-26 13:16:35,349 main: Processing observation 30061
2026-06-26 13:16:35,349 main: ********************************************************************************
2026-06-26 13:16:35,350 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,353 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 13:16:35,357 process_obs: ObsID 30061 already processed, skipping
2026-06-26 13:16:35,358 main:
2026-06-26 13:16:35,358 main: ********************************************************************************
2026-06-26 13:16:35,358 main: Processing observation 31402
2026-06-26 13:16:35,358 main: ********************************************************************************
2026-06-26 13:16:35,359 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 13:16:35,362 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:16:40,247 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31402/centroid_resids.pkl
2026-06-26 12:16:40,265 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-26 12:16:40,265 plot_crs_time: Plot file exists, skipping
2026-06-26 12:16:40,267 plot_crs_scatter: Plot file exists, skipping
2026-06-26 12:16:43,408 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31402/n_kalman_delta_roll.png
2026-06-26 12:16:47,087 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31402/index.html
2026-06-26 12:16:47,108 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31402/info.json
2026-06-26 12:16:47,120 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31402/index.html
2026-06-26 12:16:47,121 main:
2026-06-26 12:16:47,122 main: ********************************************************************************
2026-06-26 12:16:47,122 main: Processing observation 31403
2026-06-26 12:16:47,122 main: ********************************************************************************
2026-06-26 12:16:47,123 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 12:16:47,124 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:16:50,184 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31403/centroid_resids.pkl
2026-06-26 12:16:50,190 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-26 12:16:50,190 plot_crs_time: Plot file exists, skipping
2026-06-26 12:16:50,191 plot_crs_scatter: Plot file exists, skipping
2026-06-26 12:16:51,388 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31403/n_kalman_delta_roll.png
2026-06-26 12:16:51,663 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31403/index.html
2026-06-26 12:16:51,667 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31403/info.json
2026-06-26 12:16:51,682 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31403/index.html
2026-06-26 12:16:51,683 main:
2026-06-26 12:16:51,683 main: ********************************************************************************
2026-06-26 12:16:51,683 main: Processing observation 31405
2026-06-26 12:16:51,683 main: ********************************************************************************
2026-06-26 12:16:51,684 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 12:16:51,685 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:16:54,926 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31405/centroid_resids.pkl
2026-06-26 12:16:54,934 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-26 12:16:54,934 plot_crs_time: Plot file exists, skipping
2026-06-26 12:16:54,935 plot_crs_scatter: Plot file exists, skipping
2026-06-26 12:16:56,055 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31405/n_kalman_delta_roll.png
2026-06-26 12:16:56,220 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31405/index.html
2026-06-26 12:16:56,222 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31405/info.json
2026-06-26 12:16:56,242 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31405/index.html
2026-06-26 12:16:56,243 main:
2026-06-26 12:16:56,243 main: ********************************************************************************
2026-06-26 12:16:56,243 main: Processing observation 31406
2026-06-26 12:16:56,243 main: ********************************************************************************
2026-06-26 12:16:56,245 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 12:16:56,246 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:16:59,066 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-26 12:16:59,714 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31406/centroid_resids.pkl with 5 slots
2026-06-26 12:16:59,778 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31406/centroid_resids_time.png
2026-06-26 12:17:00,312 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31406/centroid_resids_scatter.png
2026-06-26 12:17:01,489 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31406/n_kalman_delta_roll.png
2026-06-26 12:17:01,646 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31406/index.html
2026-06-26 12:17:01,648 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31406/info.json
2026-06-26 12:17:01,651 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31406/index.html
2026-06-26 12:17:01,652 main:
2026-06-26 12:17:01,653 main: ********************************************************************************
2026-06-26 12:17:01,653 main: Processing observation 31611
2026-06-26 12:17:01,653 main: ********************************************************************************
2026-06-26 12:17:01,654 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 12:17:01,655 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:17:04,922 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-26 12:17:05,498 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31611/centroid_resids.pkl with 5 slots
2026-06-26 12:17:05,541 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31611/centroid_resids_time.png
2026-06-26 12:17:05,793 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31611/centroid_resids_scatter.png
2026-06-26 12:17:06,586 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31611/n_kalman_delta_roll.png
2026-06-26 12:17:06,731 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31611/index.html
2026-06-26 12:17:06,732 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31611/info.json
2026-06-26 12:17:06,735 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31611/index.html
2026-06-26 12:17:06,736 main:
2026-06-26 12:17:06,736 main: ********************************************************************************
2026-06-26 12:17:06,736 main: Processing observation 30512
2026-06-26 12:17:06,736 main: ********************************************************************************
2026-06-26 12:17:06,737 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 12:17:06,738 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:17:09,640 __init__: ObsID 30512 has insufficient telemetry, skipping
2026-06-26 12:17:09,640 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30512/index.html
2026-06-26 12:17:09,645 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/30512/info.json
2026-06-26 12:17:09,646 main:
2026-06-26 12:17:09,646 main: ********************************************************************************
2026-06-26 12:17:09,646 main: Processing observation 41390
2026-06-26 12:17:09,646 main: ********************************************************************************
2026-06-26 12:17:09,648 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 12:17:09,649 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:17:13,182 __init__: ObsID 41390 has insufficient telemetry, skipping
2026-06-26 12:17:13,184 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41390/index.html
2026-06-26 12:17:13,202 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41390/info.json
2026-06-26 12:17:13,219 main:
2026-06-26 12:17:13,219 main: ********************************************************************************
2026-06-26 12:17:13,219 main: Processing observation 41389
2026-06-26 12:17:13,219 main: ********************************************************************************
2026-06-26 12:17:13,231 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 12:17:13,255 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:17:16,328 __init__: ObsID 41389 has insufficient telemetry, skipping
2026-06-26 12:17:16,329 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41389/index.html
2026-06-26 12:17:16,338 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41389/info.json
2026-06-26 12:17:16,339 main:
2026-06-26 12:17:16,339 main: ********************************************************************************
2026-06-26 12:17:16,339 main: Processing observation 41388
2026-06-26 12:17:16,339 main: ********************************************************************************
2026-06-26 12:17:16,343 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 12:17:16,355 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:17:19,991 __init__: ObsID 41388 has insufficient telemetry, skipping
2026-06-26 12:17:19,992 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41388/index.html
2026-06-26 12:17:19,997 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41388/info.json
2026-06-26 12:17:19,998 main:
2026-06-26 12:17:19,998 main: ********************************************************************************
2026-06-26 12:17:19,998 main: Processing observation 41387
2026-06-26 12:17:19,998 main: ********************************************************************************
2026-06-26 12:17:19,999 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 12:17:20,001 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:17:22,657 __init__: ObsID 41387 has insufficient telemetry, skipping
2026-06-26 12:17:22,658 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41387/index.html
2026-06-26 12:17:22,663 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41387/info.json
2026-06-26 12:17:22,663 main:
2026-06-26 12:17:22,664 main: ********************************************************************************
2026-06-26 12:17:22,664 main: Processing observation 41386
2026-06-26 12:17:22,664 main: ********************************************************************************
2026-06-26 12:17:22,665 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 12:17:22,666 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:17:26,136 __init__: ObsID 41386 has no maneuver event in telemetry, skipping
2026-06-26 12:17:26,136 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41386/index.html
2026-06-26 12:17:26,142 info: could not get attribute kalman_start for obsid 41386
2026-06-26 12:17:26,142 info: could not get attribute kalman_stop for obsid 41386
2026-06-26 12:17:26,142 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/41386/info.json
2026-06-26 12:17:26,143 main:
2026-06-26 12:17:26,143 main: ********************************************************************************
2026-06-26 12:17:26,143 main: Processing observation 31483
2026-06-26 12:17:26,143 main: ********************************************************************************
2026-06-26 12:17:26,143 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31483/info.json file found, obs=None
2026-06-26 12:17:26,145 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-26 12:17:26,146 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/last.html
2026-06-26 12:17:29,191 __init__: ObsID 31483 has no maneuver event in telemetry, skipping
2026-06-26 12:17:29,192 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31483/index.html
2026-06-26 12:17:29,202 info: could not get attribute kalman_start for obsid 31483
2026-06-26 12:17:29,202 info: could not get attribute kalman_stop for obsid 31483
2026-06-26 12:17:29,202 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN2226A/31483/info.json
2026-06-26 12:17:29,203 main:
2026-06-26 13:17:33,462 run_check: Starting centroid dashboard continuity check
2026-06-26 13:17:33,462 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-06-26 13:17:33,464 collect_observations: Processing year 2020
2026-06-26 13:17:36,514 collect_observations: Processing year 2021
2026-06-26 13:17:41,852 collect_observations: Processing year 2022
2026-06-26 13:17:47,531 collect_observations: Processing year 2023
2026-06-26 13:17:53,596 collect_observations: Processing year 2024
2026-06-26 13:17:58,964 collect_observations: Processing year 2025
2026-06-26 13:18:04,570 collect_observations: Processing year 2026
2026-06-26 13:18:07,315 collect_observations: Collected 14100 observations from 4-digit years
2026-06-26 13:18:07,321 sort_observations_by_date: Sorted observations by date
2026-06-26 13:18:07,321 check_continuity: Starting continuity check from most recent: ObsID 31483 (JUN2226A) at 2026:177:12:53:16.525
2026-06-26 13:18:07,343 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-06-26 13:18:07,343 check_continuity: Chain complete: visited 14100 observations out of 14100 total
2026-06-26 13:18:07,344 run_check: ✓ Observation chain continuity check PASSED
2026-06-26 13:18:07,344 run_check: Summary: 14100 observations from 4-digit years, all properly linked