Prev
Index
Next
centroid_dashboard: Thu May 7 13:17:36 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Thu May 7 13:17:36 2026 |
No errors
File contents:
2026-05-07 13:16:09,401 main: Processing from 2026:120:17:16:09.400 to 2026:127:17:16:09.400
2026-05-07 13:16:15,367 get_observations: Found observation 30070 at 2026:120:17:50:58.106 with 1 manvrs
2026-05-07 13:16:15,368 get_observations: Found observation 32318 at 2026:121:05:38:02.108 with 1 manvrs
2026-05-07 13:16:15,368 get_observations: Found observation 41522 at 2026:121:11:17:26.474 with 1 manvrs
2026-05-07 13:16:15,369 get_observations: Found observation 41521 at 2026:121:13:55:40.252 with 1 manvrs
2026-05-07 13:16:15,369 get_observations: Found observation 41520 at 2026:121:15:55:40.252 with 1 manvrs
2026-05-07 13:16:15,370 get_observations: Found observation 41519 at 2026:121:17:55:40.252 with 1 manvrs
2026-05-07 13:16:15,370 get_observations: Found observation 41518 at 2026:121:19:10:40.252 with 1 manvrs
2026-05-07 13:16:15,370 get_observations: Found observation 41517 at 2026:121:20:45:40.252 with 1 manvrs
2026-05-07 13:16:15,371 get_observations: Found observation 32322 at 2026:121:22:25:41.491 with 1 manvrs
2026-05-07 13:16:15,371 get_observations: Found observation 26961 at 2026:122:02:57:58.117 with 1 manvrs
2026-05-07 13:16:15,372 get_observations: Found observation 31627 at 2026:122:18:07:50.491 with 1 manvrs
2026-05-07 13:16:15,372 get_observations: Found observation 32323 at 2026:123:03:38:55.561 with 1 manvrs
2026-05-07 13:16:15,372 get_observations: Found observation 31736 at 2026:123:07:48:08.429 with 1 manvrs
2026-05-07 13:16:15,373 get_observations: Found observation 32324 at 2026:123:19:50:36.292 with 1 manvrs
2026-05-07 13:16:15,373 get_observations: Found observation 30101 at 2026:123:23:52:41.275 with 1 manvrs
2026-05-07 13:16:15,374 get_observations: Found observation 41516 at 2026:124:03:17:31.114 with 1 manvrs
2026-05-07 13:16:15,374 get_observations: Found observation 41515 at 2026:124:06:55:40.252 with 1 manvrs
2026-05-07 13:16:15,375 get_observations: Found observation 41514 at 2026:124:08:55:40.252 with 1 manvrs
2026-05-07 13:16:15,375 get_observations: Found observation 41513 at 2026:124:11:55:40.252 with 1 manvrs
2026-05-07 13:16:15,375 get_observations: Found observation 32328 at 2026:124:14:25:15.614 with 1 manvrs
2026-05-07 13:16:15,376 get_observations: Found observation 30536 at 2026:124:20:29:29.487 with 1 manvrs
2026-05-07 13:16:15,376 get_observations: Found observation 31929 at 2026:125:04:49:19.054 with 1 manvrs
2026-05-07 13:16:15,377 get_observations: Found observation 32326 at 2026:125:08:45:24.101 with 1 manvrs
2026-05-07 13:16:15,377 get_observations: Found observation 30262 at 2026:125:12:03:12.912 with 1 manvrs
2026-05-07 13:16:15,378 get_observations: Found observation 32291 at 2026:125:21:16:01.235 with 1 manvrs
2026-05-07 13:16:15,378 get_observations: Found observation 32325 at 2026:125:23:09:08.415 with 1 manvrs
2026-05-07 13:16:15,378 get_observations: Found observation 32080 at 2026:126:02:44:51.482 with 1 manvrs
2026-05-07 13:16:15,379 get_observations: Found observation 41512 at 2026:126:08:11:04.185 with 1 manvrs
2026-05-07 13:16:15,379 get_observations: Found observation 30204 at 2026:126:09:10:36.328 with 1 manvrs
2026-05-07 13:16:15,380 get_observations: Found observation 30063 at 2026:126:12:29:33.411 with 1 manvrs
2026-05-07 13:16:15,380 get_observations: Found observation 41511 at 2026:126:18:36:19.297 with 1 manvrs
2026-05-07 13:16:15,381 get_observations: Found observation 41510 at 2026:126:21:55:40.252 with 1 manvrs
2026-05-07 13:16:15,381 get_observations: Found observation 41509 at 2026:127:00:55:40.252 with 1 manvrs
2026-05-07 13:16:15,381 get_observations: Found observation 31376 at 2026:127:05:55:57.503 with 1 manvrs
2026-05-07 13:16:15,382 get_observations: Found observation 30210 at 2026:127:15:11:02.947 with 2 manvrs
2026-05-07 13:16:15,382 main: Found 35 observations
2026-05-07 13:16:15,382 main: ********************************************************************************
2026-05-07 13:16:15,382 main: Processing observation 30070
2026-05-07 13:16:15,382 main: ********************************************************************************
2026-05-07 13:16:15,386 obs_link_from_info: Found prev obsid 32317
2026-05-07 13:16:15,389 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,390 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,393 process_obs: ObsID 30070 already processed, skipping
2026-05-07 13:16:15,393 main:
2026-05-07 13:16:15,393 main: ********************************************************************************
2026-05-07 13:16:15,393 main: Processing observation 32318
2026-05-07 13:16:15,393 main: ********************************************************************************
2026-05-07 13:16:15,394 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,395 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,399 process_obs: ObsID 32318 already processed, skipping
2026-05-07 13:16:15,399 main:
2026-05-07 13:16:15,399 main: ********************************************************************************
2026-05-07 13:16:15,399 main: Processing observation 41522
2026-05-07 13:16:15,399 main: ********************************************************************************
2026-05-07 13:16:15,400 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,401 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,404 process_obs: ObsID 41522 already processed, skipping
2026-05-07 13:16:15,404 main:
2026-05-07 13:16:15,404 main: ********************************************************************************
2026-05-07 13:16:15,404 main: Processing observation 41521
2026-05-07 13:16:15,404 main: ********************************************************************************
2026-05-07 13:16:15,405 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,406 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,409 process_obs: ObsID 41521 already processed, skipping
2026-05-07 13:16:15,409 main:
2026-05-07 13:16:15,409 main: ********************************************************************************
2026-05-07 13:16:15,409 main: Processing observation 41520
2026-05-07 13:16:15,409 main: ********************************************************************************
2026-05-07 13:16:15,410 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,411 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,414 process_obs: ObsID 41520 already processed, skipping
2026-05-07 13:16:15,414 main:
2026-05-07 13:16:15,414 main: ********************************************************************************
2026-05-07 13:16:15,414 main: Processing observation 41519
2026-05-07 13:16:15,414 main: ********************************************************************************
2026-05-07 13:16:15,415 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,416 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,419 process_obs: ObsID 41519 already processed, skipping
2026-05-07 13:16:15,419 main:
2026-05-07 13:16:15,419 main: ********************************************************************************
2026-05-07 13:16:15,419 main: Processing observation 41518
2026-05-07 13:16:15,419 main: ********************************************************************************
2026-05-07 13:16:15,420 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,421 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,424 process_obs: ObsID 41518 already processed, skipping
2026-05-07 13:16:15,424 main:
2026-05-07 13:16:15,424 main: ********************************************************************************
2026-05-07 13:16:15,424 main: Processing observation 41517
2026-05-07 13:16:15,424 main: ********************************************************************************
2026-05-07 13:16:15,425 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,426 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,429 process_obs: ObsID 41517 already processed, skipping
2026-05-07 13:16:15,430 main:
2026-05-07 13:16:15,430 main: ********************************************************************************
2026-05-07 13:16:15,430 main: Processing observation 32322
2026-05-07 13:16:15,430 main: ********************************************************************************
2026-05-07 13:16:15,430 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,432 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,434 process_obs: ObsID 32322 already processed, skipping
2026-05-07 13:16:15,434 main:
2026-05-07 13:16:15,434 main: ********************************************************************************
2026-05-07 13:16:15,434 main: Processing observation 26961
2026-05-07 13:16:15,434 main: ********************************************************************************
2026-05-07 13:16:15,435 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,436 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,440 process_obs: ObsID 26961 already processed, skipping
2026-05-07 13:16:15,440 main:
2026-05-07 13:16:15,440 main: ********************************************************************************
2026-05-07 13:16:15,440 main: Processing observation 31627
2026-05-07 13:16:15,440 main: ********************************************************************************
2026-05-07 13:16:15,441 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,442 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,445 process_obs: ObsID 31627 already processed, skipping
2026-05-07 13:16:15,445 main:
2026-05-07 13:16:15,445 main: ********************************************************************************
2026-05-07 13:16:15,445 main: Processing observation 32323
2026-05-07 13:16:15,445 main: ********************************************************************************
2026-05-07 13:16:15,446 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,447 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,450 process_obs: ObsID 32323 already processed, skipping
2026-05-07 13:16:15,450 main:
2026-05-07 13:16:15,450 main: ********************************************************************************
2026-05-07 13:16:15,450 main: Processing observation 31736
2026-05-07 13:16:15,450 main: ********************************************************************************
2026-05-07 13:16:15,451 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,452 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,455 process_obs: ObsID 31736 already processed, skipping
2026-05-07 13:16:15,455 main:
2026-05-07 13:16:15,455 main: ********************************************************************************
2026-05-07 13:16:15,455 main: Processing observation 32324
2026-05-07 13:16:15,455 main: ********************************************************************************
2026-05-07 13:16:15,456 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,457 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/APR2726A/last.html
2026-05-07 13:16:15,460 process_obs: ObsID 32324 already processed, skipping
2026-05-07 13:16:15,460 main:
2026-05-07 13:16:15,460 main: ********************************************************************************
2026-05-07 13:16:15,460 main: Processing observation 30101
2026-05-07 13:16:15,460 main: ********************************************************************************
2026-05-07 13:16:15,461 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,462 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 13:16:15,465 process_obs: ObsID 30101 already processed, skipping
2026-05-07 13:16:15,465 main:
2026-05-07 13:16:15,465 main: ********************************************************************************
2026-05-07 13:16:15,465 main: Processing observation 41516
2026-05-07 13:16:15,465 main: ********************************************************************************
2026-05-07 13:16:15,466 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,467 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 13:16:15,470 process_obs: ObsID 41516 already processed, skipping
2026-05-07 13:16:15,470 main:
2026-05-07 13:16:15,470 main: ********************************************************************************
2026-05-07 13:16:15,470 main: Processing observation 41515
2026-05-07 13:16:15,470 main: ********************************************************************************
2026-05-07 13:16:15,471 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,472 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 13:16:15,475 process_obs: ObsID 41515 already processed, skipping
2026-05-07 13:16:15,475 main:
2026-05-07 13:16:15,475 main: ********************************************************************************
2026-05-07 13:16:15,475 main: Processing observation 41514
2026-05-07 13:16:15,475 main: ********************************************************************************
2026-05-07 13:16:15,476 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,477 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 13:16:15,480 process_obs: ObsID 41514 already processed, skipping
2026-05-07 13:16:15,480 main:
2026-05-07 13:16:15,480 main: ********************************************************************************
2026-05-07 13:16:15,480 main: Processing observation 41513
2026-05-07 13:16:15,480 main: ********************************************************************************
2026-05-07 13:16:15,481 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,482 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 13:16:15,485 process_obs: ObsID 41513 already processed, skipping
2026-05-07 13:16:15,485 main:
2026-05-07 13:16:15,485 main: ********************************************************************************
2026-05-07 13:16:15,485 main: Processing observation 32328
2026-05-07 13:16:15,485 main: ********************************************************************************
2026-05-07 13:16:15,486 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,487 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 13:16:15,490 process_obs: ObsID 32328 already processed, skipping
2026-05-07 13:16:15,490 main:
2026-05-07 13:16:15,490 main: ********************************************************************************
2026-05-07 13:16:15,490 main: Processing observation 30536
2026-05-07 13:16:15,490 main: ********************************************************************************
2026-05-07 13:16:15,491 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 13:16:15,492 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:18,157 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30536/centroid_resids.pkl
2026-05-07 12:16:18,198 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-07 12:16:18,198 plot_crs_time: Plot file exists, skipping
2026-05-07 12:16:18,198 plot_crs_scatter: Plot file exists, skipping
2026-05-07 12:16:19,438 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30536/n_kalman_delta_roll.png
2026-05-07 12:16:22,327 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30536/index.html
2026-05-07 12:16:22,329 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30536/info.json
2026-05-07 12:16:22,356 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30536/index.html
2026-05-07 12:16:22,357 main:
2026-05-07 12:16:22,357 main: ********************************************************************************
2026-05-07 12:16:22,358 main: Processing observation 31929
2026-05-07 12:16:22,358 main: ********************************************************************************
2026-05-07 12:16:22,359 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:22,360 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:22,395 process_obs: ObsID 31929 already processed, skipping
2026-05-07 12:16:22,396 main:
2026-05-07 12:16:22,396 main: ********************************************************************************
2026-05-07 12:16:22,396 main: Processing observation 32326
2026-05-07 12:16:22,396 main: ********************************************************************************
2026-05-07 12:16:22,397 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:22,398 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:25,228 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32326/centroid_resids.pkl
2026-05-07 12:16:25,254 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-07 12:16:25,254 plot_crs_time: Plot file exists, skipping
2026-05-07 12:16:25,256 plot_crs_scatter: Plot file exists, skipping
2026-05-07 12:16:26,255 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32326/n_kalman_delta_roll.png
2026-05-07 12:16:31,417 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32326/index.html
2026-05-07 12:16:31,420 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32326/info.json
2026-05-07 12:16:31,448 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32326/index.html
2026-05-07 12:16:31,449 main:
2026-05-07 12:16:31,449 main: ********************************************************************************
2026-05-07 12:16:31,449 main: Processing observation 30262
2026-05-07 12:16:31,449 main: ********************************************************************************
2026-05-07 12:16:31,451 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:31,452 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:33,751 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30262/centroid_resids.pkl
2026-05-07 12:16:33,785 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-07 12:16:33,786 plot_crs_time: Plot file exists, skipping
2026-05-07 12:16:33,786 plot_crs_scatter: Plot file exists, skipping
2026-05-07 12:16:34,974 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30262/n_kalman_delta_roll.png
2026-05-07 12:16:35,139 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30262/index.html
2026-05-07 12:16:35,141 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30262/info.json
2026-05-07 12:16:35,160 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30262/index.html
2026-05-07 12:16:35,164 main:
2026-05-07 12:16:35,164 main: ********************************************************************************
2026-05-07 12:16:35,164 main: Processing observation 32291
2026-05-07 12:16:35,164 main: ********************************************************************************
2026-05-07 12:16:35,168 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:35,169 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:37,539 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32291/centroid_resids.pkl
2026-05-07 12:16:37,556 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-07 12:16:37,556 plot_crs_time: Plot file exists, skipping
2026-05-07 12:16:37,556 plot_crs_scatter: Plot file exists, skipping
2026-05-07 12:16:38,169 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32291/n_kalman_delta_roll.png
2026-05-07 12:16:38,304 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32291/index.html
2026-05-07 12:16:38,306 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32291/info.json
2026-05-07 12:16:38,322 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32291/index.html
2026-05-07 12:16:38,323 main:
2026-05-07 12:16:38,324 main: ********************************************************************************
2026-05-07 12:16:38,324 main: Processing observation 32325
2026-05-07 12:16:38,324 main: ********************************************************************************
2026-05-07 12:16:38,325 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:38,326 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:40,583 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-07 12:16:40,901 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/centroid_resids.pkl with 5 slots
2026-05-07 12:16:40,951 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/centroid_resids_time.png
2026-05-07 12:16:41,440 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/centroid_resids_scatter.png
2026-05-07 12:16:41,594 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-07 12:16:41,736 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/n_kalman_delta_roll.png
2026-05-07 12:16:41,864 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/index.html
2026-05-07 12:16:41,866 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/info.json
2026-05-07 12:16:41,868 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32325/index.html
2026-05-07 12:16:41,869 main:
2026-05-07 12:16:41,869 main: ********************************************************************************
2026-05-07 12:16:41,869 main: Processing observation 32080
2026-05-07 12:16:41,869 main: ********************************************************************************
2026-05-07 12:16:41,870 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:41,871 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:44,029 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-07 12:16:44,321 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32080/centroid_resids.pkl with 5 slots
2026-05-07 12:16:44,379 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32080/centroid_resids_time.png
2026-05-07 12:16:44,659 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32080/centroid_resids_scatter.png
2026-05-07 12:16:45,511 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32080/n_kalman_delta_roll.png
2026-05-07 12:16:45,656 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32080/index.html
2026-05-07 12:16:45,659 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32080/info.json
2026-05-07 12:16:45,667 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32080/index.html
2026-05-07 12:16:45,670 main:
2026-05-07 12:16:45,670 main: ********************************************************************************
2026-05-07 12:16:45,670 main: Processing observation 41512
2026-05-07 12:16:45,670 main: ********************************************************************************
2026-05-07 12:16:45,672 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:45,676 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:47,552 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-07 12:16:47,971 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41512/centroid_resids.pkl with 8 slots
2026-05-07 12:16:48,035 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41512/centroid_resids_time.png
2026-05-07 12:16:48,299 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41512/centroid_resids_scatter.png
2026-05-07 12:16:48,372 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-07 12:16:48,504 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41512/n_kalman_delta_roll.png
2026-05-07 12:16:48,648 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41512/index.html
2026-05-07 12:16:48,649 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41512/info.json
2026-05-07 12:16:48,652 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41512/index.html
2026-05-07 12:16:48,653 main:
2026-05-07 12:16:48,653 main: ********************************************************************************
2026-05-07 12:16:48,653 main: Processing observation 30204
2026-05-07 12:16:48,653 main: ********************************************************************************
2026-05-07 12:16:48,654 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:48,655 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:50,491 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-07 12:16:50,783 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30204/centroid_resids.pkl with 5 slots
2026-05-07 12:16:50,830 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30204/centroid_resids_time.png
2026-05-07 12:16:51,083 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30204/centroid_resids_scatter.png
2026-05-07 12:16:51,824 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30204/n_kalman_delta_roll.png
2026-05-07 12:16:52,271 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30204/index.html
2026-05-07 12:16:52,272 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30204/info.json
2026-05-07 12:16:52,275 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30204/index.html
2026-05-07 12:16:52,276 main:
2026-05-07 12:16:52,276 main: ********************************************************************************
2026-05-07 12:16:52,276 main: Processing observation 30063
2026-05-07 12:16:52,276 main: ********************************************************************************
2026-05-07 12:16:52,277 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:52,278 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:54,106 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-07 12:16:54,400 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30063/centroid_resids.pkl with 5 slots
2026-05-07 12:16:54,466 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30063/centroid_resids_time.png
2026-05-07 12:16:54,764 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30063/centroid_resids_scatter.png
2026-05-07 12:16:54,942 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-07 12:16:55,068 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30063/n_kalman_delta_roll.png
2026-05-07 12:16:55,190 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30063/index.html
2026-05-07 12:16:55,191 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30063/info.json
2026-05-07 12:16:55,194 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30063/index.html
2026-05-07 12:16:55,195 main:
2026-05-07 12:16:55,195 main: ********************************************************************************
2026-05-07 12:16:55,195 main: Processing observation 41511
2026-05-07 12:16:55,195 main: ********************************************************************************
2026-05-07 12:16:55,218 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:55,219 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:57,021 __init__: ObsID 41511 has insufficient telemetry, skipping
2026-05-07 12:16:57,022 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41511/index.html
2026-05-07 12:16:57,026 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41511/info.json
2026-05-07 12:16:57,027 main:
2026-05-07 12:16:57,027 main: ********************************************************************************
2026-05-07 12:16:57,027 main: Processing observation 41510
2026-05-07 12:16:57,027 main: ********************************************************************************
2026-05-07 12:16:57,029 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:57,030 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:16:58,865 __init__: ObsID 41510 has insufficient telemetry, skipping
2026-05-07 12:16:58,866 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41510/index.html
2026-05-07 12:16:58,871 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41510/info.json
2026-05-07 12:16:58,873 main:
2026-05-07 12:16:58,873 main: ********************************************************************************
2026-05-07 12:16:58,873 main: Processing observation 41509
2026-05-07 12:16:58,873 main: ********************************************************************************
2026-05-07 12:16:58,877 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:16:58,879 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:17:00,727 __init__: ObsID 41509 has insufficient telemetry, skipping
2026-05-07 12:17:00,728 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41509/index.html
2026-05-07 12:17:00,732 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/41509/info.json
2026-05-07 12:17:00,733 main:
2026-05-07 12:17:00,733 main: ********************************************************************************
2026-05-07 12:17:00,733 main: Processing observation 31376
2026-05-07 12:17:00,733 main: ********************************************************************************
2026-05-07 12:17:00,734 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:17:00,735 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:17:03,504 __init__: ObsID 31376 has no maneuver event in telemetry, skipping
2026-05-07 12:17:03,518 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/index.html
2026-05-07 12:17:03,523 get_aberration_correction: More than one entry for 31376 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/MAY0426/oflsa/output/MAY0426A_ManErr.txt. Skipping aber correction
2026-05-07 12:17:03,524 info: could not get attribute kalman_start for obsid 31376
2026-05-07 12:17:03,524 info: could not get attribute kalman_stop for obsid 31376
2026-05-07 12:17:03,524 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/info.json
2026-05-07 12:17:03,548 main:
2026-05-07 12:17:03,548 main: ********************************************************************************
2026-05-07 12:17:03,548 main: Processing observation 30210
2026-05-07 12:17:03,548 main: ********************************************************************************
2026-05-07 12:17:03,556 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30210/info.json file found, obs=None
2026-05-07 12:17:03,564 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-07 12:17:03,576 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-07 12:17:06,408 __init__: ObsID 30210 has no maneuver event in telemetry, skipping
2026-05-07 12:17:06,410 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30210/index.html
2026-05-07 12:17:06,419 get_aberration_correction: More than one entry for 30210 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/MAY0426/oflsa/output/MAY0426A_ManErr.txt. Skipping aber correction
2026-05-07 12:17:06,460 info: could not get attribute kalman_start for obsid 30210
2026-05-07 12:17:06,460 info: could not get attribute kalman_stop for obsid 30210
2026-05-07 12:17:06,460 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30210/info.json
2026-05-07 12:17:06,463 main:
2026-05-07 13:17:08,580 run_check: Starting centroid dashboard continuity check
2026-05-07 13:17:08,580 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-05-07 13:17:08,608 collect_observations: Processing year 2020
2026-05-07 13:17:11,373 collect_observations: Processing year 2021
2026-05-07 13:17:14,987 collect_observations: Processing year 2022
2026-05-07 13:17:19,375 collect_observations: Processing year 2023
2026-05-07 13:17:23,385 collect_observations: Processing year 2024
2026-05-07 13:17:27,361 collect_observations: Processing year 2025
2026-05-07 13:17:33,119 collect_observations: Processing year 2026
2026-05-07 13:17:36,772 collect_observations: Collected 13823 observations from 4-digit years
2026-05-07 13:17:36,776 sort_observations_by_date: Sorted observations by date
2026-05-07 13:17:36,776 check_continuity: Starting continuity check from most recent: ObsID 30210 (MAY0426A) at 2026:127:14:45:39.940
2026-05-07 13:17:36,792 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-05-07 13:17:36,792 check_continuity: Chain complete: visited 13823 observations out of 13823 total
2026-05-07 13:17:36,793 run_check: ✓ Observation chain continuity check PASSED
2026-05-07 13:17:36,793 run_check: Summary: 13823 observations from 4-digit years, all properly linked