Prev
Index
Next
centroid_dashboard: Tue May 12 13:17:54 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Tue May 12 13:17:54 2026 |
No errors
File contents:
2026-05-12 13:16:12,862 main: Processing from 2026:125:17:16:12.861 to 2026:132:17:16:12.861
2026-05-12 13:16:21,734 get_observations: Found observation 32291 at 2026:125:21:16:01.235 with 1 manvrs
2026-05-12 13:16:21,734 get_observations: Found observation 32325 at 2026:125:23:09:08.415 with 1 manvrs
2026-05-12 13:16:21,735 get_observations: Found observation 32080 at 2026:126:02:44:51.482 with 1 manvrs
2026-05-12 13:16:21,735 get_observations: Found observation 41512 at 2026:126:08:11:04.185 with 1 manvrs
2026-05-12 13:16:21,735 get_observations: Found observation 30204 at 2026:126:09:10:36.328 with 1 manvrs
2026-05-12 13:16:21,736 get_observations: Found observation 30063 at 2026:126:12:29:33.411 with 1 manvrs
2026-05-12 13:16:21,736 get_observations: Found observation 41511 at 2026:126:18:36:19.297 with 1 manvrs
2026-05-12 13:16:21,737 get_observations: Found observation 41510 at 2026:126:21:55:40.252 with 1 manvrs
2026-05-12 13:16:21,737 get_observations: Found observation 41509 at 2026:127:00:55:40.252 with 1 manvrs
2026-05-12 13:16:21,738 get_observations: Found observation 31376 at 2026:127:05:55:57.503 with 1 manvrs
2026-05-12 13:16:21,738 get_observations: Found observation 30210 at 2026:127:15:11:02.947 with 2 manvrs
2026-05-12 13:16:21,738 get_observations: Found observation 30141 at 2026:127:19:23:36.709 with 2 manvrs
2026-05-12 13:16:21,739 get_observations: Found observation 32330 at 2026:128:01:04:46.952 with 2 manvrs
2026-05-12 13:16:21,739 get_observations: Found observation 32329 at 2026:128:04:49:15.806 with 2 manvrs
2026-05-12 13:16:21,740 get_observations: Found observation 32331 at 2026:128:08:50:36.341 with 2 manvrs
2026-05-12 13:16:21,740 get_observations: Found observation 30062 at 2026:128:13:15:38.709 with 1 manvrs
2026-05-12 13:16:21,740 get_observations: Found observation 32161 at 2026:129:06:42:35.614 with 1 manvrs
2026-05-12 13:16:21,741 get_observations: Found observation 41503 at 2026:129:10:49:36.697 with 1 manvrs
2026-05-12 13:16:21,741 get_observations: Found observation 41502 at 2026:129:12:21:28.023 with 1 manvrs
2026-05-12 13:16:21,742 get_observations: Found observation 41501 at 2026:129:13:39:00.325 with 1 manvrs
2026-05-12 13:16:21,742 get_observations: Found observation 41500 at 2026:129:14:56:33.538 with 1 manvrs
2026-05-12 13:16:21,743 get_observations: Found observation 41499 at 2026:129:16:15:40.252 with 1 manvrs
2026-05-12 13:16:21,743 get_observations: Found observation 32327 at 2026:129:20:51:41.774 with 1 manvrs
2026-05-12 13:16:21,743 get_observations: Found observation 32332 at 2026:130:03:13:12.255 with 1 manvrs
2026-05-12 13:16:21,744 get_observations: Found observation 31494 at 2026:130:08:00:19.211 with 1 manvrs
2026-05-12 13:16:21,744 get_observations: Found observation 31918 at 2026:130:12:38:31.297 with 1 manvrs
2026-05-12 13:16:21,745 get_observations: Found observation 31456 at 2026:130:18:07:40.973 with 1 manvrs
2026-05-12 13:16:21,745 get_observations: Found observation 30059 at 2026:130:21:26:17.691 with 1 manvrs
2026-05-12 13:16:21,746 get_observations: Found observation 29939 at 2026:131:09:21:12.573 with 1 manvrs
2026-05-12 13:16:21,746 get_observations: Found observation 30060 at 2026:131:13:54:23.720 with 1 manvrs
2026-05-12 13:16:21,746 get_observations: Found observation 41498 at 2026:132:01:51:39.831 with 1 manvrs
2026-05-12 13:16:21,747 get_observations: Found observation 41497 at 2026:132:03:27:41.493 with 1 manvrs
2026-05-12 13:16:21,747 get_observations: Found observation 41496 at 2026:132:06:55:40.252 with 1 manvrs
2026-05-12 13:16:21,748 get_observations: Found observation 41495 at 2026:132:08:02:57.497 with 1 manvrs
2026-05-12 13:16:21,748 get_observations: Found observation 41494 at 2026:132:12:05:40.252 with 1 manvrs
2026-05-12 13:16:21,748 get_observations: Found observation 32339 at 2026:132:13:37:06.798 with 1 manvrs
2026-05-12 13:16:21,749 main: Found 36 observations
2026-05-12 13:16:21,749 main: ********************************************************************************
2026-05-12 13:16:21,749 main: Processing observation 32291
2026-05-12 13:16:21,749 main: ********************************************************************************
2026-05-12 13:16:21,781 obs_link_from_info: Found prev obsid 30262
2026-05-12 13:16:21,784 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 13:16:21,785 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 13:16:21,788 process_obs: ObsID 32291 already processed, skipping
2026-05-12 13:16:21,788 main:
2026-05-12 13:16:21,788 main: ********************************************************************************
2026-05-12 13:16:21,788 main: Processing observation 32325
2026-05-12 13:16:21,788 main: ********************************************************************************
2026-05-12 13:16:21,789 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 13:16:21,790 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:34,237 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/centroid_resids.pkl
2026-05-12 12:16:34,254 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-12 12:16:34,254 plot_crs_time: Plot file exists, skipping
2026-05-12 12:16:34,255 plot_crs_scatter: Plot file exists, skipping
2026-05-12 12:16:34,418 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-12 12:16:34,962 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/n_kalman_delta_roll.png
2026-05-12 12:16:40,480 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/index.html
2026-05-12 12:16:40,482 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/32325/info.json
2026-05-12 12:16:40,484 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32325/index.html
2026-05-12 12:16:40,487 main:
2026-05-12 12:16:40,487 main: ********************************************************************************
2026-05-12 12:16:40,487 main: Processing observation 32080
2026-05-12 12:16:40,487 main: ********************************************************************************
2026-05-12 12:16:40,488 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:40,489 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:40,510 process_obs: ObsID 32080 already processed, skipping
2026-05-12 12:16:40,510 main:
2026-05-12 12:16:40,510 main: ********************************************************************************
2026-05-12 12:16:40,510 main: Processing observation 41512
2026-05-12 12:16:40,510 main: ********************************************************************************
2026-05-12 12:16:40,512 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:40,513 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:40,549 process_obs: ObsID 41512 already processed, skipping
2026-05-12 12:16:40,549 main:
2026-05-12 12:16:40,549 main: ********************************************************************************
2026-05-12 12:16:40,549 main: Processing observation 30204
2026-05-12 12:16:40,549 main: ********************************************************************************
2026-05-12 12:16:40,550 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:40,551 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:40,576 process_obs: ObsID 30204 already processed, skipping
2026-05-12 12:16:40,576 main:
2026-05-12 12:16:40,576 main: ********************************************************************************
2026-05-12 12:16:40,576 main: Processing observation 30063
2026-05-12 12:16:40,576 main: ********************************************************************************
2026-05-12 12:16:40,577 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:40,578 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:40,582 process_obs: ObsID 30063 already processed, skipping
2026-05-12 12:16:40,582 main:
2026-05-12 12:16:40,582 main: ********************************************************************************
2026-05-12 12:16:40,582 main: Processing observation 41511
2026-05-12 12:16:40,582 main: ********************************************************************************
2026-05-12 12:16:40,584 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:40,585 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:40,588 process_obs: ObsID 41511 already processed, skipping
2026-05-12 12:16:40,589 main:
2026-05-12 12:16:40,589 main: ********************************************************************************
2026-05-12 12:16:40,589 main: Processing observation 41510
2026-05-12 12:16:40,589 main: ********************************************************************************
2026-05-12 12:16:40,590 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:40,591 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:40,597 process_obs: ObsID 41510 already processed, skipping
2026-05-12 12:16:40,597 main:
2026-05-12 12:16:40,597 main: ********************************************************************************
2026-05-12 12:16:40,597 main: Processing observation 41509
2026-05-12 12:16:40,597 main: ********************************************************************************
2026-05-12 12:16:40,598 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:40,599 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:40,603 process_obs: ObsID 41509 already processed, skipping
2026-05-12 12:16:40,604 main:
2026-05-12 12:16:40,604 main: ********************************************************************************
2026-05-12 12:16:40,604 main: Processing observation 31376
2026-05-12 12:16:40,604 main: ********************************************************************************
2026-05-12 12:16:40,605 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:40,607 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:44,658 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/centroid_resids.pkl
2026-05-12 12:16:44,673 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-12 12:16:44,674 plot_crs_time: Plot file exists, skipping
2026-05-12 12:16:44,675 plot_crs_scatter: Plot file exists, skipping
2026-05-12 12:16:45,946 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/n_kalman_delta_roll.png
2026-05-12 12:16:46,244 get_aberration_correction: More than one entry for 31376 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/MAY0426/oflsa/output/MAY0426A_ManErr.txt. Skipping aber correction
2026-05-12 12:16:52,164 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/index.html
2026-05-12 12:16:52,166 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/31376/info.json
2026-05-12 12:16:52,168 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31376/index.html
2026-05-12 12:16:52,169 main:
2026-05-12 12:16:52,169 main: ********************************************************************************
2026-05-12 12:16:52,169 main: Processing observation 30210
2026-05-12 12:16:52,169 main: ********************************************************************************
2026-05-12 12:16:52,170 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:52,171 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:52,175 process_obs: ObsID 30210 already processed, skipping
2026-05-12 12:16:52,175 main:
2026-05-12 12:16:52,175 main: ********************************************************************************
2026-05-12 12:16:52,175 main: Processing observation 30141
2026-05-12 12:16:52,175 main: ********************************************************************************
2026-05-12 12:16:52,176 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:52,177 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:52,180 process_obs: ObsID 30141 already processed, skipping
2026-05-12 12:16:52,180 main:
2026-05-12 12:16:52,180 main: ********************************************************************************
2026-05-12 12:16:52,180 main: Processing observation 32330
2026-05-12 12:16:52,180 main: ********************************************************************************
2026-05-12 12:16:52,181 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:52,182 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:52,186 process_obs: ObsID 32330 already processed, skipping
2026-05-12 12:16:52,186 main:
2026-05-12 12:16:52,186 main: ********************************************************************************
2026-05-12 12:16:52,186 main: Processing observation 32329
2026-05-12 12:16:52,186 main: ********************************************************************************
2026-05-12 12:16:52,187 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:52,188 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:52,191 process_obs: ObsID 32329 already processed, skipping
2026-05-12 12:16:52,191 main:
2026-05-12 12:16:52,191 main: ********************************************************************************
2026-05-12 12:16:52,191 main: Processing observation 32331
2026-05-12 12:16:52,191 main: ********************************************************************************
2026-05-12 12:16:52,192 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:52,193 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:52,197 process_obs: ObsID 32331 already processed, skipping
2026-05-12 12:16:52,197 main:
2026-05-12 12:16:52,197 main: ********************************************************************************
2026-05-12 12:16:52,197 main: Processing observation 30062
2026-05-12 12:16:52,197 main: ********************************************************************************
2026-05-12 12:16:52,198 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:52,199 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:54,361 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/centroid_resids.pkl
2026-05-12 12:16:54,388 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-12 12:16:54,388 plot_crs_time: Plot file exists, skipping
2026-05-12 12:16:54,388 plot_crs_scatter: Plot file exists, skipping
2026-05-12 12:16:55,777 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/n_kalman_delta_roll.png
2026-05-12 12:16:58,740 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/index.html
2026-05-12 12:16:58,742 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/30062/info.json
2026-05-12 12:16:58,744 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30062/index.html
2026-05-12 12:16:58,745 main:
2026-05-12 12:16:58,745 main: ********************************************************************************
2026-05-12 12:16:58,745 main: Processing observation 32161
2026-05-12 12:16:58,745 main: ********************************************************************************
2026-05-12 12:16:58,747 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,748 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:58,751 process_obs: ObsID 32161 already processed, skipping
2026-05-12 12:16:58,751 main:
2026-05-12 12:16:58,751 main: ********************************************************************************
2026-05-12 12:16:58,751 main: Processing observation 41503
2026-05-12 12:16:58,751 main: ********************************************************************************
2026-05-12 12:16:58,752 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,753 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:58,757 process_obs: ObsID 41503 already processed, skipping
2026-05-12 12:16:58,757 main:
2026-05-12 12:16:58,757 main: ********************************************************************************
2026-05-12 12:16:58,757 main: Processing observation 41502
2026-05-12 12:16:58,757 main: ********************************************************************************
2026-05-12 12:16:58,758 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,759 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:58,762 process_obs: ObsID 41502 already processed, skipping
2026-05-12 12:16:58,762 main:
2026-05-12 12:16:58,762 main: ********************************************************************************
2026-05-12 12:16:58,762 main: Processing observation 41501
2026-05-12 12:16:58,762 main: ********************************************************************************
2026-05-12 12:16:58,763 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,764 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:58,768 process_obs: ObsID 41501 already processed, skipping
2026-05-12 12:16:58,768 main:
2026-05-12 12:16:58,768 main: ********************************************************************************
2026-05-12 12:16:58,768 main: Processing observation 41500
2026-05-12 12:16:58,768 main: ********************************************************************************
2026-05-12 12:16:58,769 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,770 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:58,773 process_obs: ObsID 41500 already processed, skipping
2026-05-12 12:16:58,773 main:
2026-05-12 12:16:58,774 main: ********************************************************************************
2026-05-12 12:16:58,774 main: Processing observation 41499
2026-05-12 12:16:58,774 main: ********************************************************************************
2026-05-12 12:16:58,775 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,776 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:58,779 process_obs: ObsID 41499 already processed, skipping
2026-05-12 12:16:58,779 main:
2026-05-12 12:16:58,779 main: ********************************************************************************
2026-05-12 12:16:58,779 main: Processing observation 32327
2026-05-12 12:16:58,779 main: ********************************************************************************
2026-05-12 12:16:58,780 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,781 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:58,795 process_obs: ObsID 32327 already processed, skipping
2026-05-12 12:16:58,795 main:
2026-05-12 12:16:58,795 main: ********************************************************************************
2026-05-12 12:16:58,795 main: Processing observation 32332
2026-05-12 12:16:58,795 main: ********************************************************************************
2026-05-12 12:16:58,797 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,798 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:58,813 process_obs: ObsID 32332 already processed, skipping
2026-05-12 12:16:58,814 main:
2026-05-12 12:16:58,814 main: ********************************************************************************
2026-05-12 12:16:58,814 main: Processing observation 31494
2026-05-12 12:16:58,814 main: ********************************************************************************
2026-05-12 12:16:58,815 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,816 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:58,827 process_obs: ObsID 31494 already processed, skipping
2026-05-12 12:16:58,827 main:
2026-05-12 12:16:58,827 main: ********************************************************************************
2026-05-12 12:16:58,827 main: Processing observation 31918
2026-05-12 12:16:58,827 main: ********************************************************************************
2026-05-12 12:16:58,829 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,830 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:58,845 process_obs: ObsID 31918 already processed, skipping
2026-05-12 12:16:58,845 main:
2026-05-12 12:16:58,845 main: ********************************************************************************
2026-05-12 12:16:58,845 main: Processing observation 31456
2026-05-12 12:16:58,845 main: ********************************************************************************
2026-05-12 12:16:58,846 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,847 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY0426A/last.html
2026-05-12 12:16:58,863 process_obs: ObsID 31456 already processed, skipping
2026-05-12 12:16:58,863 main:
2026-05-12 12:16:58,863 main: ********************************************************************************
2026-05-12 12:16:58,863 main: Processing observation 30059
2026-05-12 12:16:58,863 main: ********************************************************************************
2026-05-12 12:16:58,864 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:16:58,865 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-12 12:17:01,110 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-12 12:17:01,626 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30059/centroid_resids.pkl with 5 slots
2026-05-12 12:17:01,710 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30059/centroid_resids_time.png
2026-05-12 12:17:02,081 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30059/centroid_resids_scatter.png
2026-05-12 12:17:03,533 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30059/n_kalman_delta_roll.png
2026-05-12 12:17:07,235 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30059/index.html
2026-05-12 12:17:07,239 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30059/info.json
2026-05-12 12:17:07,249 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30059/index.html
2026-05-12 12:17:07,252 main:
2026-05-12 12:17:07,252 main: ********************************************************************************
2026-05-12 12:17:07,253 main: Processing observation 29939
2026-05-12 12:17:07,253 main: ********************************************************************************
2026-05-12 12:17:07,258 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:17:07,263 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-12 12:17:11,108 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-12 12:17:11,601 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/29939/centroid_resids.pkl with 5 slots
2026-05-12 12:17:11,651 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/29939/centroid_resids_time.png
2026-05-12 12:17:12,198 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/29939/centroid_resids_scatter.png
2026-05-12 12:17:13,106 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/29939/n_kalman_delta_roll.png
2026-05-12 12:17:13,276 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/29939/index.html
2026-05-12 12:17:13,278 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/29939/info.json
2026-05-12 12:17:13,317 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29939/index.html
2026-05-12 12:17:13,319 main:
2026-05-12 12:17:13,319 main: ********************************************************************************
2026-05-12 12:17:13,319 main: Processing observation 30060
2026-05-12 12:17:13,319 main: ********************************************************************************
2026-05-12 12:17:13,321 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:17:13,323 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-12 12:17:15,435 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-12 12:17:15,754 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30060/centroid_resids.pkl with 5 slots
2026-05-12 12:17:15,825 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30060/centroid_resids_time.png
2026-05-12 12:17:16,130 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30060/centroid_resids_scatter.png
2026-05-12 12:17:16,385 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-12 12:17:16,499 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30060/n_kalman_delta_roll.png
2026-05-12 12:17:16,618 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30060/index.html
2026-05-12 12:17:16,619 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30060/info.json
2026-05-12 12:17:16,622 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30060/index.html
2026-05-12 12:17:16,622 main:
2026-05-12 12:17:16,623 main: ********************************************************************************
2026-05-12 12:17:16,623 main: Processing observation 41498
2026-05-12 12:17:16,623 main: ********************************************************************************
2026-05-12 12:17:16,624 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:17:16,625 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-12 12:17:19,014 __init__: ObsID 41498 has insufficient telemetry, skipping
2026-05-12 12:17:19,014 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/41498/index.html
2026-05-12 12:17:19,019 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/41498/info.json
2026-05-12 12:17:19,020 main:
2026-05-12 12:17:19,020 main: ********************************************************************************
2026-05-12 12:17:19,020 main: Processing observation 41497
2026-05-12 12:17:19,020 main: ********************************************************************************
2026-05-12 12:17:19,022 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:17:19,023 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-12 12:17:21,152 __init__: ObsID 41497 has insufficient telemetry, skipping
2026-05-12 12:17:21,152 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/41497/index.html
2026-05-12 12:17:21,157 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/41497/info.json
2026-05-12 12:17:21,158 main:
2026-05-12 12:17:21,158 main: ********************************************************************************
2026-05-12 12:17:21,158 main: Processing observation 41496
2026-05-12 12:17:21,158 main: ********************************************************************************
2026-05-12 12:17:21,159 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:17:21,160 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-12 12:17:23,282 __init__: ObsID 41496 has insufficient telemetry, skipping
2026-05-12 12:17:23,283 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/41496/index.html
2026-05-12 12:17:23,287 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/41496/info.json
2026-05-12 12:17:23,288 main:
2026-05-12 12:17:23,288 main: ********************************************************************************
2026-05-12 12:17:23,288 main: Processing observation 41495
2026-05-12 12:17:23,289 main: ********************************************************************************
2026-05-12 12:17:23,290 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:17:23,291 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-12 12:17:25,430 __init__: ObsID 41495 has insufficient telemetry, skipping
2026-05-12 12:17:25,430 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/41495/index.html
2026-05-12 12:17:25,435 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/41495/info.json
2026-05-12 12:17:25,436 main:
2026-05-12 12:17:25,436 main: ********************************************************************************
2026-05-12 12:17:25,436 main: Processing observation 41494
2026-05-12 12:17:25,436 main: ********************************************************************************
2026-05-12 12:17:25,437 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:17:25,438 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-12 12:17:27,549 __init__: ObsID 41494 has insufficient telemetry, skipping
2026-05-12 12:17:27,550 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/41494/index.html
2026-05-12 12:17:27,554 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/41494/info.json
2026-05-12 12:17:27,555 main:
2026-05-12 12:17:27,555 main: ********************************************************************************
2026-05-12 12:17:27,555 main: Processing observation 32339
2026-05-12 12:17:27,555 main: ********************************************************************************
2026-05-12 12:17:27,556 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/32339/info.json file found, obs=None
2026-05-12 12:17:27,557 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-12 12:17:27,558 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-12 12:17:29,885 __init__: ObsID 32339 has no maneuver event in telemetry, skipping
2026-05-12 12:17:29,886 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/32339/index.html
2026-05-12 12:17:29,898 get_aberration_correction: More than one entry for 32339 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/MAY1126/oflsa/output/MAY1126A_ManErr.txt. Skipping aber correction
2026-05-12 12:17:29,898 info: could not get attribute kalman_start for obsid 32339
2026-05-12 12:17:29,898 info: could not get attribute kalman_stop for obsid 32339
2026-05-12 12:17:29,899 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/32339/info.json
2026-05-12 12:17:29,912 main:
2026-05-12 13:17:31,437 run_check: Starting centroid dashboard continuity check
2026-05-12 13:17:31,437 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-05-12 13:17:31,441 collect_observations: Processing year 2020
2026-05-12 13:17:34,041 collect_observations: Processing year 2021
2026-05-12 13:17:37,823 collect_observations: Processing year 2022
2026-05-12 13:17:42,355 collect_observations: Processing year 2023
2026-05-12 13:17:45,382 collect_observations: Processing year 2024
2026-05-12 13:17:49,787 collect_observations: Processing year 2025
2026-05-12 13:17:53,023 collect_observations: Processing year 2026
2026-05-12 13:17:53,896 collect_observations: Collected 13848 observations from 4-digit years
2026-05-12 13:17:53,901 sort_observations_by_date: Sorted observations by date
2026-05-12 13:17:53,901 check_continuity: Starting continuity check from most recent: ObsID 32339 (MAY1126A) at 2026:132:12:59:35.377
2026-05-12 13:17:53,919 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-05-12 13:17:53,919 check_continuity: Chain complete: visited 13848 observations out of 13848 total
2026-05-12 13:17:53,920 run_check: ✓ Observation chain continuity check PASSED
2026-05-12 13:17:53,920 run_check: Summary: 13848 observations from 4-digit years, all properly linked