Prev
Index
Next
centroid_dashboard: Tue Jun 2 13:17:47 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Tue Jun 2 13:17:47 2026 |
No errors
File contents:
2026-06-02 13:16:09,119 main: Processing from 2026:146:17:16:09.119 to 2026:153:17:16:09.119
2026-06-02 13:16:18,140 get_observations: Found observation 32347 at 2026:146:19:30:50.711 with 1 manvrs
2026-06-02 13:16:18,141 get_observations: Found observation 32364 at 2026:146:22:28:04.859 with 1 manvrs
2026-06-02 13:16:18,141 get_observations: Found observation 30097 at 2026:147:01:42:15.834 with 1 manvrs
2026-06-02 13:16:18,141 get_observations: Found observation 30430 at 2026:147:10:32:55.895 with 1 manvrs
2026-06-02 13:16:18,142 get_observations: Found observation 30437 at 2026:147:13:47:22.592 with 1 manvrs
2026-06-02 13:16:18,142 get_observations: Found observation 41460 at 2026:147:22:36:09.951 with 1 manvrs
2026-06-02 13:16:18,143 get_observations: Found observation 41459 at 2026:148:00:55:40.252 with 1 manvrs
2026-06-02 13:16:18,143 get_observations: Found observation 41458 at 2026:148:02:55:40.252 with 1 manvrs
2026-06-02 13:16:18,144 get_observations: Found observation 41457 at 2026:148:04:45:40.252 with 1 manvrs
2026-06-02 13:16:18,144 get_observations: Found observation 41456 at 2026:148:05:55:40.252 with 1 manvrs
2026-06-02 13:16:18,144 get_observations: Found observation 41455 at 2026:148:07:55:40.252 with 1 manvrs
2026-06-02 13:16:18,145 get_observations: Found observation 30202 at 2026:148:11:05:24.459 with 1 manvrs
2026-06-02 13:16:18,145 get_observations: Found observation 30398 at 2026:148:14:28:11.045 with 1 manvrs
2026-06-02 13:16:18,146 get_observations: Found observation 32361 at 2026:148:19:14:17.614 with 1 manvrs
2026-06-02 13:16:18,146 get_observations: Found observation 32363 at 2026:148:22:37:04.186 with 1 manvrs
2026-06-02 13:16:18,146 get_observations: Found observation 32362 at 2026:149:03:23:10.709 with 1 manvrs
2026-06-02 13:16:18,147 get_observations: Found observation 29860 at 2026:149:06:44:24.016 with 1 manvrs
2026-06-02 13:16:18,147 get_observations: Found observation 32365 at 2026:149:12:51:56.088 with 1 manvrs
2026-06-02 13:16:18,148 get_observations: Found observation 30170 at 2026:149:16:58:16.120 with 1 manvrs
2026-06-02 13:16:18,148 get_observations: Found observation 31523 at 2026:150:01:39:51.583 with 1 manvrs
2026-06-02 13:16:18,149 get_observations: Found observation 30952 at 2026:150:11:06:45.708 with 1 manvrs
2026-06-02 13:16:18,149 get_observations: Found observation 41454 at 2026:150:14:34:25.270 with 1 manvrs
2026-06-02 13:16:18,149 get_observations: Found observation 41453 at 2026:150:16:35:40.252 with 1 manvrs
2026-06-02 13:16:18,150 get_observations: Found observation 41452 at 2026:150:18:10:40.252 with 1 manvrs
2026-06-02 13:16:18,150 get_observations: Found observation 41451 at 2026:150:19:55:40.252 with 1 manvrs
2026-06-02 13:16:18,151 get_observations: Found observation 41450 at 2026:150:23:10:40.252 with 1 manvrs
2026-06-02 13:16:18,151 get_observations: Found observation 32359 at 2026:151:01:56:46.367 with 1 manvrs
2026-06-02 13:16:18,151 get_observations: Found observation 32366 at 2026:151:07:45:05.830 with 1 manvrs
2026-06-02 13:16:18,152 get_observations: Found observation 31522 at 2026:151:13:42:11.532 with 1 manvrs
2026-06-02 13:16:18,152 get_observations: Found observation 30126 at 2026:151:23:01:24.018 with 1 manvrs
2026-06-02 13:16:18,153 get_observations: Found observation 32368 at 2026:152:02:33:50.292 with 1 manvrs
2026-06-02 13:16:18,153 get_observations: Found observation 32242 at 2026:152:08:45:55.020 with 1 manvrs
2026-06-02 13:16:18,153 get_observations: Found observation 32377 at 2026:152:12:26:40.807 with 1 manvrs
2026-06-02 13:16:18,154 get_observations: Found observation 31449 at 2026:152:19:25:45.872 with 1 manvrs
2026-06-02 13:16:18,154 get_observations: Found observation 30535 at 2026:152:21:35:22.325 with 1 manvrs
2026-06-02 13:16:18,155 get_observations: Found observation 41449 at 2026:153:05:49:30.602 with 1 manvrs
2026-06-02 13:16:18,155 get_observations: Found observation 41448 at 2026:153:07:08:26.185 with 1 manvrs
2026-06-02 13:16:18,155 get_observations: Found observation 41447 at 2026:153:10:55:40.252 with 1 manvrs
2026-06-02 13:16:18,156 get_observations: Found observation 41446 at 2026:153:12:50:40.252 with 1 manvrs
2026-06-02 13:16:18,156 get_observations: Found observation 41445 at 2026:153:14:13:49.489 with 1 manvrs
2026-06-02 13:16:18,157 main: Found 40 observations
2026-06-02 13:16:18,157 main: ********************************************************************************
2026-06-02 13:16:18,157 main: Processing observation 32347
2026-06-02 13:16:18,157 main: ********************************************************************************
2026-06-02 13:16:18,213 obs_link_from_info: Found prev obsid 30417
2026-06-02 13:16:18,216 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 13:16:18,218 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:20,916 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/32347/centroid_resids.pkl
2026-06-02 12:16:20,919 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-02 12:16:20,919 plot_crs_time: Plot file exists, skipping
2026-06-02 12:16:20,919 plot_crs_scatter: Plot file exists, skipping
2026-06-02 12:16:21,009 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-02 12:16:21,785 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/32347/n_kalman_delta_roll.png
2026-06-02 12:16:22,006 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/32347/index.html
2026-06-02 12:16:22,008 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/32347/info.json
2026-06-02 12:16:22,010 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32347/index.html
2026-06-02 12:16:22,011 main:
2026-06-02 12:16:22,011 main: ********************************************************************************
2026-06-02 12:16:22,011 main: Processing observation 32364
2026-06-02 12:16:22,011 main: ********************************************************************************
2026-06-02 12:16:22,012 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,013 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,017 process_obs: ObsID 32364 already processed, skipping
2026-06-02 12:16:22,017 main:
2026-06-02 12:16:22,017 main: ********************************************************************************
2026-06-02 12:16:22,017 main: Processing observation 30097
2026-06-02 12:16:22,017 main: ********************************************************************************
2026-06-02 12:16:22,018 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,019 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,022 process_obs: ObsID 30097 already processed, skipping
2026-06-02 12:16:22,022 main:
2026-06-02 12:16:22,022 main: ********************************************************************************
2026-06-02 12:16:22,022 main: Processing observation 30430
2026-06-02 12:16:22,022 main: ********************************************************************************
2026-06-02 12:16:22,023 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,024 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,028 process_obs: ObsID 30430 already processed, skipping
2026-06-02 12:16:22,028 main:
2026-06-02 12:16:22,028 main: ********************************************************************************
2026-06-02 12:16:22,028 main: Processing observation 30437
2026-06-02 12:16:22,028 main: ********************************************************************************
2026-06-02 12:16:22,029 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,030 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,033 process_obs: ObsID 30437 already processed, skipping
2026-06-02 12:16:22,033 main:
2026-06-02 12:16:22,033 main: ********************************************************************************
2026-06-02 12:16:22,033 main: Processing observation 41460
2026-06-02 12:16:22,033 main: ********************************************************************************
2026-06-02 12:16:22,034 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,035 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,039 process_obs: ObsID 41460 already processed, skipping
2026-06-02 12:16:22,039 main:
2026-06-02 12:16:22,039 main: ********************************************************************************
2026-06-02 12:16:22,039 main: Processing observation 41459
2026-06-02 12:16:22,039 main: ********************************************************************************
2026-06-02 12:16:22,040 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,041 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,045 process_obs: ObsID 41459 already processed, skipping
2026-06-02 12:16:22,045 main:
2026-06-02 12:16:22,045 main: ********************************************************************************
2026-06-02 12:16:22,045 main: Processing observation 41458
2026-06-02 12:16:22,045 main: ********************************************************************************
2026-06-02 12:16:22,046 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,047 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,050 process_obs: ObsID 41458 already processed, skipping
2026-06-02 12:16:22,050 main:
2026-06-02 12:16:22,050 main: ********************************************************************************
2026-06-02 12:16:22,050 main: Processing observation 41457
2026-06-02 12:16:22,050 main: ********************************************************************************
2026-06-02 12:16:22,051 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,053 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,057 process_obs: ObsID 41457 already processed, skipping
2026-06-02 12:16:22,057 main:
2026-06-02 12:16:22,057 main: ********************************************************************************
2026-06-02 12:16:22,057 main: Processing observation 41456
2026-06-02 12:16:22,057 main: ********************************************************************************
2026-06-02 12:16:22,058 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,062 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,073 process_obs: ObsID 41456 already processed, skipping
2026-06-02 12:16:22,073 main:
2026-06-02 12:16:22,073 main: ********************************************************************************
2026-06-02 12:16:22,073 main: Processing observation 41455
2026-06-02 12:16:22,073 main: ********************************************************************************
2026-06-02 12:16:22,075 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,078 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,085 process_obs: ObsID 41455 already processed, skipping
2026-06-02 12:16:22,085 main:
2026-06-02 12:16:22,085 main: ********************************************************************************
2026-06-02 12:16:22,085 main: Processing observation 30202
2026-06-02 12:16:22,085 main: ********************************************************************************
2026-06-02 12:16:22,087 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,091 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,101 process_obs: ObsID 30202 already processed, skipping
2026-06-02 12:16:22,101 main:
2026-06-02 12:16:22,101 main: ********************************************************************************
2026-06-02 12:16:22,101 main: Processing observation 30398
2026-06-02 12:16:22,101 main: ********************************************************************************
2026-06-02 12:16:22,102 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,103 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,106 process_obs: ObsID 30398 already processed, skipping
2026-06-02 12:16:22,107 main:
2026-06-02 12:16:22,107 main: ********************************************************************************
2026-06-02 12:16:22,107 main: Processing observation 32361
2026-06-02 12:16:22,107 main: ********************************************************************************
2026-06-02 12:16:22,108 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,109 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,116 process_obs: ObsID 32361 already processed, skipping
2026-06-02 12:16:22,116 main:
2026-06-02 12:16:22,116 main: ********************************************************************************
2026-06-02 12:16:22,116 main: Processing observation 32363
2026-06-02 12:16:22,116 main: ********************************************************************************
2026-06-02 12:16:22,120 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,121 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,133 process_obs: ObsID 32363 already processed, skipping
2026-06-02 12:16:22,133 main:
2026-06-02 12:16:22,133 main: ********************************************************************************
2026-06-02 12:16:22,133 main: Processing observation 32362
2026-06-02 12:16:22,133 main: ********************************************************************************
2026-06-02 12:16:22,135 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,138 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,143 process_obs: ObsID 32362 already processed, skipping
2026-06-02 12:16:22,143 main:
2026-06-02 12:16:22,143 main: ********************************************************************************
2026-06-02 12:16:22,143 main: Processing observation 29860
2026-06-02 12:16:22,143 main: ********************************************************************************
2026-06-02 12:16:22,144 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,145 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,149 process_obs: ObsID 29860 already processed, skipping
2026-06-02 12:16:22,149 main:
2026-06-02 12:16:22,149 main: ********************************************************************************
2026-06-02 12:16:22,149 main: Processing observation 32365
2026-06-02 12:16:22,149 main: ********************************************************************************
2026-06-02 12:16:22,150 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,151 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,154 process_obs: ObsID 32365 already processed, skipping
2026-06-02 12:16:22,154 main:
2026-06-02 12:16:22,154 main: ********************************************************************************
2026-06-02 12:16:22,154 main: Processing observation 30170
2026-06-02 12:16:22,154 main: ********************************************************************************
2026-06-02 12:16:22,155 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,157 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:22,167 process_obs: ObsID 30170 already processed, skipping
2026-06-02 12:16:22,167 main:
2026-06-02 12:16:22,167 main: ********************************************************************************
2026-06-02 12:16:22,167 main: Processing observation 31523
2026-06-02 12:16:22,167 main: ********************************************************************************
2026-06-02 12:16:22,170 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:22,173 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:25,039 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/31523/centroid_resids.pkl
2026-06-02 12:16:25,055 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-02 12:16:25,056 plot_crs_time: Plot file exists, skipping
2026-06-02 12:16:25,056 plot_crs_scatter: Plot file exists, skipping
2026-06-02 12:16:26,138 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/31523/n_kalman_delta_roll.png
2026-06-02 12:16:34,824 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/31523/index.html
2026-06-02 12:16:34,826 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/31523/info.json
2026-06-02 12:16:34,830 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31523/index.html
2026-06-02 12:16:34,831 main:
2026-06-02 12:16:34,831 main: ********************************************************************************
2026-06-02 12:16:34,831 main: Processing observation 30952
2026-06-02 12:16:34,831 main: ********************************************************************************
2026-06-02 12:16:34,833 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:34,834 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:34,838 process_obs: ObsID 30952 already processed, skipping
2026-06-02 12:16:34,838 main:
2026-06-02 12:16:34,838 main: ********************************************************************************
2026-06-02 12:16:34,838 main: Processing observation 41454
2026-06-02 12:16:34,838 main: ********************************************************************************
2026-06-02 12:16:34,840 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:34,842 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:34,849 process_obs: ObsID 41454 already processed, skipping
2026-06-02 12:16:34,849 main:
2026-06-02 12:16:34,849 main: ********************************************************************************
2026-06-02 12:16:34,849 main: Processing observation 41453
2026-06-02 12:16:34,849 main: ********************************************************************************
2026-06-02 12:16:34,851 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:34,852 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:34,856 process_obs: ObsID 41453 already processed, skipping
2026-06-02 12:16:34,856 main:
2026-06-02 12:16:34,856 main: ********************************************************************************
2026-06-02 12:16:34,856 main: Processing observation 41452
2026-06-02 12:16:34,856 main: ********************************************************************************
2026-06-02 12:16:34,858 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:34,860 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:34,870 process_obs: ObsID 41452 already processed, skipping
2026-06-02 12:16:34,870 main:
2026-06-02 12:16:34,870 main: ********************************************************************************
2026-06-02 12:16:34,870 main: Processing observation 41451
2026-06-02 12:16:34,870 main: ********************************************************************************
2026-06-02 12:16:34,871 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:34,872 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:34,876 process_obs: ObsID 41451 already processed, skipping
2026-06-02 12:16:34,876 main:
2026-06-02 12:16:34,876 main: ********************************************************************************
2026-06-02 12:16:34,876 main: Processing observation 41450
2026-06-02 12:16:34,876 main: ********************************************************************************
2026-06-02 12:16:34,877 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:34,878 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:34,883 process_obs: ObsID 41450 already processed, skipping
2026-06-02 12:16:34,883 main:
2026-06-02 12:16:34,883 main: ********************************************************************************
2026-06-02 12:16:34,883 main: Processing observation 32359
2026-06-02 12:16:34,883 main: ********************************************************************************
2026-06-02 12:16:34,885 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:34,886 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:34,898 process_obs: ObsID 32359 already processed, skipping
2026-06-02 12:16:34,898 main:
2026-06-02 12:16:34,898 main: ********************************************************************************
2026-06-02 12:16:34,899 main: Processing observation 32366
2026-06-02 12:16:34,899 main: ********************************************************************************
2026-06-02 12:16:34,901 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:34,904 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:34,915 process_obs: ObsID 32366 already processed, skipping
2026-06-02 12:16:34,915 main:
2026-06-02 12:16:34,915 main: ********************************************************************************
2026-06-02 12:16:34,915 main: Processing observation 31522
2026-06-02 12:16:34,915 main: ********************************************************************************
2026-06-02 12:16:34,916 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:34,919 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY2526A/last.html
2026-06-02 12:16:34,938 process_obs: ObsID 31522 already processed, skipping
2026-06-02 12:16:34,938 main:
2026-06-02 12:16:34,938 main: ********************************************************************************
2026-06-02 12:16:34,938 main: Processing observation 30126
2026-06-02 12:16:34,938 main: ********************************************************************************
2026-06-02 12:16:34,941 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:34,942 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-02 12:16:40,387 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/30126/centroid_resids.pkl
2026-06-02 12:16:40,408 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-02 12:16:40,409 plot_crs_time: Plot file exists, skipping
2026-06-02 12:16:40,410 plot_crs_scatter: Plot file exists, skipping
2026-06-02 12:16:41,054 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/30126/n_kalman_delta_roll.png
2026-06-02 12:16:46,206 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/30126/index.html
2026-06-02 12:16:46,227 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/30126/info.json
2026-06-02 12:16:46,291 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30126/index.html
2026-06-02 12:16:46,293 main:
2026-06-02 12:16:46,293 main: ********************************************************************************
2026-06-02 12:16:46,293 main: Processing observation 32368
2026-06-02 12:16:46,293 main: ********************************************************************************
2026-06-02 12:16:46,294 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:46,296 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-02 12:16:54,843 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-02 12:16:55,458 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32368/centroid_resids.pkl with 5 slots
2026-06-02 12:16:55,549 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32368/centroid_resids_time.png
2026-06-02 12:16:55,883 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32368/centroid_resids_scatter.png
2026-06-02 12:16:57,032 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32368/n_kalman_delta_roll.png
2026-06-02 12:16:57,167 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32368/index.html
2026-06-02 12:16:57,168 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32368/info.json
2026-06-02 12:16:57,187 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32368/index.html
2026-06-02 12:16:57,188 main:
2026-06-02 12:16:57,188 main: ********************************************************************************
2026-06-02 12:16:57,188 main: Processing observation 32242
2026-06-02 12:16:57,188 main: ********************************************************************************
2026-06-02 12:16:57,189 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:16:57,190 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-02 12:16:59,509 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-02 12:17:00,102 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32242/centroid_resids.pkl with 5 slots
2026-06-02 12:17:00,151 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32242/centroid_resids_time.png
2026-06-02 12:17:00,396 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32242/centroid_resids_scatter.png
2026-06-02 12:17:01,192 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32242/n_kalman_delta_roll.png
2026-06-02 12:17:01,342 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32242/index.html
2026-06-02 12:17:01,343 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32242/info.json
2026-06-02 12:17:01,346 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32242/index.html
2026-06-02 12:17:01,348 main:
2026-06-02 12:17:01,348 main: ********************************************************************************
2026-06-02 12:17:01,348 main: Processing observation 32377
2026-06-02 12:17:01,348 main: ********************************************************************************
2026-06-02 12:17:01,349 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:17:01,350 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-02 12:17:04,541 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-02 12:17:05,066 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32377/centroid_resids.pkl with 5 slots
2026-06-02 12:17:05,121 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32377/centroid_resids_time.png
2026-06-02 12:17:05,381 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32377/centroid_resids_scatter.png
2026-06-02 12:17:06,317 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32377/n_kalman_delta_roll.png
2026-06-02 12:17:06,464 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32377/index.html
2026-06-02 12:17:06,466 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/32377/info.json
2026-06-02 12:17:06,468 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32377/index.html
2026-06-02 12:17:06,469 main:
2026-06-02 12:17:06,469 main: ********************************************************************************
2026-06-02 12:17:06,469 main: Processing observation 31449
2026-06-02 12:17:06,469 main: ********************************************************************************
2026-06-02 12:17:06,471 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:17:06,472 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-02 12:17:10,958 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-02 12:17:11,592 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/31449/centroid_resids.pkl with 5 slots
2026-06-02 12:17:11,646 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/31449/centroid_resids_time.png
2026-06-02 12:17:11,935 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/31449/centroid_resids_scatter.png
2026-06-02 12:17:12,490 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/31449/n_kalman_delta_roll.png
2026-06-02 12:17:12,637 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/31449/index.html
2026-06-02 12:17:12,643 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/31449/info.json
2026-06-02 12:17:12,659 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31449/index.html
2026-06-02 12:17:12,660 main:
2026-06-02 12:17:12,660 main: ********************************************************************************
2026-06-02 12:17:12,660 main: Processing observation 30535
2026-06-02 12:17:12,660 main: ********************************************************************************
2026-06-02 12:17:12,661 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:17:12,662 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-02 12:17:14,848 __init__: ObsID 30535 has insufficient telemetry, skipping
2026-06-02 12:17:14,849 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/30535/index.html
2026-06-02 12:17:14,853 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/30535/info.json
2026-06-02 12:17:14,854 main:
2026-06-02 12:17:14,854 main: ********************************************************************************
2026-06-02 12:17:14,854 main: Processing observation 41449
2026-06-02 12:17:14,854 main: ********************************************************************************
2026-06-02 12:17:14,856 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:17:14,857 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-02 12:17:17,229 __init__: ObsID 41449 has insufficient telemetry, skipping
2026-06-02 12:17:17,231 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/41449/index.html
2026-06-02 12:17:17,243 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/41449/info.json
2026-06-02 12:17:17,250 main:
2026-06-02 12:17:17,250 main: ********************************************************************************
2026-06-02 12:17:17,250 main: Processing observation 41448
2026-06-02 12:17:17,250 main: ********************************************************************************
2026-06-02 12:17:17,254 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:17:17,260 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-02 12:17:20,083 __init__: ObsID 41448 has insufficient telemetry, skipping
2026-06-02 12:17:20,090 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/41448/index.html
2026-06-02 12:17:20,099 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/41448/info.json
2026-06-02 12:17:20,102 main:
2026-06-02 12:17:20,102 main: ********************************************************************************
2026-06-02 12:17:20,102 main: Processing observation 41447
2026-06-02 12:17:20,102 main: ********************************************************************************
2026-06-02 12:17:20,104 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:17:20,105 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-02 12:17:22,729 __init__: ObsID 41447 has insufficient telemetry, skipping
2026-06-02 12:17:22,730 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/41447/index.html
2026-06-02 12:17:22,735 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/41447/info.json
2026-06-02 12:17:22,735 main:
2026-06-02 12:17:22,735 main: ********************************************************************************
2026-06-02 12:17:22,736 main: Processing observation 41446
2026-06-02 12:17:22,736 main: ********************************************************************************
2026-06-02 12:17:22,737 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:17:22,738 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-02 12:17:24,875 __init__: ObsID 41446 has insufficient telemetry, skipping
2026-06-02 12:17:24,875 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/41446/index.html
2026-06-02 12:17:24,880 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/41446/info.json
2026-06-02 12:17:24,880 main:
2026-06-02 12:17:24,880 main: ********************************************************************************
2026-06-02 12:17:24,881 main: Processing observation 41445
2026-06-02 12:17:24,881 main: ********************************************************************************
2026-06-02 12:17:24,881 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/41445/info.json file found, obs=None
2026-06-02 12:17:24,882 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-02 12:17:24,883 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-02 12:17:26,878 __init__: ObsID 41445 has no maneuver event in telemetry, skipping
2026-06-02 12:17:26,879 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/41445/index.html
2026-06-02 12:17:26,883 info: could not get attribute kalman_start for obsid 41445
2026-06-02 12:17:26,883 info: could not get attribute kalman_stop for obsid 41445
2026-06-02 12:17:26,883 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/41445/info.json
2026-06-02 12:17:26,884 main:
2026-06-02 13:17:28,360 run_check: Starting centroid dashboard continuity check
2026-06-02 13:17:28,361 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-06-02 13:17:28,363 collect_observations: Processing year 2020
2026-06-02 13:17:31,628 collect_observations: Processing year 2021
2026-06-02 13:17:34,383 collect_observations: Processing year 2022
2026-06-02 13:17:37,568 collect_observations: Processing year 2023
2026-06-02 13:17:40,657 collect_observations: Processing year 2024
2026-06-02 13:17:43,580 collect_observations: Processing year 2025
2026-06-02 13:17:46,731 collect_observations: Processing year 2026
2026-06-02 13:17:47,784 collect_observations: Collected 13963 observations from 4-digit years
2026-06-02 13:17:47,788 sort_observations_by_date: Sorted observations by date
2026-06-02 13:17:47,788 check_continuity: Starting continuity check from most recent: ObsID 41445 (JUN0126A) at 2026:153:13:45:06.000
2026-06-02 13:17:47,804 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-06-02 13:17:47,804 check_continuity: Chain complete: visited 13963 observations out of 13963 total
2026-06-02 13:17:47,805 run_check: ✓ Observation chain continuity check PASSED
2026-06-02 13:17:47,805 run_check: Summary: 13963 observations from 4-digit years, all properly linked