Prev
Index
Next
centroid_dashboard: Fri May 22 13:18:35 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Fri May 22 13:18:35 2026 |
No errors
File contents:
2026-05-22 13:16:16,571 main: Processing from 2026:135:17:16:16.570 to 2026:142:17:16:16.570
2026-05-22 13:16:24,055 get_observations: Found observation 30435 at 2026:135:20:09:04.743 with 2 manvrs
2026-05-22 13:16:24,057 get_observations: Found observation 41484 at 2026:136:00:44:14.743 with 1 manvrs
2026-05-22 13:16:24,057 get_observations: Found observation 30100 at 2026:136:01:33:28.102 with 1 manvrs
2026-05-22 13:16:24,058 get_observations: Found observation 32344 at 2026:136:10:26:10.662 with 1 manvrs
2026-05-22 13:16:24,058 get_observations: Found observation 41483 at 2026:136:14:28:00.662 with 1 manvrs
2026-05-22 13:16:24,058 get_observations: Found observation 32342 at 2026:136:15:20:50.267 with 1 manvrs
2026-05-22 13:16:24,059 get_observations: Found observation 32345 at 2026:136:19:04:08.886 with 2 manvrs
2026-05-22 13:16:24,059 get_observations: Found observation 32340 at 2026:136:22:59:25.425 with 1 manvrs
2026-05-22 13:16:24,060 get_observations: Found observation 32346 at 2026:137:02:37:54.692 with 1 manvrs
2026-05-22 13:16:24,060 get_observations: Found observation 32337 at 2026:137:06:16:32.700 with 1 manvrs
2026-05-22 13:16:24,060 get_observations: Found observation 41481 at 2026:137:09:39:03.588 with 1 manvrs
2026-05-22 13:16:24,061 get_observations: Found observation 41480 at 2026:137:10:34:44.010 with 1 manvrs
2026-05-22 13:16:24,061 get_observations: Found observation 41479 at 2026:137:13:55:40.252 with 1 manvrs
2026-05-22 13:16:24,062 get_observations: Found observation 41478 at 2026:137:16:55:40.252 with 1 manvrs
2026-05-22 13:16:24,062 get_observations: Found observation 41477 at 2026:137:18:29:12.856 with 1 manvrs
2026-05-22 13:16:24,062 get_observations: Found observation 30394 at 2026:137:19:56:15.771 with 1 manvrs
2026-05-22 13:16:24,063 get_observations: Found observation 30191 at 2026:138:00:42:23.507 with 1 manvrs
2026-05-22 13:16:24,063 get_observations: Found observation 32355 at 2026:138:05:11:43.274 with 1 manvrs
2026-05-22 13:16:24,064 get_observations: Found observation 32352 at 2026:138:09:57:42.943 with 1 manvrs
2026-05-22 13:16:24,064 get_observations: Found observation 31883 at 2026:138:13:53:42.586 with 1 manvrs
2026-05-22 13:16:24,065 get_observations: Found observation 32353 at 2026:138:17:16:22.131 with 1 manvrs
2026-05-22 13:16:24,065 get_observations: Found observation 30247 at 2026:138:21:07:51.672 with 1 manvrs
2026-05-22 13:16:24,065 get_observations: Found observation 30206 at 2026:139:05:52:25.323 with 1 manvrs
2026-05-22 13:16:24,066 get_observations: Found observation 29879 at 2026:139:10:22:28.066 with 1 manvrs
2026-05-22 13:16:24,066 get_observations: Found observation 41476 at 2026:140:00:12:32.419 with 1 manvrs
2026-05-22 13:16:24,067 get_observations: Found observation 41475 at 2026:140:01:46:08.155 with 1 manvrs
2026-05-22 13:16:24,067 get_observations: Found observation 41474 at 2026:140:03:11:13.688 with 1 manvrs
2026-05-22 13:16:24,067 get_observations: Found observation 41473 at 2026:140:08:25:40.252 with 1 manvrs
2026-05-22 13:16:24,068 get_observations: Found observation 41472 at 2026:140:09:58:03.913 with 1 manvrs
2026-05-22 13:16:24,068 get_observations: Found observation 30086 at 2026:140:12:51:09.293 with 1 manvrs
2026-05-22 13:16:24,069 get_observations: Found observation 31395 at 2026:140:19:18:23.312 with 1 manvrs
2026-05-22 13:16:24,069 get_observations: Found observation 31372 at 2026:140:22:45:26.822 with 1 manvrs
2026-05-22 13:16:24,069 get_observations: Found observation 32354 at 2026:141:06:24:32.613 with 1 manvrs
2026-05-22 13:16:24,070 get_observations: Found observation 31373 at 2026:141:11:10:18.115 with 1 manvrs
2026-05-22 13:16:24,070 get_observations: Found observation 31377 at 2026:141:15:35:24.481 with 1 manvrs
2026-05-22 13:16:24,071 get_observations: Found observation 32349 at 2026:142:01:53:11.983 with 1 manvrs
2026-05-22 13:16:24,071 get_observations: Found observation 30511 at 2026:142:07:06:25.790 with 1 manvrs
2026-05-22 13:16:24,071 get_observations: Found observation 41471 at 2026:142:16:20:23.473 with 1 manvrs
2026-05-22 13:16:24,072 main: Found 38 observations
2026-05-22 13:16:24,072 main: ********************************************************************************
2026-05-22 13:16:24,072 main: Processing observation 30435
2026-05-22 13:16:24,072 main: ********************************************************************************
2026-05-22 13:16:24,078 obs_link_from_info: Found prev obsid 32251
2026-05-22 13:16:24,082 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,085 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-22 13:16:24,092 process_obs: ObsID 30435 already processed, skipping
2026-05-22 13:16:24,092 main:
2026-05-22 13:16:24,092 main: ********************************************************************************
2026-05-22 13:16:24,092 main: Processing observation 41484
2026-05-22 13:16:24,092 main: ********************************************************************************
2026-05-22 13:16:24,093 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,095 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-22 13:16:24,108 process_obs: ObsID 41484 already processed, skipping
2026-05-22 13:16:24,108 main:
2026-05-22 13:16:24,108 main: ********************************************************************************
2026-05-22 13:16:24,108 main: Processing observation 30100
2026-05-22 13:16:24,108 main: ********************************************************************************
2026-05-22 13:16:24,114 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,117 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-22 13:16:24,121 process_obs: ObsID 30100 already processed, skipping
2026-05-22 13:16:24,121 main:
2026-05-22 13:16:24,121 main: ********************************************************************************
2026-05-22 13:16:24,121 main: Processing observation 32344
2026-05-22 13:16:24,121 main: ********************************************************************************
2026-05-22 13:16:24,122 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,126 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-22 13:16:24,135 process_obs: ObsID 32344 already processed, skipping
2026-05-22 13:16:24,135 main:
2026-05-22 13:16:24,135 main: ********************************************************************************
2026-05-22 13:16:24,135 main: Processing observation 41483
2026-05-22 13:16:24,135 main: ********************************************************************************
2026-05-22 13:16:24,139 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,140 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-22 13:16:24,152 process_obs: ObsID 41483 already processed, skipping
2026-05-22 13:16:24,152 main:
2026-05-22 13:16:24,152 main: ********************************************************************************
2026-05-22 13:16:24,152 main: Processing observation 32342
2026-05-22 13:16:24,152 main: ********************************************************************************
2026-05-22 13:16:24,153 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,159 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-22 13:16:24,171 process_obs: ObsID 32342 already processed, skipping
2026-05-22 13:16:24,171 main:
2026-05-22 13:16:24,171 main: ********************************************************************************
2026-05-22 13:16:24,171 main: Processing observation 32345
2026-05-22 13:16:24,171 main: ********************************************************************************
2026-05-22 13:16:24,173 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,174 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-22 13:16:24,186 process_obs: ObsID 32345 already processed, skipping
2026-05-22 13:16:24,186 main:
2026-05-22 13:16:24,186 main: ********************************************************************************
2026-05-22 13:16:24,186 main: Processing observation 32340
2026-05-22 13:16:24,186 main: ********************************************************************************
2026-05-22 13:16:24,188 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,190 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-22 13:16:24,202 process_obs: ObsID 32340 already processed, skipping
2026-05-22 13:16:24,202 main:
2026-05-22 13:16:24,202 main: ********************************************************************************
2026-05-22 13:16:24,202 main: Processing observation 32346
2026-05-22 13:16:24,202 main: ********************************************************************************
2026-05-22 13:16:24,206 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,212 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-22 13:16:24,221 process_obs: ObsID 32346 already processed, skipping
2026-05-22 13:16:24,221 main:
2026-05-22 13:16:24,221 main: ********************************************************************************
2026-05-22 13:16:24,221 main: Processing observation 32337
2026-05-22 13:16:24,221 main: ********************************************************************************
2026-05-22 13:16:24,224 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,228 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-22 13:16:24,241 process_obs: ObsID 32337 already processed, skipping
2026-05-22 13:16:24,241 main:
2026-05-22 13:16:24,241 main: ********************************************************************************
2026-05-22 13:16:24,241 main: Processing observation 41481
2026-05-22 13:16:24,241 main: ********************************************************************************
2026-05-22 13:16:24,242 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,248 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-22 13:16:24,258 process_obs: ObsID 41481 already processed, skipping
2026-05-22 13:16:24,258 main:
2026-05-22 13:16:24,258 main: ********************************************************************************
2026-05-22 13:16:24,258 main: Processing observation 41480
2026-05-22 13:16:24,258 main: ********************************************************************************
2026-05-22 13:16:24,260 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,266 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,279 process_obs: ObsID 41480 already processed, skipping
2026-05-22 13:16:24,279 main:
2026-05-22 13:16:24,279 main: ********************************************************************************
2026-05-22 13:16:24,279 main: Processing observation 41479
2026-05-22 13:16:24,279 main: ********************************************************************************
2026-05-22 13:16:24,281 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,285 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,317 process_obs: ObsID 41479 already processed, skipping
2026-05-22 13:16:24,317 main:
2026-05-22 13:16:24,317 main: ********************************************************************************
2026-05-22 13:16:24,317 main: Processing observation 41478
2026-05-22 13:16:24,317 main: ********************************************************************************
2026-05-22 13:16:24,319 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,321 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,334 process_obs: ObsID 41478 already processed, skipping
2026-05-22 13:16:24,334 main:
2026-05-22 13:16:24,334 main: ********************************************************************************
2026-05-22 13:16:24,334 main: Processing observation 41477
2026-05-22 13:16:24,334 main: ********************************************************************************
2026-05-22 13:16:24,335 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,336 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,356 process_obs: ObsID 41477 already processed, skipping
2026-05-22 13:16:24,356 main:
2026-05-22 13:16:24,356 main: ********************************************************************************
2026-05-22 13:16:24,356 main: Processing observation 30394
2026-05-22 13:16:24,356 main: ********************************************************************************
2026-05-22 13:16:24,373 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,401 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,495 process_obs: ObsID 30394 already processed, skipping
2026-05-22 13:16:24,495 main:
2026-05-22 13:16:24,495 main: ********************************************************************************
2026-05-22 13:16:24,495 main: Processing observation 30191
2026-05-22 13:16:24,495 main: ********************************************************************************
2026-05-22 13:16:24,502 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,511 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,585 process_obs: ObsID 30191 already processed, skipping
2026-05-22 13:16:24,585 main:
2026-05-22 13:16:24,585 main: ********************************************************************************
2026-05-22 13:16:24,585 main: Processing observation 32355
2026-05-22 13:16:24,585 main: ********************************************************************************
2026-05-22 13:16:24,603 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,625 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,690 process_obs: ObsID 32355 already processed, skipping
2026-05-22 13:16:24,690 main:
2026-05-22 13:16:24,690 main: ********************************************************************************
2026-05-22 13:16:24,690 main: Processing observation 32352
2026-05-22 13:16:24,690 main: ********************************************************************************
2026-05-22 13:16:24,703 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,721 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,791 process_obs: ObsID 32352 already processed, skipping
2026-05-22 13:16:24,791 main:
2026-05-22 13:16:24,791 main: ********************************************************************************
2026-05-22 13:16:24,791 main: Processing observation 31883
2026-05-22 13:16:24,791 main: ********************************************************************************
2026-05-22 13:16:24,797 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,809 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,841 process_obs: ObsID 31883 already processed, skipping
2026-05-22 13:16:24,841 main:
2026-05-22 13:16:24,841 main: ********************************************************************************
2026-05-22 13:16:24,841 main: Processing observation 32353
2026-05-22 13:16:24,841 main: ********************************************************************************
2026-05-22 13:16:24,848 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,852 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,896 process_obs: ObsID 32353 already processed, skipping
2026-05-22 13:16:24,896 main:
2026-05-22 13:16:24,896 main: ********************************************************************************
2026-05-22 13:16:24,896 main: Processing observation 30247
2026-05-22 13:16:24,896 main: ********************************************************************************
2026-05-22 13:16:24,901 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,910 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,922 process_obs: ObsID 30247 already processed, skipping
2026-05-22 13:16:24,922 main:
2026-05-22 13:16:24,922 main: ********************************************************************************
2026-05-22 13:16:24,922 main: Processing observation 30206
2026-05-22 13:16:24,922 main: ********************************************************************************
2026-05-22 13:16:24,923 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,941 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 13:16:24,965 process_obs: ObsID 30206 already processed, skipping
2026-05-22 13:16:24,965 main:
2026-05-22 13:16:24,965 main: ********************************************************************************
2026-05-22 13:16:24,965 main: Processing observation 29879
2026-05-22 13:16:24,965 main: ********************************************************************************
2026-05-22 13:16:24,970 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 13:16:24,978 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:29,410 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/29879/centroid_resids.pkl
2026-05-22 12:16:29,435 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-22 12:16:29,435 plot_crs_time: Plot file exists, skipping
2026-05-22 12:16:29,436 plot_crs_scatter: Plot file exists, skipping
2026-05-22 12:16:31,668 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/29879/n_kalman_delta_roll.png
2026-05-22 12:16:35,901 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/29879/index.html
2026-05-22 12:16:35,911 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/29879/info.json
2026-05-22 12:16:35,926 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29879/index.html
2026-05-22 12:16:35,927 main:
2026-05-22 12:16:35,927 main: ********************************************************************************
2026-05-22 12:16:35,927 main: Processing observation 41476
2026-05-22 12:16:35,927 main: ********************************************************************************
2026-05-22 12:16:35,932 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:35,937 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:35,953 process_obs: ObsID 41476 already processed, skipping
2026-05-22 12:16:35,953 main:
2026-05-22 12:16:35,953 main: ********************************************************************************
2026-05-22 12:16:35,953 main: Processing observation 41475
2026-05-22 12:16:35,953 main: ********************************************************************************
2026-05-22 12:16:35,955 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:35,959 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:35,968 process_obs: ObsID 41475 already processed, skipping
2026-05-22 12:16:35,968 main:
2026-05-22 12:16:35,969 main: ********************************************************************************
2026-05-22 12:16:35,969 main: Processing observation 41474
2026-05-22 12:16:35,969 main: ********************************************************************************
2026-05-22 12:16:35,974 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:35,979 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:35,995 process_obs: ObsID 41474 already processed, skipping
2026-05-22 12:16:35,995 main:
2026-05-22 12:16:35,995 main: ********************************************************************************
2026-05-22 12:16:35,995 main: Processing observation 41473
2026-05-22 12:16:35,995 main: ********************************************************************************
2026-05-22 12:16:35,996 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:36,002 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:36,034 process_obs: ObsID 41473 already processed, skipping
2026-05-22 12:16:36,034 main:
2026-05-22 12:16:36,034 main: ********************************************************************************
2026-05-22 12:16:36,034 main: Processing observation 41472
2026-05-22 12:16:36,034 main: ********************************************************************************
2026-05-22 12:16:36,039 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:36,044 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:36,073 process_obs: ObsID 41472 already processed, skipping
2026-05-22 12:16:36,073 main:
2026-05-22 12:16:36,073 main: ********************************************************************************
2026-05-22 12:16:36,073 main: Processing observation 30086
2026-05-22 12:16:36,073 main: ********************************************************************************
2026-05-22 12:16:36,083 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:36,088 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:36,111 process_obs: ObsID 30086 already processed, skipping
2026-05-22 12:16:36,111 main:
2026-05-22 12:16:36,111 main: ********************************************************************************
2026-05-22 12:16:36,111 main: Processing observation 31395
2026-05-22 12:16:36,111 main: ********************************************************************************
2026-05-22 12:16:36,124 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:36,127 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:36,168 process_obs: ObsID 31395 already processed, skipping
2026-05-22 12:16:36,168 main:
2026-05-22 12:16:36,168 main: ********************************************************************************
2026-05-22 12:16:36,168 main: Processing observation 31372
2026-05-22 12:16:36,168 main: ********************************************************************************
2026-05-22 12:16:36,177 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:36,182 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:39,323 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-22 12:16:39,789 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31372/centroid_resids.pkl with 5 slots
2026-05-22 12:16:39,846 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31372/centroid_resids_time.png
2026-05-22 12:16:40,192 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31372/centroid_resids_scatter.png
2026-05-22 12:16:41,431 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31372/n_kalman_delta_roll.png
2026-05-22 12:16:44,411 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31372/index.html
2026-05-22 12:16:44,415 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31372/info.json
2026-05-22 12:16:44,428 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31372/index.html
2026-05-22 12:16:44,433 main:
2026-05-22 12:16:44,433 main: ********************************************************************************
2026-05-22 12:16:44,433 main: Processing observation 32354
2026-05-22 12:16:44,433 main: ********************************************************************************
2026-05-22 12:16:44,441 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:44,444 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:47,113 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-22 12:16:47,752 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32354/centroid_resids.pkl with 5 slots
2026-05-22 12:16:47,806 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32354/centroid_resids_time.png
2026-05-22 12:16:48,278 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32354/centroid_resids_scatter.png
2026-05-22 12:16:49,195 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32354/n_kalman_delta_roll.png
2026-05-22 12:16:49,378 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32354/index.html
2026-05-22 12:16:49,385 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32354/info.json
2026-05-22 12:16:49,387 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32354/index.html
2026-05-22 12:16:49,388 main:
2026-05-22 12:16:49,388 main: ********************************************************************************
2026-05-22 12:16:49,388 main: Processing observation 31373
2026-05-22 12:16:49,388 main: ********************************************************************************
2026-05-22 12:16:49,391 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:49,398 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:51,887 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-22 12:16:52,649 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31373/centroid_resids.pkl with 5 slots
2026-05-22 12:16:52,698 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31373/centroid_resids_time.png
2026-05-22 12:16:52,970 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31373/centroid_resids_scatter.png
2026-05-22 12:16:53,818 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31373/n_kalman_delta_roll.png
2026-05-22 12:16:54,133 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31373/index.html
2026-05-22 12:16:54,134 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31373/info.json
2026-05-22 12:16:54,140 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31373/index.html
2026-05-22 12:16:54,142 main:
2026-05-22 12:16:54,142 main: ********************************************************************************
2026-05-22 12:16:54,142 main: Processing observation 31377
2026-05-22 12:16:54,142 main: ********************************************************************************
2026-05-22 12:16:54,145 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:54,146 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:16:56,587 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-22 12:16:56,920 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31377/centroid_resids.pkl with 5 slots
2026-05-22 12:16:56,982 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31377/centroid_resids_time.png
2026-05-22 12:16:57,379 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31377/centroid_resids_scatter.png
2026-05-22 12:16:57,676 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-05-22 12:16:57,785 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31377/n_kalman_delta_roll.png
2026-05-22 12:16:57,912 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31377/index.html
2026-05-22 12:16:57,914 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31377/info.json
2026-05-22 12:16:57,924 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31377/index.html
2026-05-22 12:16:57,926 main:
2026-05-22 12:16:57,926 main: ********************************************************************************
2026-05-22 12:16:57,926 main: Processing observation 32349
2026-05-22 12:16:57,926 main: ********************************************************************************
2026-05-22 12:16:57,928 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:16:57,931 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:17:00,638 __init__: ObsID 32349 has insufficient telemetry, skipping
2026-05-22 12:17:00,640 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32349/index.html
2026-05-22 12:17:00,648 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32349/info.json
2026-05-22 12:17:00,651 main:
2026-05-22 12:17:00,651 main: ********************************************************************************
2026-05-22 12:17:00,651 main: Processing observation 30511
2026-05-22 12:17:00,651 main: ********************************************************************************
2026-05-22 12:17:00,657 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:17:00,664 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:17:03,745 __init__: ObsID 30511 has no maneuver event in telemetry, skipping
2026-05-22 12:17:03,753 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30511/index.html
2026-05-22 12:17:03,765 info: could not get attribute kalman_start for obsid 30511
2026-05-22 12:17:03,765 info: could not get attribute kalman_stop for obsid 30511
2026-05-22 12:17:03,765 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30511/info.json
2026-05-22 12:17:03,771 main:
2026-05-22 12:17:03,771 main: ********************************************************************************
2026-05-22 12:17:03,771 main: Processing observation 41471
2026-05-22 12:17:03,771 main: ********************************************************************************
2026-05-22 12:17:03,773 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/41471/info.json file found, obs=None
2026-05-22 12:17:03,778 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-22 12:17:03,785 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-22 12:17:08,616 __init__: ObsID 41471 has no maneuver event in telemetry, skipping
2026-05-22 12:17:08,616 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/41471/index.html
2026-05-22 12:17:08,621 info: could not get attribute kalman_start for obsid 41471
2026-05-22 12:17:08,621 info: could not get attribute kalman_stop for obsid 41471
2026-05-22 12:17:08,621 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/41471/info.json
2026-05-22 12:17:08,623 main:
2026-05-22 13:17:10,595 run_check: Starting centroid dashboard continuity check
2026-05-22 13:17:10,595 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-05-22 13:17:10,597 collect_observations: Processing year 2020
2026-05-22 13:17:18,349 collect_observations: Processing year 2021
2026-05-22 13:17:28,587 collect_observations: Processing year 2022
2026-05-22 13:17:43,075 collect_observations: Processing year 2023
2026-05-22 13:17:57,729 collect_observations: Processing year 2024
2026-05-22 13:18:12,903 collect_observations: Processing year 2025
2026-05-22 13:18:29,681 collect_observations: Processing year 2026
2026-05-22 13:18:35,264 collect_observations: Collected 13900 observations from 4-digit years
2026-05-22 13:18:35,269 sort_observations_by_date: Sorted observations by date
2026-05-22 13:18:35,269 check_continuity: Starting continuity check from most recent: ObsID 41471 (MAY1826A) at 2026:142:15:58:24.343
2026-05-22 13:18:35,288 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-05-22 13:18:35,288 check_continuity: Chain complete: visited 13900 observations out of 13900 total
2026-05-22 13:18:35,288 run_check: ✓ Observation chain continuity check PASSED
2026-05-22 13:18:35,288 run_check: Summary: 13900 observations from 4-digit years, all properly linked