Prev
Index
Next
centroid_dashboard: Tue Jun 16 13:21:03 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Tue Jun 16 13:21:03 2026 |
No errors
File contents:
2026-06-16 13:16:19,590 main: Processing from 2026:160:17:16:19.590 to 2026:167:17:16:19.590
2026-06-16 13:16:34,419 get_observations: Found observation 32378 at 2026:160:20:08:56.428 with 1 manvrs
2026-06-16 13:16:34,420 get_observations: Found observation 29654 at 2026:160:23:33:45.523 with 1 manvrs
2026-06-16 13:16:34,420 get_observations: Found observation 41430 at 2026:161:03:33:59.628 with 1 manvrs
2026-06-16 13:16:34,421 get_observations: Found observation 41429 at 2026:161:10:55:40.252 with 1 manvrs
2026-06-16 13:16:34,421 get_observations: Found observation 41428 at 2026:161:12:29:11.989 with 1 manvrs
2026-06-16 13:16:34,422 get_observations: Found observation 30541 at 2026:161:16:35:02.622 with 1 manvrs
2026-06-16 13:16:34,422 get_observations: Found observation 30506 at 2026:161:20:19:28.629 with 1 manvrs
2026-06-16 13:16:34,424 get_observations: Found observation 32388 at 2026:162:00:50:34.625 with 1 manvrs
2026-06-16 13:16:34,424 get_observations: Found observation 29955 at 2026:162:05:52:26.116 with 2 manvrs
2026-06-16 13:16:34,425 get_observations: Found observation 32389 at 2026:162:12:29:52.770 with 1 manvrs
2026-06-16 13:16:34,425 get_observations: Found observation 32357 at 2026:162:17:34:31.392 with 2 manvrs
2026-06-16 13:16:34,426 get_observations: Found observation 32358 at 2026:162:19:20:13.710 with 1 manvrs
2026-06-16 13:16:34,426 get_observations: Found observation 30137 at 2026:162:21:19:46.681 with 1 manvrs
2026-06-16 13:16:34,427 get_observations: Found observation 29801 at 2026:163:01:06:15.059 with 2 manvrs
2026-06-16 13:16:34,427 get_observations: Found observation 32386 at 2026:163:07:38:46.206 with 2 manvrs
2026-06-16 13:16:34,428 get_observations: Found observation 32384 at 2026:163:13:04:39.420 with 2 manvrs
2026-06-16 13:16:34,428 get_observations: Found observation 41422 at 2026:163:19:10:10.242 with 1 manvrs
2026-06-16 13:16:34,429 get_observations: Found observation 41421 at 2026:163:20:28:22.080 with 1 manvrs
2026-06-16 13:16:34,429 get_observations: Found observation 41420 at 2026:164:01:25:40.252 with 1 manvrs
2026-06-16 13:16:34,430 get_observations: Found observation 41419 at 2026:164:03:00:18.672 with 1 manvrs
2026-06-16 13:16:34,430 get_observations: Found observation 30139 at 2026:164:07:48:01.931 with 1 manvrs
2026-06-16 13:16:34,431 get_observations: Found observation 31409 at 2026:164:12:19:36.642 with 2 manvrs
2026-06-16 13:16:34,431 get_observations: Found observation 32385 at 2026:164:18:10:51.593 with 1 manvrs
2026-06-16 13:16:34,432 get_observations: Found observation 32383 at 2026:164:21:36:50.013 with 1 manvrs
2026-06-16 13:16:34,432 get_observations: Found observation 32381 at 2026:165:09:17:52.138 with 1 manvrs
2026-06-16 13:16:34,433 get_observations: Found observation 30538 at 2026:165:12:43:47.227 with 1 manvrs
2026-06-16 13:16:34,433 get_observations: Found observation 32391 at 2026:165:17:32:48.599 with 1 manvrs
2026-06-16 13:16:34,434 get_observations: Found observation 32387 at 2026:165:20:58:28.632 with 1 manvrs
2026-06-16 13:16:34,434 get_observations: Found observation 31140 at 2026:166:01:50:25.659 with 1 manvrs
2026-06-16 13:16:34,435 get_observations: Found observation 32402 at 2026:166:05:14:32.257 with 1 manvrs
2026-06-16 13:16:34,435 get_observations: Found observation 41417 at 2026:166:11:08:12.535 with 1 manvrs
2026-06-16 13:16:34,436 get_observations: Found observation 41416 at 2026:166:12:24:05.295 with 1 manvrs
2026-06-16 13:16:34,436 get_observations: Found observation 41415 at 2026:166:14:40:34.338 with 1 manvrs
2026-06-16 13:16:34,437 get_observations: Found observation 41414 at 2026:166:19:55:40.252 with 1 manvrs
2026-06-16 13:16:34,437 get_observations: Found observation 41413 at 2026:166:20:43:55.444 with 1 manvrs
2026-06-16 13:16:34,438 get_observations: Found observation 29995 at 2026:166:22:53:01.073 with 1 manvrs
2026-06-16 13:16:34,438 get_observations: Found observation 32147 at 2026:167:02:18:31.207 with 1 manvrs
2026-06-16 13:16:34,439 get_observations: Found observation 29985 at 2026:167:06:35:01.367 with 1 manvrs
2026-06-16 13:16:34,439 get_observations: Found observation 29925 at 2026:167:11:39:25.325 with 1 manvrs
2026-06-16 13:16:34,440 main: Found 39 observations
2026-06-16 13:16:34,440 main: ********************************************************************************
2026-06-16 13:16:34,440 main: Processing observation 32378
2026-06-16 13:16:34,440 main: ********************************************************************************
2026-06-16 13:16:34,510 obs_link_from_info: Found prev obsid 29922
2026-06-16 13:16:34,565 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:34,606 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:34,706 process_obs: ObsID 32378 already processed, skipping
2026-06-16 13:16:34,706 main:
2026-06-16 13:16:34,706 main: ********************************************************************************
2026-06-16 13:16:34,706 main: Processing observation 29654
2026-06-16 13:16:34,706 main: ********************************************************************************
2026-06-16 13:16:34,726 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:34,754 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:34,901 process_obs: ObsID 29654 already processed, skipping
2026-06-16 13:16:34,902 main:
2026-06-16 13:16:34,902 main: ********************************************************************************
2026-06-16 13:16:34,902 main: Processing observation 41430
2026-06-16 13:16:34,902 main: ********************************************************************************
2026-06-16 13:16:34,921 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:34,949 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,109 process_obs: ObsID 41430 already processed, skipping
2026-06-16 13:16:35,110 main:
2026-06-16 13:16:35,110 main: ********************************************************************************
2026-06-16 13:16:35,110 main: Processing observation 41429
2026-06-16 13:16:35,110 main: ********************************************************************************
2026-06-16 13:16:35,126 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,149 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,246 process_obs: ObsID 41429 already processed, skipping
2026-06-16 13:16:35,246 main:
2026-06-16 13:16:35,246 main: ********************************************************************************
2026-06-16 13:16:35,246 main: Processing observation 41428
2026-06-16 13:16:35,246 main: ********************************************************************************
2026-06-16 13:16:35,256 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,266 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,361 process_obs: ObsID 41428 already processed, skipping
2026-06-16 13:16:35,362 main:
2026-06-16 13:16:35,362 main: ********************************************************************************
2026-06-16 13:16:35,362 main: Processing observation 30541
2026-06-16 13:16:35,362 main: ********************************************************************************
2026-06-16 13:16:35,377 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,410 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,531 process_obs: ObsID 30541 already processed, skipping
2026-06-16 13:16:35,531 main:
2026-06-16 13:16:35,531 main: ********************************************************************************
2026-06-16 13:16:35,531 main: Processing observation 30506
2026-06-16 13:16:35,531 main: ********************************************************************************
2026-06-16 13:16:35,537 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,549 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,629 process_obs: ObsID 30506 already processed, skipping
2026-06-16 13:16:35,630 main:
2026-06-16 13:16:35,630 main: ********************************************************************************
2026-06-16 13:16:35,630 main: Processing observation 32388
2026-06-16 13:16:35,630 main: ********************************************************************************
2026-06-16 13:16:35,641 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,659 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,725 process_obs: ObsID 32388 already processed, skipping
2026-06-16 13:16:35,726 main:
2026-06-16 13:16:35,726 main: ********************************************************************************
2026-06-16 13:16:35,726 main: Processing observation 29955
2026-06-16 13:16:35,726 main: ********************************************************************************
2026-06-16 13:16:35,737 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,757 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,833 process_obs: ObsID 29955 already processed, skipping
2026-06-16 13:16:35,833 main:
2026-06-16 13:16:35,833 main: ********************************************************************************
2026-06-16 13:16:35,833 main: Processing observation 32389
2026-06-16 13:16:35,833 main: ********************************************************************************
2026-06-16 13:16:35,841 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,851 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,880 process_obs: ObsID 32389 already processed, skipping
2026-06-16 13:16:35,880 main:
2026-06-16 13:16:35,880 main: ********************************************************************************
2026-06-16 13:16:35,880 main: Processing observation 32357
2026-06-16 13:16:35,880 main: ********************************************************************************
2026-06-16 13:16:35,881 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,882 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,886 process_obs: ObsID 32357 already processed, skipping
2026-06-16 13:16:35,886 main:
2026-06-16 13:16:35,886 main: ********************************************************************************
2026-06-16 13:16:35,886 main: Processing observation 32358
2026-06-16 13:16:35,886 main: ********************************************************************************
2026-06-16 13:16:35,887 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,888 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,916 process_obs: ObsID 32358 already processed, skipping
2026-06-16 13:16:35,916 main:
2026-06-16 13:16:35,916 main: ********************************************************************************
2026-06-16 13:16:35,916 main: Processing observation 30137
2026-06-16 13:16:35,916 main: ********************************************************************************
2026-06-16 13:16:35,917 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,918 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,949 process_obs: ObsID 30137 already processed, skipping
2026-06-16 13:16:35,949 main:
2026-06-16 13:16:35,949 main: ********************************************************************************
2026-06-16 13:16:35,949 main: Processing observation 29801
2026-06-16 13:16:35,949 main: ********************************************************************************
2026-06-16 13:16:35,950 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,951 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:35,993 process_obs: ObsID 29801 already processed, skipping
2026-06-16 13:16:35,993 main:
2026-06-16 13:16:35,993 main: ********************************************************************************
2026-06-16 13:16:35,993 main: Processing observation 32386
2026-06-16 13:16:35,993 main: ********************************************************************************
2026-06-16 13:16:35,994 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:35,995 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:36,029 process_obs: ObsID 32386 already processed, skipping
2026-06-16 13:16:36,029 main:
2026-06-16 13:16:36,029 main: ********************************************************************************
2026-06-16 13:16:36,029 main: Processing observation 32384
2026-06-16 13:16:36,029 main: ********************************************************************************
2026-06-16 13:16:36,030 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:36,031 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:36,076 process_obs: ObsID 32384 already processed, skipping
2026-06-16 13:16:36,076 main:
2026-06-16 13:16:36,076 main: ********************************************************************************
2026-06-16 13:16:36,076 main: Processing observation 41422
2026-06-16 13:16:36,076 main: ********************************************************************************
2026-06-16 13:16:36,077 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:36,078 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:36,097 process_obs: ObsID 41422 already processed, skipping
2026-06-16 13:16:36,097 main:
2026-06-16 13:16:36,097 main: ********************************************************************************
2026-06-16 13:16:36,097 main: Processing observation 41421
2026-06-16 13:16:36,097 main: ********************************************************************************
2026-06-16 13:16:36,098 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:36,099 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:36,138 process_obs: ObsID 41421 already processed, skipping
2026-06-16 13:16:36,138 main:
2026-06-16 13:16:36,138 main: ********************************************************************************
2026-06-16 13:16:36,138 main: Processing observation 41420
2026-06-16 13:16:36,138 main: ********************************************************************************
2026-06-16 13:16:36,139 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:36,140 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:36,154 process_obs: ObsID 41420 already processed, skipping
2026-06-16 13:16:36,154 main:
2026-06-16 13:16:36,154 main: ********************************************************************************
2026-06-16 13:16:36,154 main: Processing observation 41419
2026-06-16 13:16:36,154 main: ********************************************************************************
2026-06-16 13:16:36,155 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:36,156 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:36,194 process_obs: ObsID 41419 already processed, skipping
2026-06-16 13:16:36,195 main:
2026-06-16 13:16:36,195 main: ********************************************************************************
2026-06-16 13:16:36,195 main: Processing observation 30139
2026-06-16 13:16:36,195 main: ********************************************************************************
2026-06-16 13:16:36,206 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:36,207 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:36,238 process_obs: ObsID 30139 already processed, skipping
2026-06-16 13:16:36,238 main:
2026-06-16 13:16:36,238 main: ********************************************************************************
2026-06-16 13:16:36,238 main: Processing observation 31409
2026-06-16 13:16:36,238 main: ********************************************************************************
2026-06-16 13:16:36,239 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:36,240 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:36,322 process_obs: ObsID 31409 already processed, skipping
2026-06-16 13:16:36,322 main:
2026-06-16 13:16:36,322 main: ********************************************************************************
2026-06-16 13:16:36,322 main: Processing observation 32385
2026-06-16 13:16:36,322 main: ********************************************************************************
2026-06-16 13:16:36,323 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:36,324 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 13:16:36,373 process_obs: ObsID 32385 already processed, skipping
2026-06-16 13:16:36,374 main:
2026-06-16 13:16:36,374 main: ********************************************************************************
2026-06-16 13:16:36,374 main: Processing observation 32383
2026-06-16 13:16:36,374 main: ********************************************************************************
2026-06-16 13:16:36,375 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 13:16:36,376 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 12:16:43,701 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/centroid_resids.pkl
2026-06-16 12:16:43,747 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-16 12:16:43,748 plot_crs_time: Plot file exists, skipping
2026-06-16 12:16:43,748 plot_crs_scatter: Plot file exists, skipping
2026-06-16 12:16:44,046 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-16 12:16:45,141 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/n_kalman_delta_roll.png
2026-06-16 12:16:53,046 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/index.html
2026-06-16 12:16:53,066 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/info.json
2026-06-16 12:16:53,190 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32383/index.html
2026-06-16 12:16:53,218 main:
2026-06-16 12:16:53,218 main: ********************************************************************************
2026-06-16 12:16:53,218 main: Processing observation 32381
2026-06-16 12:16:53,218 main: ********************************************************************************
2026-06-16 12:16:53,234 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:16:53,249 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 12:16:53,274 process_obs: ObsID 32381 already processed, skipping
2026-06-16 12:16:53,274 main:
2026-06-16 12:16:53,274 main: ********************************************************************************
2026-06-16 12:16:53,274 main: Processing observation 30538
2026-06-16 12:16:53,274 main: ********************************************************************************
2026-06-16 12:16:53,276 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:16:53,277 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 12:16:53,295 process_obs: ObsID 30538 already processed, skipping
2026-06-16 12:16:53,295 main:
2026-06-16 12:16:53,295 main: ********************************************************************************
2026-06-16 12:16:53,295 main: Processing observation 32391
2026-06-16 12:16:53,295 main: ********************************************************************************
2026-06-16 12:16:53,296 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:16:53,297 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 12:16:53,318 process_obs: ObsID 32391 already processed, skipping
2026-06-16 12:16:53,318 main:
2026-06-16 12:16:53,318 main: ********************************************************************************
2026-06-16 12:16:53,318 main: Processing observation 32387
2026-06-16 12:16:53,318 main: ********************************************************************************
2026-06-16 12:16:53,319 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:16:53,320 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-16 12:16:55,364 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32387/centroid_resids.pkl
2026-06-16 12:16:55,416 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-16 12:16:55,416 plot_crs_time: Plot file exists, skipping
2026-06-16 12:16:55,416 plot_crs_scatter: Plot file exists, skipping
2026-06-16 12:16:55,975 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32387/n_kalman_delta_roll.png
2026-06-16 12:16:58,470 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32387/index.html
2026-06-16 12:16:58,472 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32387/info.json
2026-06-16 12:16:58,485 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32387/index.html
2026-06-16 12:16:58,486 main:
2026-06-16 12:16:58,486 main: ********************************************************************************
2026-06-16 12:16:58,486 main: Processing observation 31140
2026-06-16 12:16:58,486 main: ********************************************************************************
2026-06-16 12:16:58,499 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:16:58,500 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-16 12:17:00,640 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-16 12:17:02,292 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/31140/centroid_resids.pkl with 5 slots
2026-06-16 12:17:02,343 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/31140/centroid_resids_time.png
2026-06-16 12:17:02,833 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/31140/centroid_resids_scatter.png
2026-06-16 12:17:03,504 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/31140/n_kalman_delta_roll.png
2026-06-16 12:17:03,675 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/31140/index.html
2026-06-16 12:17:03,698 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/31140/info.json
2026-06-16 12:17:03,739 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31140/index.html
2026-06-16 12:17:03,740 main:
2026-06-16 12:17:03,740 main: ********************************************************************************
2026-06-16 12:17:03,740 main: Processing observation 32402
2026-06-16 12:17:03,740 main: ********************************************************************************
2026-06-16 12:17:03,741 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:17:03,744 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-16 12:17:06,221 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-16 12:17:07,132 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/32402/centroid_resids.pkl with 5 slots
2026-06-16 12:17:07,417 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/32402/centroid_resids_time.png
2026-06-16 12:17:08,425 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/32402/centroid_resids_scatter.png
2026-06-16 12:17:09,541 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/32402/n_kalman_delta_roll.png
2026-06-16 12:17:09,688 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/32402/index.html
2026-06-16 12:17:09,690 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/32402/info.json
2026-06-16 12:17:09,692 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32402/index.html
2026-06-16 12:17:09,693 main:
2026-06-16 12:17:09,693 main: ********************************************************************************
2026-06-16 12:17:09,693 main: Processing observation 41417
2026-06-16 12:17:09,693 main: ********************************************************************************
2026-06-16 12:17:09,694 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:17:09,695 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-16 12:17:11,762 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-16 12:17:13,053 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41417/centroid_resids.pkl with 8 slots
2026-06-16 12:17:13,118 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41417/centroid_resids_time.png
2026-06-16 12:17:13,432 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41417/centroid_resids_scatter.png
2026-06-16 12:17:13,509 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-16 12:17:13,673 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41417/n_kalman_delta_roll.png
2026-06-16 12:17:14,041 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41417/index.html
2026-06-16 12:17:14,042 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41417/info.json
2026-06-16 12:17:14,105 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41417/index.html
2026-06-16 12:17:14,106 main:
2026-06-16 12:17:14,106 main: ********************************************************************************
2026-06-16 12:17:14,106 main: Processing observation 41416
2026-06-16 12:17:14,106 main: ********************************************************************************
2026-06-16 12:17:14,107 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:17:14,108 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-16 12:17:16,171 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-16 12:17:16,641 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41416/centroid_resids.pkl with 8 slots
2026-06-16 12:17:16,748 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41416/centroid_resids_time.png
2026-06-16 12:17:17,069 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41416/centroid_resids_scatter.png
2026-06-16 12:17:17,161 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-16 12:17:17,283 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41416/n_kalman_delta_roll.png
2026-06-16 12:17:17,428 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41416/index.html
2026-06-16 12:17:17,430 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41416/info.json
2026-06-16 12:17:17,433 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41416/index.html
2026-06-16 12:17:17,433 main:
2026-06-16 12:17:17,433 main: ********************************************************************************
2026-06-16 12:17:17,434 main: Processing observation 41415
2026-06-16 12:17:17,434 main: ********************************************************************************
2026-06-16 12:17:17,435 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:17:17,436 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-16 12:17:19,606 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-16 12:17:20,413 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41415/centroid_resids.pkl with 7 slots
2026-06-16 12:17:20,513 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41415/centroid_resids_time.png
2026-06-16 12:17:20,861 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41415/centroid_resids_scatter.png
2026-06-16 12:17:21,009 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-16 12:17:21,124 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41415/n_kalman_delta_roll.png
2026-06-16 12:17:21,255 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41415/index.html
2026-06-16 12:17:21,257 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41415/info.json
2026-06-16 12:17:21,259 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41415/index.html
2026-06-16 12:17:21,260 main:
2026-06-16 12:17:21,260 main: ********************************************************************************
2026-06-16 12:17:21,260 main: Processing observation 41414
2026-06-16 12:17:21,260 main: ********************************************************************************
2026-06-16 12:17:21,261 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:17:21,262 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-16 12:17:23,399 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-16 12:17:23,803 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41414/centroid_resids.pkl with 8 slots
2026-06-16 12:17:23,863 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41414/centroid_resids_time.png
2026-06-16 12:17:24,126 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41414/centroid_resids_scatter.png
2026-06-16 12:17:24,188 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-16 12:17:24,297 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41414/n_kalman_delta_roll.png
2026-06-16 12:17:24,426 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41414/index.html
2026-06-16 12:17:24,427 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41414/info.json
2026-06-16 12:17:24,429 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41414/index.html
2026-06-16 12:17:24,430 main:
2026-06-16 12:17:24,430 main: ********************************************************************************
2026-06-16 12:17:24,430 main: Processing observation 41413
2026-06-16 12:17:24,430 main: ********************************************************************************
2026-06-16 12:17:24,431 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:17:24,432 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-16 12:17:26,592 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-16 12:17:27,988 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41413/centroid_resids.pkl with 8 slots
2026-06-16 12:17:28,052 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41413/centroid_resids_time.png
2026-06-16 12:17:28,608 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41413/centroid_resids_scatter.png
2026-06-16 12:17:28,703 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-16 12:17:28,822 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41413/n_kalman_delta_roll.png
2026-06-16 12:17:28,960 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41413/index.html
2026-06-16 12:17:28,962 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41413/info.json
2026-06-16 12:17:28,964 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41413/index.html
2026-06-16 12:17:28,965 main:
2026-06-16 12:17:28,965 main: ********************************************************************************
2026-06-16 12:17:28,965 main: Processing observation 29995
2026-06-16 12:17:28,965 main: ********************************************************************************
2026-06-16 12:17:28,966 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:17:28,967 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-16 12:17:31,094 __init__: ObsID 29995 has insufficient telemetry, skipping
2026-06-16 12:17:31,095 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/29995/index.html
2026-06-16 12:17:31,099 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/29995/info.json
2026-06-16 12:17:31,100 main:
2026-06-16 12:17:31,100 main: ********************************************************************************
2026-06-16 12:17:31,100 main: Processing observation 32147
2026-06-16 12:17:31,100 main: ********************************************************************************
2026-06-16 12:17:31,101 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:17:31,102 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-16 12:17:33,271 __init__: ObsID 32147 has insufficient telemetry, skipping
2026-06-16 12:17:33,272 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/32147/index.html
2026-06-16 12:17:33,276 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/32147/info.json
2026-06-16 12:17:33,277 main:
2026-06-16 12:17:33,277 main: ********************************************************************************
2026-06-16 12:17:33,277 main: Processing observation 29985
2026-06-16 12:17:33,277 main: ********************************************************************************
2026-06-16 12:17:33,278 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:17:33,279 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-16 12:17:35,396 __init__: ObsID 29985 has no maneuver event in telemetry, skipping
2026-06-16 12:17:35,396 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/29985/index.html
2026-06-16 12:17:35,402 info: could not get attribute kalman_start for obsid 29985
2026-06-16 12:17:35,402 info: could not get attribute kalman_stop for obsid 29985
2026-06-16 12:17:35,402 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/29985/info.json
2026-06-16 12:17:35,403 main:
2026-06-16 12:17:35,403 main: ********************************************************************************
2026-06-16 12:17:35,403 main: Processing observation 29925
2026-06-16 12:17:35,403 main: ********************************************************************************
2026-06-16 12:17:35,404 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/29925/info.json file found, obs=None
2026-06-16 12:17:35,405 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-16 12:17:35,406 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-16 12:17:37,519 __init__: ObsID 29925 has no maneuver event in telemetry, skipping
2026-06-16 12:17:37,520 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/29925/index.html
2026-06-16 12:17:37,524 get_aberration_correction: More than one entry for 29925 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/JUN1526/oflsa/output/JUN1526A_ManErr.txt. Skipping aber correction
2026-06-16 12:17:37,524 info: could not get attribute kalman_start for obsid 29925
2026-06-16 12:17:37,524 info: could not get attribute kalman_stop for obsid 29925
2026-06-16 12:17:37,524 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/29925/info.json
2026-06-16 12:17:37,525 main:
2026-06-16 13:17:39,037 run_check: Starting centroid dashboard continuity check
2026-06-16 13:17:39,037 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-06-16 13:17:39,350 collect_observations: Processing year 2020
2026-06-16 13:18:00,904 collect_observations: Processing year 2021
2026-06-16 13:18:33,143 collect_observations: Processing year 2022
2026-06-16 13:19:10,029 collect_observations: Processing year 2023
2026-06-16 13:19:44,584 collect_observations: Processing year 2024
2026-06-16 13:20:19,638 collect_observations: Processing year 2025
2026-06-16 13:20:50,459 collect_observations: Processing year 2026
2026-06-16 13:21:03,824 collect_observations: Collected 14045 observations from 4-digit years
2026-06-16 13:21:03,830 sort_observations_by_date: Sorted observations by date
2026-06-16 13:21:03,830 check_continuity: Starting continuity check from most recent: ObsID 29925 (JUN1526A) at 2026:167:11:06:07.115
2026-06-16 13:21:03,852 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-06-16 13:21:03,852 check_continuity: Chain complete: visited 14045 observations out of 14045 total
2026-06-16 13:21:03,853 run_check: ✓ Observation chain continuity check PASSED
2026-06-16 13:21:03,853 run_check: Summary: 14045 observations from 4-digit years, all properly linked