Prev
Index
Next
centroid_dashboard: Mon Jun 15 13:17:48 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Mon Jun 15 13:17:48 2026 |
No errors
File contents:
2026-06-15 13:16:13,603 main: Processing from 2026:159:17:16:13.602 to 2026:166:17:16:13.602
2026-06-15 13:16:21,675 get_observations: Found observation 32380 at 2026:159:17:54:40.829 with 1 manvrs
2026-06-15 13:16:21,676 get_observations: Found observation 30244 at 2026:159:21:17:56.980 with 1 manvrs
2026-06-15 13:16:21,676 get_observations: Found observation 31370 at 2026:160:01:05:30.360 with 1 manvrs
2026-06-15 13:16:21,676 get_observations: Found observation 32356 at 2026:160:02:04:10.980 with 1 manvrs
2026-06-15 13:16:21,677 get_observations: Found observation 29989 at 2026:160:03:01:37.877 with 1 manvrs
2026-06-15 13:16:21,677 get_observations: Found observation 32390 at 2026:160:06:33:16.362 with 1 manvrs
2026-06-15 13:16:21,678 get_observations: Found observation 32382 at 2026:160:09:56:43.509 with 1 manvrs
2026-06-15 13:16:21,678 get_observations: Found observation 29922 at 2026:160:14:00:39.775 with 1 manvrs
2026-06-15 13:16:21,678 get_observations: Found observation 32378 at 2026:160:20:08:56.428 with 1 manvrs
2026-06-15 13:16:21,679 get_observations: Found observation 29654 at 2026:160:23:33:45.523 with 1 manvrs
2026-06-15 13:16:21,679 get_observations: Found observation 41430 at 2026:161:03:33:59.628 with 1 manvrs
2026-06-15 13:16:21,680 get_observations: Found observation 41429 at 2026:161:10:55:40.252 with 1 manvrs
2026-06-15 13:16:21,680 get_observations: Found observation 41428 at 2026:161:12:29:11.989 with 1 manvrs
2026-06-15 13:16:21,680 get_observations: Found observation 30541 at 2026:161:16:35:02.622 with 1 manvrs
2026-06-15 13:16:21,681 get_observations: Found observation 30506 at 2026:161:20:19:28.629 with 1 manvrs
2026-06-15 13:16:21,681 get_observations: Found observation 32388 at 2026:162:00:50:34.625 with 1 manvrs
2026-06-15 13:16:21,682 get_observations: Found observation 29955 at 2026:162:05:52:26.116 with 2 manvrs
2026-06-15 13:16:21,682 get_observations: Found observation 32389 at 2026:162:12:29:52.770 with 1 manvrs
2026-06-15 13:16:21,682 get_observations: Found observation 32357 at 2026:162:17:34:31.392 with 2 manvrs
2026-06-15 13:16:21,683 get_observations: Found observation 32358 at 2026:162:19:20:13.710 with 1 manvrs
2026-06-15 13:16:21,683 get_observations: Found observation 30137 at 2026:162:21:19:46.681 with 1 manvrs
2026-06-15 13:16:21,684 get_observations: Found observation 29801 at 2026:163:01:06:15.059 with 2 manvrs
2026-06-15 13:16:21,684 get_observations: Found observation 32386 at 2026:163:07:38:46.206 with 2 manvrs
2026-06-15 13:16:21,685 get_observations: Found observation 32384 at 2026:163:13:04:39.420 with 2 manvrs
2026-06-15 13:16:21,685 get_observations: Found observation 41422 at 2026:163:19:10:10.242 with 1 manvrs
2026-06-15 13:16:21,686 get_observations: Found observation 41421 at 2026:163:20:28:22.080 with 1 manvrs
2026-06-15 13:16:21,686 get_observations: Found observation 41420 at 2026:164:01:25:40.252 with 1 manvrs
2026-06-15 13:16:21,686 get_observations: Found observation 41419 at 2026:164:03:00:18.672 with 1 manvrs
2026-06-15 13:16:21,687 get_observations: Found observation 30139 at 2026:164:07:48:01.931 with 1 manvrs
2026-06-15 13:16:21,687 get_observations: Found observation 31409 at 2026:164:12:19:36.642 with 2 manvrs
2026-06-15 13:16:21,688 get_observations: Found observation 32385 at 2026:164:18:10:51.593 with 1 manvrs
2026-06-15 13:16:21,688 get_observations: Found observation 32383 at 2026:164:21:36:50.013 with 1 manvrs
2026-06-15 13:16:21,688 get_observations: Found observation 32381 at 2026:165:09:17:52.138 with 1 manvrs
2026-06-15 13:16:21,689 get_observations: Found observation 30538 at 2026:165:12:43:47.227 with 1 manvrs
2026-06-15 13:16:21,689 get_observations: Found observation 32391 at 2026:165:17:32:48.599 with 1 manvrs
2026-06-15 13:16:21,690 get_observations: Found observation 32387 at 2026:165:20:58:28.632 with 1 manvrs
2026-06-15 13:16:21,690 get_observations: Found observation 31140 at 2026:166:01:50:25.659 with 1 manvrs
2026-06-15 13:16:21,690 get_observations: Found observation 32402 at 2026:166:05:14:32.257 with 1 manvrs
2026-06-15 13:16:21,691 get_observations: Found observation 41417 at 2026:166:11:08:12.535 with 1 manvrs
2026-06-15 13:16:21,691 get_observations: Found observation 41416 at 2026:166:12:24:05.295 with 1 manvrs
2026-06-15 13:16:21,692 get_observations: Found observation 41415 at 2026:166:14:40:34.338 with 1 manvrs
2026-06-15 13:16:21,692 main: Found 41 observations
2026-06-15 13:16:21,692 main: ********************************************************************************
2026-06-15 13:16:21,692 main: Processing observation 32380
2026-06-15 13:16:21,692 main: ********************************************************************************
2026-06-15 13:16:21,696 obs_link_from_info: Found prev obsid 30254
2026-06-15 13:16:21,700 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 13:16:21,701 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 13:16:21,704 process_obs: ObsID 32380 already processed, skipping
2026-06-15 13:16:21,704 main:
2026-06-15 13:16:21,704 main: ********************************************************************************
2026-06-15 13:16:21,704 main: Processing observation 30244
2026-06-15 13:16:21,704 main: ********************************************************************************
2026-06-15 13:16:21,705 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 13:16:21,706 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 13:16:21,710 process_obs: ObsID 30244 already processed, skipping
2026-06-15 13:16:21,710 main:
2026-06-15 13:16:21,710 main: ********************************************************************************
2026-06-15 13:16:21,710 main: Processing observation 31370
2026-06-15 13:16:21,710 main: ********************************************************************************
2026-06-15 13:16:21,711 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 13:16:21,712 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 13:16:21,715 process_obs: ObsID 31370 already processed, skipping
2026-06-15 13:16:21,715 main:
2026-06-15 13:16:21,715 main: ********************************************************************************
2026-06-15 13:16:21,715 main: Processing observation 32356
2026-06-15 13:16:21,716 main: ********************************************************************************
2026-06-15 13:16:21,716 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 13:16:21,718 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 13:16:21,721 process_obs: ObsID 32356 already processed, skipping
2026-06-15 13:16:21,721 main:
2026-06-15 13:16:21,721 main: ********************************************************************************
2026-06-15 13:16:21,721 main: Processing observation 29989
2026-06-15 13:16:21,721 main: ********************************************************************************
2026-06-15 13:16:21,722 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 13:16:21,723 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:24,371 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29989/centroid_resids.pkl
2026-06-15 12:16:24,377 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-15 12:16:24,377 plot_crs_time: Plot file exists, skipping
2026-06-15 12:16:24,377 plot_crs_scatter: Plot file exists, skipping
2026-06-15 12:16:24,743 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-15 12:16:26,277 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29989/n_kalman_delta_roll.png
2026-06-15 12:16:30,861 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29989/index.html
2026-06-15 12:16:30,864 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29989/info.json
2026-06-15 12:16:30,871 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29989/index.html
2026-06-15 12:16:30,874 main:
2026-06-15 12:16:30,874 main: ********************************************************************************
2026-06-15 12:16:30,874 main: Processing observation 32390
2026-06-15 12:16:30,874 main: ********************************************************************************
2026-06-15 12:16:30,876 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:30,878 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:30,885 process_obs: ObsID 32390 already processed, skipping
2026-06-15 12:16:30,885 main:
2026-06-15 12:16:30,885 main: ********************************************************************************
2026-06-15 12:16:30,885 main: Processing observation 32382
2026-06-15 12:16:30,885 main: ********************************************************************************
2026-06-15 12:16:30,886 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:30,888 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:30,894 process_obs: ObsID 32382 already processed, skipping
2026-06-15 12:16:30,894 main:
2026-06-15 12:16:30,894 main: ********************************************************************************
2026-06-15 12:16:30,894 main: Processing observation 29922
2026-06-15 12:16:30,894 main: ********************************************************************************
2026-06-15 12:16:30,895 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:30,896 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:30,921 process_obs: ObsID 29922 already processed, skipping
2026-06-15 12:16:30,921 main:
2026-06-15 12:16:30,921 main: ********************************************************************************
2026-06-15 12:16:30,921 main: Processing observation 32378
2026-06-15 12:16:30,921 main: ********************************************************************************
2026-06-15 12:16:30,922 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:30,924 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:30,931 process_obs: ObsID 32378 already processed, skipping
2026-06-15 12:16:30,931 main:
2026-06-15 12:16:30,931 main: ********************************************************************************
2026-06-15 12:16:30,931 main: Processing observation 29654
2026-06-15 12:16:30,931 main: ********************************************************************************
2026-06-15 12:16:30,933 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:30,936 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:30,999 process_obs: ObsID 29654 already processed, skipping
2026-06-15 12:16:30,999 main:
2026-06-15 12:16:30,999 main: ********************************************************************************
2026-06-15 12:16:30,999 main: Processing observation 41430
2026-06-15 12:16:30,999 main: ********************************************************************************
2026-06-15 12:16:31,010 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,035 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,079 process_obs: ObsID 41430 already processed, skipping
2026-06-15 12:16:31,080 main:
2026-06-15 12:16:31,080 main: ********************************************************************************
2026-06-15 12:16:31,080 main: Processing observation 41429
2026-06-15 12:16:31,080 main: ********************************************************************************
2026-06-15 12:16:31,083 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,086 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,119 process_obs: ObsID 41429 already processed, skipping
2026-06-15 12:16:31,119 main:
2026-06-15 12:16:31,119 main: ********************************************************************************
2026-06-15 12:16:31,119 main: Processing observation 41428
2026-06-15 12:16:31,119 main: ********************************************************************************
2026-06-15 12:16:31,128 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,139 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,162 process_obs: ObsID 41428 already processed, skipping
2026-06-15 12:16:31,162 main:
2026-06-15 12:16:31,162 main: ********************************************************************************
2026-06-15 12:16:31,162 main: Processing observation 30541
2026-06-15 12:16:31,162 main: ********************************************************************************
2026-06-15 12:16:31,164 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,187 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,237 process_obs: ObsID 30541 already processed, skipping
2026-06-15 12:16:31,237 main:
2026-06-15 12:16:31,237 main: ********************************************************************************
2026-06-15 12:16:31,237 main: Processing observation 30506
2026-06-15 12:16:31,237 main: ********************************************************************************
2026-06-15 12:16:31,251 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,273 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,300 process_obs: ObsID 30506 already processed, skipping
2026-06-15 12:16:31,300 main:
2026-06-15 12:16:31,300 main: ********************************************************************************
2026-06-15 12:16:31,300 main: Processing observation 32388
2026-06-15 12:16:31,300 main: ********************************************************************************
2026-06-15 12:16:31,302 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,303 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,308 process_obs: ObsID 32388 already processed, skipping
2026-06-15 12:16:31,308 main:
2026-06-15 12:16:31,308 main: ********************************************************************************
2026-06-15 12:16:31,308 main: Processing observation 29955
2026-06-15 12:16:31,308 main: ********************************************************************************
2026-06-15 12:16:31,309 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,310 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,317 process_obs: ObsID 29955 already processed, skipping
2026-06-15 12:16:31,317 main:
2026-06-15 12:16:31,317 main: ********************************************************************************
2026-06-15 12:16:31,317 main: Processing observation 32389
2026-06-15 12:16:31,317 main: ********************************************************************************
2026-06-15 12:16:31,318 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,319 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,324 process_obs: ObsID 32389 already processed, skipping
2026-06-15 12:16:31,324 main:
2026-06-15 12:16:31,324 main: ********************************************************************************
2026-06-15 12:16:31,324 main: Processing observation 32357
2026-06-15 12:16:31,324 main: ********************************************************************************
2026-06-15 12:16:31,325 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,326 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,331 process_obs: ObsID 32357 already processed, skipping
2026-06-15 12:16:31,331 main:
2026-06-15 12:16:31,331 main: ********************************************************************************
2026-06-15 12:16:31,331 main: Processing observation 32358
2026-06-15 12:16:31,331 main: ********************************************************************************
2026-06-15 12:16:31,332 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,335 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,339 process_obs: ObsID 32358 already processed, skipping
2026-06-15 12:16:31,339 main:
2026-06-15 12:16:31,339 main: ********************************************************************************
2026-06-15 12:16:31,339 main: Processing observation 30137
2026-06-15 12:16:31,339 main: ********************************************************************************
2026-06-15 12:16:31,340 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,342 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,346 process_obs: ObsID 30137 already processed, skipping
2026-06-15 12:16:31,346 main:
2026-06-15 12:16:31,346 main: ********************************************************************************
2026-06-15 12:16:31,346 main: Processing observation 29801
2026-06-15 12:16:31,346 main: ********************************************************************************
2026-06-15 12:16:31,347 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,348 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,364 process_obs: ObsID 29801 already processed, skipping
2026-06-15 12:16:31,364 main:
2026-06-15 12:16:31,364 main: ********************************************************************************
2026-06-15 12:16:31,364 main: Processing observation 32386
2026-06-15 12:16:31,364 main: ********************************************************************************
2026-06-15 12:16:31,365 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,367 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,370 process_obs: ObsID 32386 already processed, skipping
2026-06-15 12:16:31,371 main:
2026-06-15 12:16:31,371 main: ********************************************************************************
2026-06-15 12:16:31,371 main: Processing observation 32384
2026-06-15 12:16:31,371 main: ********************************************************************************
2026-06-15 12:16:31,372 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,373 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,391 process_obs: ObsID 32384 already processed, skipping
2026-06-15 12:16:31,391 main:
2026-06-15 12:16:31,391 main: ********************************************************************************
2026-06-15 12:16:31,391 main: Processing observation 41422
2026-06-15 12:16:31,391 main: ********************************************************************************
2026-06-15 12:16:31,392 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,393 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,397 process_obs: ObsID 41422 already processed, skipping
2026-06-15 12:16:31,397 main:
2026-06-15 12:16:31,397 main: ********************************************************************************
2026-06-15 12:16:31,397 main: Processing observation 41421
2026-06-15 12:16:31,397 main: ********************************************************************************
2026-06-15 12:16:31,399 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,401 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,406 process_obs: ObsID 41421 already processed, skipping
2026-06-15 12:16:31,406 main:
2026-06-15 12:16:31,406 main: ********************************************************************************
2026-06-15 12:16:31,406 main: Processing observation 41420
2026-06-15 12:16:31,406 main: ********************************************************************************
2026-06-15 12:16:31,407 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,409 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,414 process_obs: ObsID 41420 already processed, skipping
2026-06-15 12:16:31,414 main:
2026-06-15 12:16:31,414 main: ********************************************************************************
2026-06-15 12:16:31,414 main: Processing observation 41419
2026-06-15 12:16:31,414 main: ********************************************************************************
2026-06-15 12:16:31,415 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,416 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,434 process_obs: ObsID 41419 already processed, skipping
2026-06-15 12:16:31,434 main:
2026-06-15 12:16:31,434 main: ********************************************************************************
2026-06-15 12:16:31,434 main: Processing observation 30139
2026-06-15 12:16:31,434 main: ********************************************************************************
2026-06-15 12:16:31,436 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,437 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,453 process_obs: ObsID 30139 already processed, skipping
2026-06-15 12:16:31,453 main:
2026-06-15 12:16:31,453 main: ********************************************************************************
2026-06-15 12:16:31,453 main: Processing observation 31409
2026-06-15 12:16:31,453 main: ********************************************************************************
2026-06-15 12:16:31,454 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,455 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,467 process_obs: ObsID 31409 already processed, skipping
2026-06-15 12:16:31,467 main:
2026-06-15 12:16:31,467 main: ********************************************************************************
2026-06-15 12:16:31,467 main: Processing observation 32385
2026-06-15 12:16:31,467 main: ********************************************************************************
2026-06-15 12:16:31,732 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,733 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:31,751 process_obs: ObsID 32385 already processed, skipping
2026-06-15 12:16:31,752 main:
2026-06-15 12:16:31,752 main: ********************************************************************************
2026-06-15 12:16:31,752 main: Processing observation 32383
2026-06-15 12:16:31,752 main: ********************************************************************************
2026-06-15 12:16:31,754 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:31,756 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:40,143 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-15 12:16:40,662 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/centroid_resids.pkl with 5 slots
2026-06-15 12:16:40,802 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/centroid_resids_time.png
2026-06-15 12:16:41,180 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/centroid_resids_scatter.png
2026-06-15 12:16:41,443 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-15 12:16:41,557 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/n_kalman_delta_roll.png
2026-06-15 12:16:46,572 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/index.html
2026-06-15 12:16:46,577 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/info.json
2026-06-15 12:16:46,586 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32383/index.html
2026-06-15 12:16:46,589 main:
2026-06-15 12:16:46,589 main: ********************************************************************************
2026-06-15 12:16:46,590 main: Processing observation 32381
2026-06-15 12:16:46,590 main: ********************************************************************************
2026-06-15 12:16:46,593 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:46,598 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:51,619 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-15 12:16:52,042 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32381/centroid_resids.pkl with 5 slots
2026-06-15 12:16:52,109 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32381/centroid_resids_time.png
2026-06-15 12:16:52,413 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32381/centroid_resids_scatter.png
2026-06-15 12:16:53,581 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32381/n_kalman_delta_roll.png
2026-06-15 12:16:53,886 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32381/index.html
2026-06-15 12:16:53,890 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32381/info.json
2026-06-15 12:16:53,899 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32381/index.html
2026-06-15 12:16:53,903 main:
2026-06-15 12:16:53,903 main: ********************************************************************************
2026-06-15 12:16:53,903 main: Processing observation 30538
2026-06-15 12:16:53,903 main: ********************************************************************************
2026-06-15 12:16:53,907 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:16:53,911 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:16:59,096 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-15 12:16:59,425 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30538/centroid_resids.pkl with 5 slots
2026-06-15 12:16:59,478 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30538/centroid_resids_time.png
2026-06-15 12:16:59,764 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30538/centroid_resids_scatter.png
2026-06-15 12:17:00,444 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30538/n_kalman_delta_roll.png
2026-06-15 12:17:00,585 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30538/index.html
2026-06-15 12:17:00,586 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30538/info.json
2026-06-15 12:17:00,589 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30538/index.html
2026-06-15 12:17:00,590 main:
2026-06-15 12:17:00,590 main: ********************************************************************************
2026-06-15 12:17:00,590 main: Processing observation 32391
2026-06-15 12:17:00,590 main: ********************************************************************************
2026-06-15 12:17:00,591 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:17:00,592 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:17:03,402 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-15 12:17:03,705 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32391/centroid_resids.pkl with 5 slots
2026-06-15 12:17:03,754 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32391/centroid_resids_time.png
2026-06-15 12:17:04,002 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32391/centroid_resids_scatter.png
2026-06-15 12:17:04,713 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32391/n_kalman_delta_roll.png
2026-06-15 12:17:04,906 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32391/index.html
2026-06-15 12:17:04,909 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32391/info.json
2026-06-15 12:17:04,915 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32391/index.html
2026-06-15 12:17:04,916 main:
2026-06-15 12:17:04,916 main: ********************************************************************************
2026-06-15 12:17:04,916 main: Processing observation 32387
2026-06-15 12:17:04,916 main: ********************************************************************************
2026-06-15 12:17:04,919 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:17:04,921 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-15 12:17:07,269 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-15 12:17:07,719 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32387/centroid_resids.pkl with 5 slots
2026-06-15 12:17:07,779 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32387/centroid_resids_time.png
2026-06-15 12:17:08,114 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32387/centroid_resids_scatter.png
2026-06-15 12:17:08,544 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-15 12:17:08,657 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32387/n_kalman_delta_roll.png
2026-06-15 12:17:09,452 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32387/index.html
2026-06-15 12:17:09,464 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32387/info.json
2026-06-15 12:17:09,479 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32387/index.html
2026-06-15 12:17:09,491 main:
2026-06-15 12:17:09,491 main: ********************************************************************************
2026-06-15 12:17:09,491 main: Processing observation 31140
2026-06-15 12:17:09,491 main: ********************************************************************************
2026-06-15 12:17:09,500 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:17:09,505 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-15 12:17:12,397 __init__: ObsID 31140 has insufficient telemetry, skipping
2026-06-15 12:17:12,397 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/31140/index.html
2026-06-15 12:17:12,409 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/31140/info.json
2026-06-15 12:17:12,410 main:
2026-06-15 12:17:12,410 main: ********************************************************************************
2026-06-15 12:17:12,410 main: Processing observation 32402
2026-06-15 12:17:12,410 main: ********************************************************************************
2026-06-15 12:17:12,411 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:17:12,413 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-15 12:17:14,718 __init__: ObsID 32402 has insufficient telemetry, skipping
2026-06-15 12:17:14,718 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/32402/index.html
2026-06-15 12:17:14,723 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/32402/info.json
2026-06-15 12:17:14,724 main:
2026-06-15 12:17:14,724 main: ********************************************************************************
2026-06-15 12:17:14,724 main: Processing observation 41417
2026-06-15 12:17:14,724 main: ********************************************************************************
2026-06-15 12:17:14,725 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:17:14,727 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-15 12:17:17,153 __init__: ObsID 41417 has insufficient telemetry, skipping
2026-06-15 12:17:17,154 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41417/index.html
2026-06-15 12:17:17,159 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41417/info.json
2026-06-15 12:17:17,160 main:
2026-06-15 12:17:17,160 main: ********************************************************************************
2026-06-15 12:17:17,160 main: Processing observation 41416
2026-06-15 12:17:17,160 main: ********************************************************************************
2026-06-15 12:17:17,162 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:17:17,163 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-15 12:17:19,391 __init__: ObsID 41416 has no maneuver event in telemetry, skipping
2026-06-15 12:17:19,392 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41416/index.html
2026-06-15 12:17:19,397 info: could not get attribute kalman_start for obsid 41416
2026-06-15 12:17:19,397 info: could not get attribute kalman_stop for obsid 41416
2026-06-15 12:17:19,397 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41416/info.json
2026-06-15 12:17:19,398 main:
2026-06-15 12:17:19,398 main: ********************************************************************************
2026-06-15 12:17:19,398 main: Processing observation 41415
2026-06-15 12:17:19,398 main: ********************************************************************************
2026-06-15 12:17:19,399 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41415/info.json file found, obs=None
2026-06-15 12:17:19,400 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-15 12:17:19,401 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/last.html
2026-06-15 12:17:21,732 __init__: ObsID 41415 has no maneuver event in telemetry, skipping
2026-06-15 12:17:21,732 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41415/index.html
2026-06-15 12:17:21,737 info: could not get attribute kalman_start for obsid 41415
2026-06-15 12:17:21,737 info: could not get attribute kalman_stop for obsid 41415
2026-06-15 12:17:21,737 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN1526A/41415/info.json
2026-06-15 12:17:21,738 main:
2026-06-15 13:17:23,416 run_check: Starting centroid dashboard continuity check
2026-06-15 13:17:23,416 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-06-15 13:17:23,418 collect_observations: Processing year 2020
2026-06-15 13:17:25,548 collect_observations: Processing year 2021
2026-06-15 13:17:28,799 collect_observations: Processing year 2022
2026-06-15 13:17:32,896 collect_observations: Processing year 2023
2026-06-15 13:17:37,225 collect_observations: Processing year 2024
2026-06-15 13:17:42,150 collect_observations: Processing year 2025
2026-06-15 13:17:47,127 collect_observations: Processing year 2026
2026-06-15 13:17:48,300 collect_observations: Collected 14039 observations from 4-digit years
2026-06-15 13:17:48,307 sort_observations_by_date: Sorted observations by date
2026-06-15 13:17:48,307 check_continuity: Starting continuity check from most recent: ObsID 41415 (JUN1526A) at 2026:166:14:08:31.043
2026-06-15 13:17:48,329 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-06-15 13:17:48,329 check_continuity: Chain complete: visited 14039 observations out of 14039 total
2026-06-15 13:17:48,330 run_check: ✓ Observation chain continuity check PASSED
2026-06-15 13:17:48,330 run_check: Summary: 14039 observations from 4-digit years, all properly linked