Prev   Index   Next

centroid_dashboard: Sun Jun 14 13:18:03 2026

File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log

Task Status AgeMaxAge Last Date
centroid_dashboard OK 0.891.0 Sun Jun 14 13:18:03 2026

No errors

File contents:

2026-06-14 13:16:13,777 main: Processing from 2026:158:17:16:13.776 to 2026:165:17:16:13.776
2026-06-14 13:16:21,896 get_observations: Found observation 41436 at 2026:158:18:10:40.252 with 1 manvrs
2026-06-14 13:16:21,896 get_observations: Found observation 41434 at 2026:158:20:03:10.252 with 2 manvrs
2026-06-14 13:16:21,897 get_observations: Found observation 41433 at 2026:158:20:50:47.707 with 1 manvrs
2026-06-14 13:16:21,897 get_observations: Found observation 41432 at 2026:158:21:49:29.790 with 1 manvrs
2026-06-14 13:16:21,897 get_observations: Found observation 41431 at 2026:158:22:47:47.560 with 1 manvrs
2026-06-14 13:16:21,898 get_observations: Found observation 32373 at 2026:159:00:27:11.771 with 1 manvrs
2026-06-14 13:16:21,898 get_observations: Found observation 31312 at 2026:159:03:42:45.291 with 1 manvrs
2026-06-14 13:16:21,899 get_observations: Found observation 32379 at 2026:159:08:03:07.874 with 1 manvrs
2026-06-14 13:16:21,899 get_observations: Found observation 30254 at 2026:159:11:28:09.003 with 1 manvrs
2026-06-14 13:16:21,899 get_observations: Found observation 32380 at 2026:159:17:54:40.829 with 1 manvrs
2026-06-14 13:16:21,900 get_observations: Found observation 30244 at 2026:159:21:17:56.980 with 1 manvrs
2026-06-14 13:16:21,900 get_observations: Found observation 31370 at 2026:160:01:05:30.360 with 1 manvrs
2026-06-14 13:16:21,901 get_observations: Found observation 32356 at 2026:160:02:04:10.980 with 1 manvrs
2026-06-14 13:16:21,901 get_observations: Found observation 29989 at 2026:160:03:01:37.877 with 1 manvrs
2026-06-14 13:16:21,901 get_observations: Found observation 32390 at 2026:160:06:33:16.362 with 1 manvrs
2026-06-14 13:16:21,902 get_observations: Found observation 32382 at 2026:160:09:56:43.509 with 1 manvrs
2026-06-14 13:16:21,902 get_observations: Found observation 29922 at 2026:160:14:00:39.775 with 1 manvrs
2026-06-14 13:16:21,903 get_observations: Found observation 32378 at 2026:160:20:08:56.428 with 1 manvrs
2026-06-14 13:16:21,903 get_observations: Found observation 29654 at 2026:160:23:33:45.523 with 1 manvrs
2026-06-14 13:16:21,903 get_observations: Found observation 41430 at 2026:161:03:33:59.628 with 1 manvrs
2026-06-14 13:16:21,904 get_observations: Found observation 41429 at 2026:161:10:55:40.252 with 1 manvrs
2026-06-14 13:16:21,904 get_observations: Found observation 41428 at 2026:161:12:29:11.989 with 1 manvrs
2026-06-14 13:16:21,905 get_observations: Found observation 30541 at 2026:161:16:35:02.622 with 1 manvrs
2026-06-14 13:16:21,905 get_observations: Found observation 30506 at 2026:161:20:19:28.629 with 1 manvrs
2026-06-14 13:16:21,906 get_observations: Found observation 32388 at 2026:162:00:50:34.625 with 1 manvrs
2026-06-14 13:16:21,906 get_observations: Found observation 29955 at 2026:162:05:52:26.116 with 2 manvrs
2026-06-14 13:16:21,906 get_observations: Found observation 32389 at 2026:162:12:29:52.770 with 1 manvrs
2026-06-14 13:16:21,907 get_observations: Found observation 32357 at 2026:162:17:34:31.392 with 2 manvrs
2026-06-14 13:16:21,907 get_observations: Found observation 32358 at 2026:162:19:20:13.710 with 1 manvrs
2026-06-14 13:16:21,908 get_observations: Found observation 30137 at 2026:162:21:19:46.681 with 1 manvrs
2026-06-14 13:16:21,908 get_observations: Found observation 29801 at 2026:163:01:06:15.059 with 2 manvrs
2026-06-14 13:16:21,908 get_observations: Found observation 32386 at 2026:163:07:38:46.206 with 2 manvrs
2026-06-14 13:16:21,909 get_observations: Found observation 32384 at 2026:163:13:04:39.420 with 2 manvrs
2026-06-14 13:16:21,909 get_observations: Found observation 41422 at 2026:163:19:10:10.242 with 1 manvrs
2026-06-14 13:16:21,909 get_observations: Found observation 41421 at 2026:163:20:28:22.080 with 1 manvrs
2026-06-14 13:16:21,910 get_observations: Found observation 41420 at 2026:164:01:25:40.252 with 1 manvrs
2026-06-14 13:16:21,910 get_observations: Found observation 41419 at 2026:164:03:00:18.672 with 1 manvrs
2026-06-14 13:16:21,911 get_observations: Found observation 30139 at 2026:164:07:48:01.931 with 1 manvrs
2026-06-14 13:16:21,911 get_observations: Found observation 31409 at 2026:164:12:19:36.642 with 2 manvrs
2026-06-14 13:16:21,911 get_observations: Found observation 32385 at 2026:164:18:10:51.593 with 1 manvrs
2026-06-14 13:16:21,912 get_observations: Found observation 32383 at 2026:164:21:36:50.013 with 1 manvrs
2026-06-14 13:16:21,912 get_observations: Found observation 32381 at 2026:165:09:17:52.138 with 1 manvrs
2026-06-14 13:16:21,913 get_observations: Found observation 30538 at 2026:165:12:43:47.227 with 1 manvrs
2026-06-14 13:16:21,913 main: Found 43 observations
2026-06-14 13:16:21,913 main: ********************************************************************************
2026-06-14 13:16:21,913 main: Processing observation 41436
2026-06-14 13:16:21,913 main: ********************************************************************************
2026-06-14 13:16:21,921 obs_link_from_info: Found prev obsid 41437
2026-06-14 13:16:21,925 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:21,927 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-14 13:16:21,934 process_obs: ObsID 41436 already processed, skipping
2026-06-14 13:16:21,934 main:
2026-06-14 13:16:21,934 main: ********************************************************************************
2026-06-14 13:16:21,935 main: Processing observation 41434
2026-06-14 13:16:21,935 main: ********************************************************************************
2026-06-14 13:16:21,937 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:21,939 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-14 13:16:21,944 process_obs: ObsID 41434 already processed, skipping
2026-06-14 13:16:21,944 main:
2026-06-14 13:16:21,944 main: ********************************************************************************
2026-06-14 13:16:21,944 main: Processing observation 41433
2026-06-14 13:16:21,944 main: ********************************************************************************
2026-06-14 13:16:21,945 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:21,946 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-14 13:16:21,951 process_obs: ObsID 41433 already processed, skipping
2026-06-14 13:16:21,951 main:
2026-06-14 13:16:21,951 main: ********************************************************************************
2026-06-14 13:16:21,951 main: Processing observation 41432
2026-06-14 13:16:21,951 main: ********************************************************************************
2026-06-14 13:16:21,952 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:21,954 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-14 13:16:21,960 process_obs: ObsID 41432 already processed, skipping
2026-06-14 13:16:21,960 main:
2026-06-14 13:16:21,960 main: ********************************************************************************
2026-06-14 13:16:21,960 main: Processing observation 41431
2026-06-14 13:16:21,960 main: ********************************************************************************
2026-06-14 13:16:21,962 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:21,964 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-14 13:16:21,971 process_obs: ObsID 41431 already processed, skipping
2026-06-14 13:16:21,971 main:
2026-06-14 13:16:21,971 main: ********************************************************************************
2026-06-14 13:16:21,971 main: Processing observation 32373
2026-06-14 13:16:21,971 main: ********************************************************************************
2026-06-14 13:16:21,974 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:21,975 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0126A/last.html
2026-06-14 13:16:21,981 process_obs: ObsID 32373 already processed, skipping
2026-06-14 13:16:21,981 main:
2026-06-14 13:16:21,981 main: ********************************************************************************
2026-06-14 13:16:21,981 main: Processing observation 31312
2026-06-14 13:16:21,981 main: ********************************************************************************
2026-06-14 13:16:21,982 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:21,984 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 13:16:21,993 process_obs: ObsID 31312 already processed, skipping
2026-06-14 13:16:21,993 main:
2026-06-14 13:16:21,993 main: ********************************************************************************
2026-06-14 13:16:21,993 main: Processing observation 32379
2026-06-14 13:16:21,993 main: ********************************************************************************
2026-06-14 13:16:21,997 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:21,998 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 13:16:22,003 process_obs: ObsID 32379 already processed, skipping
2026-06-14 13:16:22,003 main:
2026-06-14 13:16:22,003 main: ********************************************************************************
2026-06-14 13:16:22,003 main: Processing observation 30254
2026-06-14 13:16:22,003 main: ********************************************************************************
2026-06-14 13:16:22,006 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:22,007 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 13:16:22,015 process_obs: ObsID 30254 already processed, skipping
2026-06-14 13:16:22,015 main:
2026-06-14 13:16:22,015 main: ********************************************************************************
2026-06-14 13:16:22,015 main: Processing observation 32380
2026-06-14 13:16:22,015 main: ********************************************************************************
2026-06-14 13:16:22,016 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:22,018 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 13:16:22,022 process_obs: ObsID 32380 already processed, skipping
2026-06-14 13:16:22,022 main:
2026-06-14 13:16:22,022 main: ********************************************************************************
2026-06-14 13:16:22,022 main: Processing observation 30244
2026-06-14 13:16:22,022 main: ********************************************************************************
2026-06-14 13:16:22,023 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:22,024 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 13:16:22,027 process_obs: ObsID 30244 already processed, skipping
2026-06-14 13:16:22,027 main:
2026-06-14 13:16:22,027 main: ********************************************************************************
2026-06-14 13:16:22,027 main: Processing observation 31370
2026-06-14 13:16:22,027 main: ********************************************************************************
2026-06-14 13:16:22,028 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:22,029 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 13:16:22,033 process_obs: ObsID 31370 already processed, skipping
2026-06-14 13:16:22,033 main:
2026-06-14 13:16:22,033 main: ********************************************************************************
2026-06-14 13:16:22,033 main: Processing observation 32356
2026-06-14 13:16:22,033 main: ********************************************************************************
2026-06-14 13:16:22,035 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:22,037 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 13:16:22,051 process_obs: ObsID 32356 already processed, skipping
2026-06-14 13:16:22,051 main:
2026-06-14 13:16:22,051 main: ********************************************************************************
2026-06-14 13:16:22,051 main: Processing observation 29989
2026-06-14 13:16:22,051 main: ********************************************************************************
2026-06-14 13:16:22,053 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 13:16:22,054 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:26,450 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29989/centroid_resids.pkl
2026-06-14 12:16:26,455 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-14 12:16:26,455 plot_crs_time: Plot file exists, skipping
2026-06-14 12:16:26,456 plot_crs_scatter: Plot file exists, skipping
2026-06-14 12:16:26,663 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-14 12:16:27,910 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29989/n_kalman_delta_roll.png
2026-06-14 12:16:33,444 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29989/index.html
2026-06-14 12:16:33,446 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29989/info.json
2026-06-14 12:16:33,451 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29989/index.html
2026-06-14 12:16:33,452 main:
2026-06-14 12:16:33,452 main: ********************************************************************************
2026-06-14 12:16:33,452 main: Processing observation 32390
2026-06-14 12:16:33,452 main: ********************************************************************************
2026-06-14 12:16:33,455 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,459 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,465 process_obs: ObsID 32390 already processed, skipping
2026-06-14 12:16:33,465 main:
2026-06-14 12:16:33,465 main: ********************************************************************************
2026-06-14 12:16:33,465 main: Processing observation 32382
2026-06-14 12:16:33,465 main: ********************************************************************************
2026-06-14 12:16:33,468 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,471 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,705 process_obs: ObsID 32382 already processed, skipping
2026-06-14 12:16:33,705 main:
2026-06-14 12:16:33,705 main: ********************************************************************************
2026-06-14 12:16:33,705 main: Processing observation 29922
2026-06-14 12:16:33,705 main: ********************************************************************************
2026-06-14 12:16:33,706 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,708 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,712 process_obs: ObsID 29922 already processed, skipping
2026-06-14 12:16:33,712 main:
2026-06-14 12:16:33,712 main: ********************************************************************************
2026-06-14 12:16:33,712 main: Processing observation 32378
2026-06-14 12:16:33,712 main: ********************************************************************************
2026-06-14 12:16:33,714 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,716 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,740 process_obs: ObsID 32378 already processed, skipping
2026-06-14 12:16:33,740 main:
2026-06-14 12:16:33,740 main: ********************************************************************************
2026-06-14 12:16:33,740 main: Processing observation 29654
2026-06-14 12:16:33,740 main: ********************************************************************************
2026-06-14 12:16:33,741 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,742 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,746 process_obs: ObsID 29654 already processed, skipping
2026-06-14 12:16:33,746 main:
2026-06-14 12:16:33,746 main: ********************************************************************************
2026-06-14 12:16:33,746 main: Processing observation 41430
2026-06-14 12:16:33,746 main: ********************************************************************************
2026-06-14 12:16:33,747 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,748 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,752 process_obs: ObsID 41430 already processed, skipping
2026-06-14 12:16:33,752 main:
2026-06-14 12:16:33,752 main: ********************************************************************************
2026-06-14 12:16:33,752 main: Processing observation 41429
2026-06-14 12:16:33,752 main: ********************************************************************************
2026-06-14 12:16:33,753 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,754 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,757 process_obs: ObsID 41429 already processed, skipping
2026-06-14 12:16:33,757 main:
2026-06-14 12:16:33,757 main: ********************************************************************************
2026-06-14 12:16:33,757 main: Processing observation 41428
2026-06-14 12:16:33,757 main: ********************************************************************************
2026-06-14 12:16:33,758 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,759 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,765 process_obs: ObsID 41428 already processed, skipping
2026-06-14 12:16:33,765 main:
2026-06-14 12:16:33,765 main: ********************************************************************************
2026-06-14 12:16:33,765 main: Processing observation 30541
2026-06-14 12:16:33,765 main: ********************************************************************************
2026-06-14 12:16:33,770 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,771 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,779 process_obs: ObsID 30541 already processed, skipping
2026-06-14 12:16:33,779 main:
2026-06-14 12:16:33,779 main: ********************************************************************************
2026-06-14 12:16:33,779 main: Processing observation 30506
2026-06-14 12:16:33,779 main: ********************************************************************************
2026-06-14 12:16:33,782 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,783 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,803 process_obs: ObsID 30506 already processed, skipping
2026-06-14 12:16:33,803 main:
2026-06-14 12:16:33,803 main: ********************************************************************************
2026-06-14 12:16:33,803 main: Processing observation 32388
2026-06-14 12:16:33,803 main: ********************************************************************************
2026-06-14 12:16:33,813 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,814 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,818 process_obs: ObsID 32388 already processed, skipping
2026-06-14 12:16:33,818 main:
2026-06-14 12:16:33,818 main: ********************************************************************************
2026-06-14 12:16:33,818 main: Processing observation 29955
2026-06-14 12:16:33,818 main: ********************************************************************************
2026-06-14 12:16:33,819 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,820 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,824 process_obs: ObsID 29955 already processed, skipping
2026-06-14 12:16:33,824 main:
2026-06-14 12:16:33,824 main: ********************************************************************************
2026-06-14 12:16:33,824 main: Processing observation 32389
2026-06-14 12:16:33,824 main: ********************************************************************************
2026-06-14 12:16:33,826 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,827 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,832 process_obs: ObsID 32389 already processed, skipping
2026-06-14 12:16:33,832 main:
2026-06-14 12:16:33,832 main: ********************************************************************************
2026-06-14 12:16:33,832 main: Processing observation 32357
2026-06-14 12:16:33,832 main: ********************************************************************************
2026-06-14 12:16:33,833 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,834 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,838 process_obs: ObsID 32357 already processed, skipping
2026-06-14 12:16:33,838 main:
2026-06-14 12:16:33,838 main: ********************************************************************************
2026-06-14 12:16:33,838 main: Processing observation 32358
2026-06-14 12:16:33,838 main: ********************************************************************************
2026-06-14 12:16:33,839 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,840 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,845 process_obs: ObsID 32358 already processed, skipping
2026-06-14 12:16:33,845 main:
2026-06-14 12:16:33,845 main: ********************************************************************************
2026-06-14 12:16:33,845 main: Processing observation 30137
2026-06-14 12:16:33,845 main: ********************************************************************************
2026-06-14 12:16:33,846 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,847 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:33,861 process_obs: ObsID 30137 already processed, skipping
2026-06-14 12:16:33,861 main:
2026-06-14 12:16:33,861 main: ********************************************************************************
2026-06-14 12:16:33,861 main: Processing observation 29801
2026-06-14 12:16:33,862 main: ********************************************************************************
2026-06-14 12:16:33,863 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:33,865 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:36,787 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29801/centroid_resids.pkl
2026-06-14 12:16:36,806 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-14 12:16:36,807 plot_crs_time: Plot file exists, skipping
2026-06-14 12:16:36,811 plot_crs_scatter: Plot file exists, skipping
2026-06-14 12:16:38,002 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29801/n_kalman_delta_roll.png
2026-06-14 12:16:38,232 get_aberration_correction: More than one entry for 29801 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/JUN0826/oflsb/output/JUN0826B_ManErr.txt. Skipping aber correction
2026-06-14 12:16:42,342 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29801/index.html
2026-06-14 12:16:42,343 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/29801/info.json
2026-06-14 12:16:42,364 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29801/index.html
2026-06-14 12:16:42,366 main:
2026-06-14 12:16:42,366 main: ********************************************************************************
2026-06-14 12:16:42,366 main: Processing observation 32386
2026-06-14 12:16:42,366 main: ********************************************************************************
2026-06-14 12:16:42,367 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:42,368 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:42,388 process_obs: ObsID 32386 already processed, skipping
2026-06-14 12:16:42,388 main:
2026-06-14 12:16:42,388 main: ********************************************************************************
2026-06-14 12:16:42,388 main: Processing observation 32384
2026-06-14 12:16:42,388 main: ********************************************************************************
2026-06-14 12:16:42,389 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:42,390 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:44,585 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32384/centroid_resids.pkl
2026-06-14 12:16:44,661 write_centroid_resids: Centroid residuals file exists, skipping
2026-06-14 12:16:44,661 plot_crs_time: Plot file exists, skipping
2026-06-14 12:16:44,661 plot_crs_scatter: Plot file exists, skipping
2026-06-14 12:16:46,039 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32384/n_kalman_delta_roll.png
2026-06-14 12:16:49,435 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32384/index.html
2026-06-14 12:16:49,438 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32384/info.json
2026-06-14 12:16:49,450 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32384/index.html
2026-06-14 12:16:49,451 main:
2026-06-14 12:16:49,451 main: ********************************************************************************
2026-06-14 12:16:49,451 main: Processing observation 41422
2026-06-14 12:16:49,451 main: ********************************************************************************
2026-06-14 12:16:49,453 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:49,455 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:49,473 process_obs: ObsID 41422 already processed, skipping
2026-06-14 12:16:49,473 main:
2026-06-14 12:16:49,473 main: ********************************************************************************
2026-06-14 12:16:49,473 main: Processing observation 41421
2026-06-14 12:16:49,473 main: ********************************************************************************
2026-06-14 12:16:49,476 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:49,479 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:49,492 process_obs: ObsID 41421 already processed, skipping
2026-06-14 12:16:49,492 main:
2026-06-14 12:16:49,492 main: ********************************************************************************
2026-06-14 12:16:49,492 main: Processing observation 41420
2026-06-14 12:16:49,492 main: ********************************************************************************
2026-06-14 12:16:49,493 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:49,496 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:49,513 process_obs: ObsID 41420 already processed, skipping
2026-06-14 12:16:49,513 main:
2026-06-14 12:16:49,513 main: ********************************************************************************
2026-06-14 12:16:49,513 main: Processing observation 41419
2026-06-14 12:16:49,513 main: ********************************************************************************
2026-06-14 12:16:49,514 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:49,517 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:51,825 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-14 12:16:52,516 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/41419/centroid_resids.pkl with 8 slots
2026-06-14 12:16:52,606 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/41419/centroid_resids_time.png
2026-06-14 12:16:53,230 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/41419/centroid_resids_scatter.png
2026-06-14 12:16:53,422 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-06-14 12:16:53,542 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/41419/n_kalman_delta_roll.png
2026-06-14 12:16:56,140 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/41419/index.html
2026-06-14 12:16:56,142 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/41419/info.json
2026-06-14 12:16:56,145 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/41/41419/index.html
2026-06-14 12:16:56,146 main:
2026-06-14 12:16:56,146 main: ********************************************************************************
2026-06-14 12:16:56,146 main: Processing observation 30139
2026-06-14 12:16:56,146 main: ********************************************************************************
2026-06-14 12:16:56,149 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:16:56,150 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:16:58,525 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-14 12:16:58,944 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30139/centroid_resids.pkl with 5 slots
2026-06-14 12:16:58,997 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30139/centroid_resids_time.png
2026-06-14 12:16:59,287 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30139/centroid_resids_scatter.png
2026-06-14 12:17:00,376 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30139/n_kalman_delta_roll.png
2026-06-14 12:17:00,542 get_aberration_correction: More than one entry for 30139 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/JUN0826/oflsb/output/JUN0826B_ManErr.txt. Skipping aber correction
2026-06-14 12:17:00,552 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30139/index.html
2026-06-14 12:17:00,555 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30139/info.json
2026-06-14 12:17:00,558 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30139/index.html
2026-06-14 12:17:00,559 main:
2026-06-14 12:17:00,560 main: ********************************************************************************
2026-06-14 12:17:00,560 main: Processing observation 31409
2026-06-14 12:17:00,560 main: ********************************************************************************
2026-06-14 12:17:00,561 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:17:00,562 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:17:03,444 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-14 12:17:03,827 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/31409/centroid_resids.pkl with 5 slots
2026-06-14 12:17:03,913 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/31409/centroid_resids_time.png
2026-06-14 12:17:04,231 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/31409/centroid_resids_scatter.png
2026-06-14 12:17:05,586 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/31409/n_kalman_delta_roll.png
2026-06-14 12:17:05,860 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/31409/index.html
2026-06-14 12:17:05,865 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/31409/info.json
2026-06-14 12:17:05,873 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31409/index.html
2026-06-14 12:17:05,876 main:
2026-06-14 12:17:05,876 main: ********************************************************************************
2026-06-14 12:17:05,876 main: Processing observation 32385
2026-06-14 12:17:05,876 main: ********************************************************************************
2026-06-14 12:17:05,895 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:17:05,899 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:17:10,343 get_centroid_resids: Computing centroid residuals from telemetry
2026-06-14 12:17:10,653 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32385/centroid_resids.pkl with 5 slots
2026-06-14 12:17:10,700 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32385/centroid_resids_time.png
2026-06-14 12:17:11,169 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32385/centroid_resids_scatter.png
2026-06-14 12:17:12,372 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32385/n_kalman_delta_roll.png
2026-06-14 12:17:12,542 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32385/index.html
2026-06-14 12:17:12,548 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32385/info.json
2026-06-14 12:17:12,551 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32385/index.html
2026-06-14 12:17:12,551 main:
2026-06-14 12:17:12,552 main: ********************************************************************************
2026-06-14 12:17:12,552 main: Processing observation 32383
2026-06-14 12:17:12,552 main: ********************************************************************************
2026-06-14 12:17:12,553 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:17:12,554 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:17:14,867 __init__: ObsID 32383 has insufficient telemetry, skipping
2026-06-14 12:17:14,867 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/index.html
2026-06-14 12:17:14,873 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32383/info.json
2026-06-14 12:17:14,873 main:
2026-06-14 12:17:14,873 main: ********************************************************************************
2026-06-14 12:17:14,873 main: Processing observation 32381
2026-06-14 12:17:14,874 main: ********************************************************************************
2026-06-14 12:17:14,877 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:17:14,878 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:17:17,299 __init__: ObsID 32381 has no maneuver event in telemetry, skipping
2026-06-14 12:17:17,300 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32381/index.html
2026-06-14 12:17:17,304 info: could not get attribute kalman_start for obsid 32381
2026-06-14 12:17:17,304 info: could not get attribute kalman_stop for obsid 32381
2026-06-14 12:17:17,304 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/32381/info.json
2026-06-14 12:17:17,305 main:
2026-06-14 12:17:17,305 main: ********************************************************************************
2026-06-14 12:17:17,305 main: Processing observation 30538
2026-06-14 12:17:17,305 main: ********************************************************************************
2026-06-14 12:17:17,306 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30538/info.json file found, obs=None
2026-06-14 12:17:17,307 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-06-14 12:17:17,308 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/last.html
2026-06-14 12:17:19,935 __init__: ObsID 30538 has no maneuver event in telemetry, skipping
2026-06-14 12:17:19,943 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30538/index.html
2026-06-14 12:17:19,961 info: could not get attribute kalman_start for obsid 30538
2026-06-14 12:17:19,961 info: could not get attribute kalman_stop for obsid 30538
2026-06-14 12:17:19,961 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/JUN0826B/30538/info.json
2026-06-14 12:17:19,971 main:
2026-06-14 13:17:21,686 run_check: Starting centroid dashboard continuity check
2026-06-14 13:17:21,686 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-06-14 13:17:21,690 collect_observations: Processing year 2020
2026-06-14 13:17:25,441 collect_observations: Processing year 2021
2026-06-14 13:17:31,297 collect_observations: Processing year 2022
2026-06-14 13:17:37,730 collect_observations: Processing year 2023
2026-06-14 13:17:44,293 collect_observations: Processing year 2024
2026-06-14 13:17:50,597 collect_observations: Processing year 2025
2026-06-14 13:17:57,928 collect_observations: Processing year 2026
2026-06-14 13:18:03,556 collect_observations: Collected 14032 observations from 4-digit years
2026-06-14 13:18:03,564 sort_observations_by_date: Sorted observations by date
2026-06-14 13:18:03,564 check_continuity: Starting continuity check from most recent: ObsID 30538 (JUN0826B) at 2026:165:12:08:57.887
2026-06-14 13:18:03,585 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-06-14 13:18:03,585 check_continuity: Chain complete: visited 14032 observations out of 14032 total
2026-06-14 13:18:03,586 run_check: ✓ Observation chain continuity check PASSED
2026-06-14 13:18:03,586 run_check: Summary: 14032 observations from 4-digit years, all properly linked