Prev
Index
Next
centroid_dashboard: Tue May 19 13:17:32 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Tue May 19 13:17:32 2026 |
No errors
File contents:
2026-05-19 13:16:11,946 main: Processing from 2026:132:17:16:11.945 to 2026:139:17:16:11.945
2026-05-19 13:16:29,025 get_observations: Found observation 30091 at 2026:132:18:33:00.064 with 2 manvrs
2026-05-19 13:16:29,026 get_observations: Found observation 30195 at 2026:133:00:27:08.154 with 2 manvrs
2026-05-19 13:16:29,026 get_observations: Found observation 32341 at 2026:133:05:31:14.621 with 2 manvrs
2026-05-19 13:16:29,027 get_observations: Found observation 32210 at 2026:133:10:31:18.084 with 2 manvrs
2026-05-19 13:16:29,027 get_observations: Found observation 30258 at 2026:133:15:06:15.089 with 1 manvrs
2026-05-19 13:16:29,028 get_observations: Found observation 32343 at 2026:133:23:57:49.754 with 1 manvrs
2026-05-19 13:16:29,028 get_observations: Found observation 31145 at 2026:134:04:26:55.444 with 1 manvrs
2026-05-19 13:16:29,028 get_observations: Found observation 30066 at 2026:134:09:08:32.664 with 1 manvrs
2026-05-19 13:16:29,029 get_observations: Found observation 41489 at 2026:134:17:58:41.819 with 1 manvrs
2026-05-19 13:16:29,029 get_observations: Found observation 41488 at 2026:134:21:40:40.252 with 1 manvrs
2026-05-19 13:16:29,030 get_observations: Found observation 41487 at 2026:135:00:25:40.252 with 1 manvrs
2026-05-19 13:16:29,030 get_observations: Found observation 31993 at 2026:135:04:33:31.578 with 1 manvrs
2026-05-19 13:16:29,030 get_observations: Found observation 32338 at 2026:135:09:52:23.722 with 2 manvrs
2026-05-19 13:16:29,031 get_observations: Found observation 32251 at 2026:135:13:48:54.427 with 1 manvrs
2026-05-19 13:16:29,031 get_observations: Found observation 30435 at 2026:135:20:09:04.743 with 2 manvrs
2026-05-19 13:16:29,032 get_observations: Found observation 41484 at 2026:136:00:44:14.743 with 1 manvrs
2026-05-19 13:16:29,032 get_observations: Found observation 30100 at 2026:136:01:33:28.102 with 1 manvrs
2026-05-19 13:16:29,033 get_observations: Found observation 32344 at 2026:136:10:26:10.662 with 1 manvrs
2026-05-19 13:16:29,033 get_observations: Found observation 41483 at 2026:136:14:28:00.662 with 1 manvrs
2026-05-19 13:16:29,033 get_observations: Found observation 32342 at 2026:136:15:20:50.267 with 1 manvrs
2026-05-19 13:16:29,034 get_observations: Found observation 32345 at 2026:136:19:04:08.886 with 2 manvrs
2026-05-19 13:16:29,034 get_observations: Found observation 32340 at 2026:136:22:59:25.425 with 1 manvrs
2026-05-19 13:16:29,035 get_observations: Found observation 32346 at 2026:137:02:37:54.692 with 1 manvrs
2026-05-19 13:16:29,035 get_observations: Found observation 32337 at 2026:137:06:16:32.700 with 1 manvrs
2026-05-19 13:16:29,036 get_observations: Found observation 41481 at 2026:137:09:39:03.588 with 1 manvrs
2026-05-19 13:16:29,036 get_observations: Found observation 41480 at 2026:137:10:34:44.010 with 1 manvrs
2026-05-19 13:16:29,036 get_observations: Found observation 41479 at 2026:137:13:55:40.252 with 1 manvrs
2026-05-19 13:16:29,037 get_observations: Found observation 41478 at 2026:137:16:55:40.252 with 1 manvrs
2026-05-19 13:16:29,037 get_observations: Found observation 41477 at 2026:137:18:29:12.856 with 1 manvrs
2026-05-19 13:16:29,038 get_observations: Found observation 30394 at 2026:137:19:56:15.771 with 1 manvrs
2026-05-19 13:16:29,038 get_observations: Found observation 30191 at 2026:138:00:42:23.507 with 1 manvrs
2026-05-19 13:16:29,039 get_observations: Found observation 32355 at 2026:138:05:11:43.274 with 1 manvrs
2026-05-19 13:16:29,039 get_observations: Found observation 32352 at 2026:138:09:57:42.943 with 1 manvrs
2026-05-19 13:16:29,039 get_observations: Found observation 31883 at 2026:138:13:53:42.586 with 1 manvrs
2026-05-19 13:16:29,040 get_observations: Found observation 32353 at 2026:138:17:16:22.131 with 1 manvrs
2026-05-19 13:16:29,040 get_observations: Found observation 30247 at 2026:138:21:07:51.672 with 1 manvrs
2026-05-19 13:16:29,041 get_observations: Found observation 30206 at 2026:139:05:52:25.323 with 1 manvrs
2026-05-19 13:16:29,041 get_observations: Found observation 29879 at 2026:139:10:22:28.066 with 1 manvrs
2026-05-19 13:16:29,041 main: Found 38 observations
2026-05-19 13:16:29,042 main: ********************************************************************************
2026-05-19 13:16:29,042 main: Processing observation 30091
2026-05-19 13:16:29,042 main: ********************************************************************************
2026-05-19 13:16:29,046 obs_link_from_info: Found prev obsid 32339
2026-05-19 13:16:29,050 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,051 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,054 process_obs: ObsID 30091 already processed, skipping
2026-05-19 13:16:29,054 main:
2026-05-19 13:16:29,054 main: ********************************************************************************
2026-05-19 13:16:29,054 main: Processing observation 30195
2026-05-19 13:16:29,054 main: ********************************************************************************
2026-05-19 13:16:29,055 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,056 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,059 process_obs: ObsID 30195 already processed, skipping
2026-05-19 13:16:29,059 main:
2026-05-19 13:16:29,059 main: ********************************************************************************
2026-05-19 13:16:29,059 main: Processing observation 32341
2026-05-19 13:16:29,059 main: ********************************************************************************
2026-05-19 13:16:29,061 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,062 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,065 process_obs: ObsID 32341 already processed, skipping
2026-05-19 13:16:29,065 main:
2026-05-19 13:16:29,065 main: ********************************************************************************
2026-05-19 13:16:29,065 main: Processing observation 32210
2026-05-19 13:16:29,065 main: ********************************************************************************
2026-05-19 13:16:29,066 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,067 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,070 process_obs: ObsID 32210 already processed, skipping
2026-05-19 13:16:29,071 main:
2026-05-19 13:16:29,071 main: ********************************************************************************
2026-05-19 13:16:29,071 main: Processing observation 30258
2026-05-19 13:16:29,071 main: ********************************************************************************
2026-05-19 13:16:29,072 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,073 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,076 process_obs: ObsID 30258 already processed, skipping
2026-05-19 13:16:29,076 main:
2026-05-19 13:16:29,076 main: ********************************************************************************
2026-05-19 13:16:29,076 main: Processing observation 32343
2026-05-19 13:16:29,076 main: ********************************************************************************
2026-05-19 13:16:29,077 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,078 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,082 process_obs: ObsID 32343 already processed, skipping
2026-05-19 13:16:29,082 main:
2026-05-19 13:16:29,082 main: ********************************************************************************
2026-05-19 13:16:29,082 main: Processing observation 31145
2026-05-19 13:16:29,082 main: ********************************************************************************
2026-05-19 13:16:29,083 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,084 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,087 process_obs: ObsID 31145 already processed, skipping
2026-05-19 13:16:29,087 main:
2026-05-19 13:16:29,087 main: ********************************************************************************
2026-05-19 13:16:29,087 main: Processing observation 30066
2026-05-19 13:16:29,087 main: ********************************************************************************
2026-05-19 13:16:29,088 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,090 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,093 process_obs: ObsID 30066 already processed, skipping
2026-05-19 13:16:29,093 main:
2026-05-19 13:16:29,093 main: ********************************************************************************
2026-05-19 13:16:29,093 main: Processing observation 41489
2026-05-19 13:16:29,093 main: ********************************************************************************
2026-05-19 13:16:29,094 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,095 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,098 process_obs: ObsID 41489 already processed, skipping
2026-05-19 13:16:29,098 main:
2026-05-19 13:16:29,098 main: ********************************************************************************
2026-05-19 13:16:29,098 main: Processing observation 41488
2026-05-19 13:16:29,099 main: ********************************************************************************
2026-05-19 13:16:29,100 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,101 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,104 process_obs: ObsID 41488 already processed, skipping
2026-05-19 13:16:29,104 main:
2026-05-19 13:16:29,104 main: ********************************************************************************
2026-05-19 13:16:29,104 main: Processing observation 41487
2026-05-19 13:16:29,104 main: ********************************************************************************
2026-05-19 13:16:29,105 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,106 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,109 process_obs: ObsID 41487 already processed, skipping
2026-05-19 13:16:29,109 main:
2026-05-19 13:16:29,109 main: ********************************************************************************
2026-05-19 13:16:29,109 main: Processing observation 31993
2026-05-19 13:16:29,109 main: ********************************************************************************
2026-05-19 13:16:29,111 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,112 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,115 process_obs: ObsID 31993 already processed, skipping
2026-05-19 13:16:29,115 main:
2026-05-19 13:16:29,115 main: ********************************************************************************
2026-05-19 13:16:29,115 main: Processing observation 32338
2026-05-19 13:16:29,115 main: ********************************************************************************
2026-05-19 13:16:29,116 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,117 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,120 process_obs: ObsID 32338 already processed, skipping
2026-05-19 13:16:29,120 main:
2026-05-19 13:16:29,120 main: ********************************************************************************
2026-05-19 13:16:29,120 main: Processing observation 32251
2026-05-19 13:16:29,120 main: ********************************************************************************
2026-05-19 13:16:29,121 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,123 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,126 process_obs: ObsID 32251 already processed, skipping
2026-05-19 13:16:29,126 main:
2026-05-19 13:16:29,126 main: ********************************************************************************
2026-05-19 13:16:29,126 main: Processing observation 30435
2026-05-19 13:16:29,126 main: ********************************************************************************
2026-05-19 13:16:29,127 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,128 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,131 process_obs: ObsID 30435 already processed, skipping
2026-05-19 13:16:29,131 main:
2026-05-19 13:16:29,131 main: ********************************************************************************
2026-05-19 13:16:29,131 main: Processing observation 41484
2026-05-19 13:16:29,131 main: ********************************************************************************
2026-05-19 13:16:29,132 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,133 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 13:16:29,137 process_obs: ObsID 41484 already processed, skipping
2026-05-19 13:16:29,137 main:
2026-05-19 13:16:29,137 main: ********************************************************************************
2026-05-19 13:16:29,137 main: Processing observation 30100
2026-05-19 13:16:29,137 main: ********************************************************************************
2026-05-19 13:16:29,138 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 13:16:29,139 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 12:16:32,752 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30100/centroid_resids.pkl
2026-05-19 12:16:32,758 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-19 12:16:32,759 plot_crs_time: Plot file exists, skipping
2026-05-19 12:16:32,759 plot_crs_scatter: Plot file exists, skipping
2026-05-19 12:16:34,291 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30100/n_kalman_delta_roll.png
2026-05-19 12:16:37,439 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30100/index.html
2026-05-19 12:16:37,450 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/30100/info.json
2026-05-19 12:16:37,486 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30100/index.html
2026-05-19 12:16:37,493 main:
2026-05-19 12:16:37,493 main: ********************************************************************************
2026-05-19 12:16:37,493 main: Processing observation 32344
2026-05-19 12:16:37,493 main: ********************************************************************************
2026-05-19 12:16:37,500 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:37,515 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 12:16:37,563 process_obs: ObsID 32344 already processed, skipping
2026-05-19 12:16:37,563 main:
2026-05-19 12:16:37,563 main: ********************************************************************************
2026-05-19 12:16:37,563 main: Processing observation 41483
2026-05-19 12:16:37,563 main: ********************************************************************************
2026-05-19 12:16:37,578 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:37,580 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 12:16:37,607 process_obs: ObsID 41483 already processed, skipping
2026-05-19 12:16:37,607 main:
2026-05-19 12:16:37,607 main: ********************************************************************************
2026-05-19 12:16:37,607 main: Processing observation 32342
2026-05-19 12:16:37,607 main: ********************************************************************************
2026-05-19 12:16:37,627 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:37,654 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 12:16:39,905 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/32342/centroid_resids.pkl
2026-05-19 12:16:39,908 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-19 12:16:39,908 plot_crs_time: Plot file exists, skipping
2026-05-19 12:16:39,908 plot_crs_scatter: Plot file exists, skipping
2026-05-19 12:16:40,500 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/32342/n_kalman_delta_roll.png
2026-05-19 12:16:40,634 get_aberration_correction: More than one entry for 32342 in /proj/sot/ska3/aca/data/mpcrit1/mplogs/2026/MAY1126/oflsa/output/MAY1126A_ManErr.txt. Skipping aber correction
2026-05-19 12:16:42,463 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/32342/index.html
2026-05-19 12:16:42,465 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/32342/info.json
2026-05-19 12:16:42,467 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32342/index.html
2026-05-19 12:16:42,468 main:
2026-05-19 12:16:42,468 main: ********************************************************************************
2026-05-19 12:16:42,468 main: Processing observation 32345
2026-05-19 12:16:42,468 main: ********************************************************************************
2026-05-19 12:16:42,469 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:42,470 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 12:16:42,474 process_obs: ObsID 32345 already processed, skipping
2026-05-19 12:16:42,474 main:
2026-05-19 12:16:42,474 main: ********************************************************************************
2026-05-19 12:16:42,474 main: Processing observation 32340
2026-05-19 12:16:42,474 main: ********************************************************************************
2026-05-19 12:16:42,475 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:42,476 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 12:16:42,479 process_obs: ObsID 32340 already processed, skipping
2026-05-19 12:16:42,479 main:
2026-05-19 12:16:42,479 main: ********************************************************************************
2026-05-19 12:16:42,479 main: Processing observation 32346
2026-05-19 12:16:42,479 main: ********************************************************************************
2026-05-19 12:16:42,481 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:42,482 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 12:16:42,485 process_obs: ObsID 32346 already processed, skipping
2026-05-19 12:16:42,485 main:
2026-05-19 12:16:42,485 main: ********************************************************************************
2026-05-19 12:16:42,485 main: Processing observation 32337
2026-05-19 12:16:42,485 main: ********************************************************************************
2026-05-19 12:16:42,486 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:42,487 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 12:16:42,490 process_obs: ObsID 32337 already processed, skipping
2026-05-19 12:16:42,490 main:
2026-05-19 12:16:42,490 main: ********************************************************************************
2026-05-19 12:16:42,491 main: Processing observation 41481
2026-05-19 12:16:42,491 main: ********************************************************************************
2026-05-19 12:16:42,492 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:42,493 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1126A/last.html
2026-05-19 12:16:42,496 process_obs: ObsID 41481 already processed, skipping
2026-05-19 12:16:42,496 main:
2026-05-19 12:16:42,496 main: ********************************************************************************
2026-05-19 12:16:42,496 main: Processing observation 41480
2026-05-19 12:16:42,496 main: ********************************************************************************
2026-05-19 12:16:42,498 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:42,499 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:16:42,502 process_obs: ObsID 41480 already processed, skipping
2026-05-19 12:16:42,502 main:
2026-05-19 12:16:42,502 main: ********************************************************************************
2026-05-19 12:16:42,502 main: Processing observation 41479
2026-05-19 12:16:42,502 main: ********************************************************************************
2026-05-19 12:16:42,503 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:42,504 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:16:42,508 process_obs: ObsID 41479 already processed, skipping
2026-05-19 12:16:42,508 main:
2026-05-19 12:16:42,508 main: ********************************************************************************
2026-05-19 12:16:42,508 main: Processing observation 41478
2026-05-19 12:16:42,508 main: ********************************************************************************
2026-05-19 12:16:42,509 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:42,510 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:16:42,513 process_obs: ObsID 41478 already processed, skipping
2026-05-19 12:16:42,513 main:
2026-05-19 12:16:42,513 main: ********************************************************************************
2026-05-19 12:16:42,513 main: Processing observation 41477
2026-05-19 12:16:42,513 main: ********************************************************************************
2026-05-19 12:16:42,514 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:42,515 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:16:42,519 process_obs: ObsID 41477 already processed, skipping
2026-05-19 12:16:42,519 main:
2026-05-19 12:16:42,519 main: ********************************************************************************
2026-05-19 12:16:42,519 main: Processing observation 30394
2026-05-19 12:16:42,519 main: ********************************************************************************
2026-05-19 12:16:42,520 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:42,521 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:16:44,846 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30394/centroid_resids.pkl
2026-05-19 12:16:44,854 write_centroid_resids: Centroid residuals file exists, skipping
2026-05-19 12:16:44,854 plot_crs_time: Plot file exists, skipping
2026-05-19 12:16:44,855 plot_crs_scatter: Plot file exists, skipping
2026-05-19 12:16:45,579 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30394/n_kalman_delta_roll.png
2026-05-19 12:16:47,517 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30394/index.html
2026-05-19 12:16:47,519 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30394/info.json
2026-05-19 12:16:47,522 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30394/index.html
2026-05-19 12:16:47,523 main:
2026-05-19 12:16:47,523 main: ********************************************************************************
2026-05-19 12:16:47,523 main: Processing observation 30191
2026-05-19 12:16:47,523 main: ********************************************************************************
2026-05-19 12:16:47,525 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:47,526 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:16:49,576 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-19 12:16:49,918 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30191/centroid_resids.pkl with 5 slots
2026-05-19 12:16:49,968 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30191/centroid_resids_time.png
2026-05-19 12:16:50,280 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30191/centroid_resids_scatter.png
2026-05-19 12:16:51,300 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30191/n_kalman_delta_roll.png
2026-05-19 12:16:51,455 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30191/index.html
2026-05-19 12:16:51,457 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30191/info.json
2026-05-19 12:16:51,459 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/30/30191/index.html
2026-05-19 12:16:51,460 main:
2026-05-19 12:16:51,460 main: ********************************************************************************
2026-05-19 12:16:51,460 main: Processing observation 32355
2026-05-19 12:16:51,460 main: ********************************************************************************
2026-05-19 12:16:51,461 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:51,462 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:16:53,321 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-19 12:16:53,640 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32355/centroid_resids.pkl with 5 slots
2026-05-19 12:16:53,692 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32355/centroid_resids_time.png
2026-05-19 12:16:53,951 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32355/centroid_resids_scatter.png
2026-05-19 12:16:54,778 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32355/n_kalman_delta_roll.png
2026-05-19 12:16:54,938 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32355/index.html
2026-05-19 12:16:54,939 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32355/info.json
2026-05-19 12:16:54,942 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32355/index.html
2026-05-19 12:16:54,943 main:
2026-05-19 12:16:54,943 main: ********************************************************************************
2026-05-19 12:16:54,943 main: Processing observation 32352
2026-05-19 12:16:54,943 main: ********************************************************************************
2026-05-19 12:16:54,944 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:54,945 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:16:56,852 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-19 12:16:57,412 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32352/centroid_resids.pkl with 5 slots
2026-05-19 12:16:57,458 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32352/centroid_resids_time.png
2026-05-19 12:16:57,709 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32352/centroid_resids_scatter.png
2026-05-19 12:16:58,635 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32352/n_kalman_delta_roll.png
2026-05-19 12:16:58,781 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32352/index.html
2026-05-19 12:16:58,783 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32352/info.json
2026-05-19 12:16:58,785 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32352/index.html
2026-05-19 12:16:58,786 main:
2026-05-19 12:16:58,786 main: ********************************************************************************
2026-05-19 12:16:58,786 main: Processing observation 31883
2026-05-19 12:16:58,786 main: ********************************************************************************
2026-05-19 12:16:58,787 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:16:58,788 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:17:01,014 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-19 12:17:01,360 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31883/centroid_resids.pkl with 5 slots
2026-05-19 12:17:01,406 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31883/centroid_resids_time.png
2026-05-19 12:17:01,644 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31883/centroid_resids_scatter.png
2026-05-19 12:17:02,394 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31883/n_kalman_delta_roll.png
2026-05-19 12:17:02,675 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31883/index.html
2026-05-19 12:17:02,680 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/31883/info.json
2026-05-19 12:17:02,705 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31883/index.html
2026-05-19 12:17:02,717 main:
2026-05-19 12:17:02,717 main: ********************************************************************************
2026-05-19 12:17:02,717 main: Processing observation 32353
2026-05-19 12:17:02,717 main: ********************************************************************************
2026-05-19 12:17:02,723 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:17:02,741 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:17:05,371 get_centroid_resids: Computing centroid residuals from telemetry
2026-05-19 12:17:06,130 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32353/centroid_resids.pkl with 5 slots
2026-05-19 12:17:06,178 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32353/centroid_resids_time.png
2026-05-19 12:17:06,476 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32353/centroid_resids_scatter.png
2026-05-19 12:17:07,413 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32353/n_kalman_delta_roll.png
2026-05-19 12:17:07,819 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32353/index.html
2026-05-19 12:17:07,820 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/32353/info.json
2026-05-19 12:17:07,822 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32353/index.html
2026-05-19 12:17:07,823 main:
2026-05-19 12:17:07,823 main: ********************************************************************************
2026-05-19 12:17:07,823 main: Processing observation 30247
2026-05-19 12:17:07,823 main: ********************************************************************************
2026-05-19 12:17:07,824 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:17:07,825 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:17:09,894 __init__: ObsID 30247 has insufficient telemetry, skipping
2026-05-19 12:17:09,894 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30247/index.html
2026-05-19 12:17:09,899 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30247/info.json
2026-05-19 12:17:09,900 main:
2026-05-19 12:17:09,900 main: ********************************************************************************
2026-05-19 12:17:09,900 main: Processing observation 30206
2026-05-19 12:17:09,900 main: ********************************************************************************
2026-05-19 12:17:09,903 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:17:09,904 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:17:11,988 __init__: ObsID 30206 has no maneuver event in telemetry, skipping
2026-05-19 12:17:11,989 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30206/index.html
2026-05-19 12:17:11,993 info: could not get attribute kalman_start for obsid 30206
2026-05-19 12:17:11,994 info: could not get attribute kalman_stop for obsid 30206
2026-05-19 12:17:11,994 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/30206/info.json
2026-05-19 12:17:11,994 main:
2026-05-19 12:17:11,994 main: ********************************************************************************
2026-05-19 12:17:11,995 main: Processing observation 29879
2026-05-19 12:17:11,995 main: ********************************************************************************
2026-05-19 12:17:11,995 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/29879/info.json file found, obs=None
2026-05-19 12:17:11,996 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-05-19 12:17:11,997 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/last.html
2026-05-19 12:17:14,053 __init__: ObsID 29879 has no maneuver event in telemetry, skipping
2026-05-19 12:17:14,054 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/29879/index.html
2026-05-19 12:17:14,058 info: could not get attribute kalman_start for obsid 29879
2026-05-19 12:17:14,058 info: could not get attribute kalman_stop for obsid 29879
2026-05-19 12:17:14,058 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/MAY1826A/29879/info.json
2026-05-19 12:17:14,059 main:
2026-05-19 13:17:15,731 run_check: Starting centroid dashboard continuity check
2026-05-19 13:17:15,731 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-05-19 13:17:15,732 collect_observations: Processing year 2020
2026-05-19 13:17:17,423 collect_observations: Processing year 2021
2026-05-19 13:17:19,796 collect_observations: Processing year 2022
2026-05-19 13:17:22,658 collect_observations: Processing year 2023
2026-05-19 13:17:25,440 collect_observations: Processing year 2024
2026-05-19 13:17:28,198 collect_observations: Processing year 2025
2026-05-19 13:17:31,189 collect_observations: Processing year 2026
2026-05-19 13:17:32,031 collect_observations: Collected 13886 observations from 4-digit years
2026-05-19 13:17:32,036 sort_observations_by_date: Sorted observations by date
2026-05-19 13:17:32,036 check_continuity: Starting continuity check from most recent: ObsID 29879 (MAY1826A) at 2026:139:09:50:11.071
2026-05-19 13:17:32,053 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-05-19 13:17:32,053 check_continuity: Chain complete: visited 13886 observations out of 13886 total
2026-05-19 13:17:32,054 run_check: ✓ Observation chain continuity check PASSED
2026-05-19 13:17:32,054 run_check: Summary: 13886 observations from 4-digit years, all properly linked