Prev
Index
Next
centroid_dashboard: Sun Aug 23 13:18:31 2026
File: /proj/sot/ska/data/ska_trend/centroid_dashboard/logs/daily.0/centroid_dashboard.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| centroid_dashboard |
OK
|
0.89 | 1.0 |
Sun Aug 23 13:18:31 2026 |
No errors
File contents:
2026-08-23 13:16:10,747 main: Processing from 2026:228:17:16:10.746 to 2026:235:17:16:10.746
2026-08-23 13:16:18,061 get_observations: Found observation 32499 at 2026:229:01:42:32.061 with 1 manvrs
2026-08-23 13:16:18,061 get_observations: Found observation 31499 at 2026:229:05:09:44.610 with 1 manvrs
2026-08-23 13:16:18,062 get_observations: Found observation 29990 at 2026:229:09:42:26.354 with 1 manvrs
2026-08-23 13:16:18,062 get_observations: Found observation 30234 at 2026:229:13:38:39.646 with 1 manvrs
2026-08-23 13:16:18,063 get_observations: Found observation 41220 at 2026:229:22:27:30.059 with 1 manvrs
2026-08-23 13:16:18,063 get_observations: Found observation 41219 at 2026:230:00:55:40.252 with 1 manvrs
2026-08-23 13:16:18,063 get_observations: Found observation 41218 at 2026:230:03:55:40.252 with 1 manvrs
2026-08-23 13:16:18,064 get_observations: Found observation 41217 at 2026:230:08:55:40.252 with 1 manvrs
2026-08-23 13:16:18,064 get_observations: Found observation 30007 at 2026:230:10:55:50.134 with 1 manvrs
2026-08-23 13:16:18,065 get_observations: Found observation 31037 at 2026:230:14:57:36.943 with 1 manvrs
2026-08-23 13:16:18,065 get_observations: Found observation 30089 at 2026:230:17:41:42.491 with 1 manvrs
2026-08-23 13:16:18,065 get_observations: Found observation 32504 at 2026:231:05:18:15.721 with 1 manvrs
2026-08-23 13:16:18,066 get_observations: Found observation 31167 at 2026:231:08:47:21.456 with 1 manvrs
2026-08-23 13:16:18,066 get_observations: Found observation 29830 at 2026:231:13:31:56.360 with 1 manvrs
2026-08-23 13:16:18,067 get_observations: Found observation 32505 at 2026:231:18:15:39.975 with 1 manvrs
2026-08-23 13:16:18,067 get_observations: Found observation 32506 at 2026:231:20:50:14.260 with 1 manvrs
2026-08-23 13:16:18,067 get_observations: Found observation 31002 at 2026:232:01:01:33.509 with 1 manvrs
2026-08-23 13:16:18,068 get_observations: Found observation 30130 at 2026:232:04:56:30.177 with 1 manvrs
2026-08-23 13:16:18,068 get_observations: Found observation 41216 at 2026:232:13:24:08.400 with 1 manvrs
2026-08-23 13:16:18,069 get_observations: Found observation 41215 at 2026:232:16:55:40.252 with 1 manvrs
2026-08-23 13:16:18,069 get_observations: Found observation 41214 at 2026:232:19:25:40.252 with 1 manvrs
2026-08-23 13:16:18,070 get_observations: Found observation 41213 at 2026:232:23:55:40.252 with 1 manvrs
2026-08-23 13:16:18,070 get_observations: Found observation 32501 at 2026:233:01:58:30.004 with 1 manvrs
2026-08-23 13:16:18,070 get_observations: Found observation 31452 at 2026:233:07:50:55.924 with 1 manvrs
2026-08-23 13:16:18,071 get_observations: Found observation 30447 at 2026:233:11:40:11.722 with 1 manvrs
2026-08-23 13:16:18,071 get_observations: Found observation 30408 at 2026:233:14:28:51.064 with 1 manvrs
2026-08-23 13:16:18,072 get_observations: Found observation 29937 at 2026:233:22:34:44.128 with 1 manvrs
2026-08-23 13:16:18,072 get_observations: Found observation 32503 at 2026:234:07:31:12.259 with 1 manvrs
2026-08-23 13:16:18,073 get_observations: Found observation 32500 at 2026:234:10:12:42.725 with 1 manvrs
2026-08-23 13:16:18,073 get_observations: Found observation 31684 at 2026:234:13:17:36.969 with 1 manvrs
2026-08-23 13:16:18,073 get_observations: Found observation 29968 at 2026:234:22:57:09.104 with 1 manvrs
2026-08-23 13:16:18,074 get_observations: Found observation 41212 at 2026:235:04:55:58.812 with 1 manvrs
2026-08-23 13:16:18,074 get_observations: Found observation 41211 at 2026:235:07:55:40.252 with 1 manvrs
2026-08-23 13:16:18,075 get_observations: Found observation 41210 at 2026:235:10:55:40.252 with 1 manvrs
2026-08-23 13:16:18,075 get_observations: Found observation 41209 at 2026:235:12:05:40.252 with 1 manvrs
2026-08-23 13:16:18,075 get_observations: Found observation 41208 at 2026:235:14:55:40.252 with 1 manvrs
2026-08-23 13:16:18,076 get_observations: Found observation 32502 at 2026:235:17:13:21.587 with 1 manvrs
2026-08-23 13:16:18,076 main: Found 37 observations
2026-08-23 13:16:18,076 main: ********************************************************************************
2026-08-23 13:16:18,076 main: Processing observation 32499
2026-08-23 13:16:18,076 main: ********************************************************************************
2026-08-23 13:16:18,084 obs_link_from_info: Found prev obsid 30227
2026-08-23 13:16:18,093 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,096 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,100 process_obs: ObsID 32499 already processed, skipping
2026-08-23 13:16:18,100 main:
2026-08-23 13:16:18,101 main: ********************************************************************************
2026-08-23 13:16:18,101 main: Processing observation 31499
2026-08-23 13:16:18,101 main: ********************************************************************************
2026-08-23 13:16:18,102 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,104 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,111 process_obs: ObsID 31499 already processed, skipping
2026-08-23 13:16:18,111 main:
2026-08-23 13:16:18,111 main: ********************************************************************************
2026-08-23 13:16:18,111 main: Processing observation 29990
2026-08-23 13:16:18,111 main: ********************************************************************************
2026-08-23 13:16:18,112 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,115 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,121 process_obs: ObsID 29990 already processed, skipping
2026-08-23 13:16:18,121 main:
2026-08-23 13:16:18,121 main: ********************************************************************************
2026-08-23 13:16:18,121 main: Processing observation 30234
2026-08-23 13:16:18,121 main: ********************************************************************************
2026-08-23 13:16:18,123 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,124 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,131 process_obs: ObsID 30234 already processed, skipping
2026-08-23 13:16:18,131 main:
2026-08-23 13:16:18,131 main: ********************************************************************************
2026-08-23 13:16:18,131 main: Processing observation 41220
2026-08-23 13:16:18,131 main: ********************************************************************************
2026-08-23 13:16:18,133 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,134 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,141 process_obs: ObsID 41220 already processed, skipping
2026-08-23 13:16:18,141 main:
2026-08-23 13:16:18,141 main: ********************************************************************************
2026-08-23 13:16:18,141 main: Processing observation 41219
2026-08-23 13:16:18,141 main: ********************************************************************************
2026-08-23 13:16:18,142 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,144 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,148 process_obs: ObsID 41219 already processed, skipping
2026-08-23 13:16:18,149 main:
2026-08-23 13:16:18,149 main: ********************************************************************************
2026-08-23 13:16:18,149 main: Processing observation 41218
2026-08-23 13:16:18,149 main: ********************************************************************************
2026-08-23 13:16:18,152 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,153 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,159 process_obs: ObsID 41218 already processed, skipping
2026-08-23 13:16:18,159 main:
2026-08-23 13:16:18,159 main: ********************************************************************************
2026-08-23 13:16:18,159 main: Processing observation 41217
2026-08-23 13:16:18,159 main: ********************************************************************************
2026-08-23 13:16:18,161 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,162 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,168 process_obs: ObsID 41217 already processed, skipping
2026-08-23 13:16:18,168 main:
2026-08-23 13:16:18,168 main: ********************************************************************************
2026-08-23 13:16:18,168 main: Processing observation 30007
2026-08-23 13:16:18,168 main: ********************************************************************************
2026-08-23 13:16:18,169 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,171 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,178 process_obs: ObsID 30007 already processed, skipping
2026-08-23 13:16:18,178 main:
2026-08-23 13:16:18,178 main: ********************************************************************************
2026-08-23 13:16:18,178 main: Processing observation 31037
2026-08-23 13:16:18,178 main: ********************************************************************************
2026-08-23 13:16:18,179 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,181 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,186 process_obs: ObsID 31037 already processed, skipping
2026-08-23 13:16:18,186 main:
2026-08-23 13:16:18,186 main: ********************************************************************************
2026-08-23 13:16:18,186 main: Processing observation 30089
2026-08-23 13:16:18,186 main: ********************************************************************************
2026-08-23 13:16:18,189 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,190 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,196 process_obs: ObsID 30089 already processed, skipping
2026-08-23 13:16:18,196 main:
2026-08-23 13:16:18,196 main: ********************************************************************************
2026-08-23 13:16:18,196 main: Processing observation 32504
2026-08-23 13:16:18,196 main: ********************************************************************************
2026-08-23 13:16:18,198 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,200 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,204 process_obs: ObsID 32504 already processed, skipping
2026-08-23 13:16:18,204 main:
2026-08-23 13:16:18,204 main: ********************************************************************************
2026-08-23 13:16:18,204 main: Processing observation 31167
2026-08-23 13:16:18,204 main: ********************************************************************************
2026-08-23 13:16:18,207 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,208 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,215 process_obs: ObsID 31167 already processed, skipping
2026-08-23 13:16:18,215 main:
2026-08-23 13:16:18,215 main: ********************************************************************************
2026-08-23 13:16:18,215 main: Processing observation 29830
2026-08-23 13:16:18,215 main: ********************************************************************************
2026-08-23 13:16:18,216 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,218 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,227 process_obs: ObsID 29830 already processed, skipping
2026-08-23 13:16:18,227 main:
2026-08-23 13:16:18,227 main: ********************************************************************************
2026-08-23 13:16:18,227 main: Processing observation 32505
2026-08-23 13:16:18,227 main: ********************************************************************************
2026-08-23 13:16:18,228 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,230 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,262 process_obs: ObsID 32505 already processed, skipping
2026-08-23 13:16:18,262 main:
2026-08-23 13:16:18,262 main: ********************************************************************************
2026-08-23 13:16:18,262 main: Processing observation 32506
2026-08-23 13:16:18,262 main: ********************************************************************************
2026-08-23 13:16:18,282 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,299 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,356 process_obs: ObsID 32506 already processed, skipping
2026-08-23 13:16:18,356 main:
2026-08-23 13:16:18,356 main: ********************************************************************************
2026-08-23 13:16:18,356 main: Processing observation 31002
2026-08-23 13:16:18,356 main: ********************************************************************************
2026-08-23 13:16:18,357 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,358 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,362 process_obs: ObsID 31002 already processed, skipping
2026-08-23 13:16:18,362 main:
2026-08-23 13:16:18,362 main: ********************************************************************************
2026-08-23 13:16:18,362 main: Processing observation 30130
2026-08-23 13:16:18,362 main: ********************************************************************************
2026-08-23 13:16:18,363 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,364 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,367 process_obs: ObsID 30130 already processed, skipping
2026-08-23 13:16:18,367 main:
2026-08-23 13:16:18,367 main: ********************************************************************************
2026-08-23 13:16:18,367 main: Processing observation 41216
2026-08-23 13:16:18,367 main: ********************************************************************************
2026-08-23 13:16:18,368 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,369 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,373 process_obs: ObsID 41216 already processed, skipping
2026-08-23 13:16:18,373 main:
2026-08-23 13:16:18,373 main: ********************************************************************************
2026-08-23 13:16:18,373 main: Processing observation 41215
2026-08-23 13:16:18,373 main: ********************************************************************************
2026-08-23 13:16:18,374 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,375 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,379 process_obs: ObsID 41215 already processed, skipping
2026-08-23 13:16:18,379 main:
2026-08-23 13:16:18,379 main: ********************************************************************************
2026-08-23 13:16:18,379 main: Processing observation 41214
2026-08-23 13:16:18,379 main: ********************************************************************************
2026-08-23 13:16:18,380 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,381 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,403 process_obs: ObsID 41214 already processed, skipping
2026-08-23 13:16:18,403 main:
2026-08-23 13:16:18,403 main: ********************************************************************************
2026-08-23 13:16:18,403 main: Processing observation 41213
2026-08-23 13:16:18,403 main: ********************************************************************************
2026-08-23 13:16:18,404 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,417 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 13:16:18,426 process_obs: ObsID 41213 already processed, skipping
2026-08-23 13:16:18,426 main:
2026-08-23 13:16:18,426 main: ********************************************************************************
2026-08-23 13:16:18,426 main: Processing observation 32501
2026-08-23 13:16:18,426 main: ********************************************************************************
2026-08-23 13:16:18,438 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 13:16:18,439 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:21,329 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32501/centroid_resids.pkl
2026-08-23 12:16:21,367 write_centroid_resids: Centroid residuals file exists, skipping
2026-08-23 12:16:21,367 plot_crs_time: Plot file exists, skipping
2026-08-23 12:16:21,367 plot_crs_scatter: Plot file exists, skipping
2026-08-23 12:16:21,441 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-08-23 12:16:22,103 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32501/n_kalman_delta_roll.png
2026-08-23 12:16:24,469 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32501/index.html
2026-08-23 12:16:24,471 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32501/info.json
2026-08-23 12:16:24,482 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32501/index.html
2026-08-23 12:16:24,483 main:
2026-08-23 12:16:24,483 main: ********************************************************************************
2026-08-23 12:16:24,483 main: Processing observation 31452
2026-08-23 12:16:24,483 main: ********************************************************************************
2026-08-23 12:16:24,485 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:24,486 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:26,680 get_centroid_resids_from_file: Reading centroid residuals from /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/31452/centroid_resids.pkl
2026-08-23 12:16:26,709 write_centroid_resids: Centroid residuals file exists, skipping
2026-08-23 12:16:26,710 plot_crs_time: Plot file exists, skipping
2026-08-23 12:16:26,710 plot_crs_scatter: Plot file exists, skipping
2026-08-23 12:16:26,773 plot_n_kalman_delta_roll: No OBC - GND deltas available, not plotting
2026-08-23 12:16:26,933 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/31452/n_kalman_delta_roll.png
2026-08-23 12:16:27,069 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/31452/index.html
2026-08-23 12:16:27,071 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/31452/info.json
2026-08-23 12:16:27,109 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31452/index.html
2026-08-23 12:16:27,110 main:
2026-08-23 12:16:27,110 main: ********************************************************************************
2026-08-23 12:16:27,111 main: Processing observation 30447
2026-08-23 12:16:27,111 main: ********************************************************************************
2026-08-23 12:16:27,112 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:27,115 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:27,118 process_obs: ObsID 30447 already processed, skipping
2026-08-23 12:16:27,118 main:
2026-08-23 12:16:27,118 main: ********************************************************************************
2026-08-23 12:16:27,118 main: Processing observation 30408
2026-08-23 12:16:27,118 main: ********************************************************************************
2026-08-23 12:16:27,119 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:27,120 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:27,125 process_obs: ObsID 30408 already processed, skipping
2026-08-23 12:16:27,125 main:
2026-08-23 12:16:27,125 main: ********************************************************************************
2026-08-23 12:16:27,125 main: Processing observation 29937
2026-08-23 12:16:27,125 main: ********************************************************************************
2026-08-23 12:16:27,126 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:27,127 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:29,435 get_centroid_resids: Computing centroid residuals from telemetry
2026-08-23 12:16:29,832 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/29937/centroid_resids.pkl with 5 slots
2026-08-23 12:16:29,901 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/29937/centroid_resids_time.png
2026-08-23 12:16:30,245 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/29937/centroid_resids_scatter.png
2026-08-23 12:16:31,961 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/29937/n_kalman_delta_roll.png
2026-08-23 12:16:35,042 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/29937/index.html
2026-08-23 12:16:35,044 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/29937/info.json
2026-08-23 12:16:35,095 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/29/29937/index.html
2026-08-23 12:16:35,096 main:
2026-08-23 12:16:35,096 main: ********************************************************************************
2026-08-23 12:16:35,096 main: Processing observation 32503
2026-08-23 12:16:35,096 main: ********************************************************************************
2026-08-23 12:16:35,098 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:35,099 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:37,641 get_centroid_resids: Computing centroid residuals from telemetry
2026-08-23 12:16:37,961 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32503/centroid_resids.pkl with 5 slots
2026-08-23 12:16:38,215 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32503/centroid_resids_time.png
2026-08-23 12:16:38,456 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32503/centroid_resids_scatter.png
2026-08-23 12:16:39,311 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32503/n_kalman_delta_roll.png
2026-08-23 12:16:39,474 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32503/index.html
2026-08-23 12:16:39,481 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32503/info.json
2026-08-23 12:16:39,493 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32503/index.html
2026-08-23 12:16:39,494 main:
2026-08-23 12:16:39,494 main: ********************************************************************************
2026-08-23 12:16:39,494 main: Processing observation 32500
2026-08-23 12:16:39,494 main: ********************************************************************************
2026-08-23 12:16:39,495 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:39,496 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:41,471 get_centroid_resids: Computing centroid residuals from telemetry
2026-08-23 12:16:41,730 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32500/centroid_resids.pkl with 4 slots
2026-08-23 12:16:41,768 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32500/centroid_resids_time.png
2026-08-23 12:16:41,990 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32500/centroid_resids_scatter.png
2026-08-23 12:16:42,805 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32500/n_kalman_delta_roll.png
2026-08-23 12:16:42,938 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32500/index.html
2026-08-23 12:16:42,940 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32500/info.json
2026-08-23 12:16:42,943 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/32/32500/index.html
2026-08-23 12:16:42,944 main:
2026-08-23 12:16:42,944 main: ********************************************************************************
2026-08-23 12:16:42,944 main: Processing observation 31684
2026-08-23 12:16:42,944 main: ********************************************************************************
2026-08-23 12:16:42,945 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:42,946 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:45,182 get_centroid_resids: Computing centroid residuals from telemetry
2026-08-23 12:16:45,659 write_centroid_resids: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/31684/centroid_resids.pkl with 5 slots
2026-08-23 12:16:45,734 plot_crs_time: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/31684/centroid_resids_time.png
2026-08-23 12:16:46,098 plot_crs_scatter: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/31684/centroid_resids_scatter.png
2026-08-23 12:16:47,414 plot_n_kalman_delta_roll: Writing plot file /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/31684/n_kalman_delta_roll.png
2026-08-23 12:16:47,552 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/31684/index.html
2026-08-23 12:16:47,554 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/31684/info.json
2026-08-23 12:16:47,578 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/31/31684/index.html
2026-08-23 12:16:47,579 main:
2026-08-23 12:16:47,579 main: ********************************************************************************
2026-08-23 12:16:47,579 main: Processing observation 29968
2026-08-23 12:16:47,579 main: ********************************************************************************
2026-08-23 12:16:47,592 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:47,593 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:50,257 __init__: ObsID 29968 has insufficient telemetry, skipping
2026-08-23 12:16:50,257 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/29968/index.html
2026-08-23 12:16:50,262 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/29968/info.json
2026-08-23 12:16:50,263 main:
2026-08-23 12:16:50,263 main: ********************************************************************************
2026-08-23 12:16:50,263 main: Processing observation 41212
2026-08-23 12:16:50,263 main: ********************************************************************************
2026-08-23 12:16:50,264 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:50,265 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:52,266 __init__: ObsID 41212 has insufficient telemetry, skipping
2026-08-23 12:16:52,267 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/41212/index.html
2026-08-23 12:16:52,271 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/41212/info.json
2026-08-23 12:16:52,272 main:
2026-08-23 12:16:52,272 main: ********************************************************************************
2026-08-23 12:16:52,272 main: Processing observation 41211
2026-08-23 12:16:52,272 main: ********************************************************************************
2026-08-23 12:16:52,274 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:52,275 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:54,879 __init__: ObsID 41211 has insufficient telemetry, skipping
2026-08-23 12:16:54,879 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/41211/index.html
2026-08-23 12:16:54,885 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/41211/info.json
2026-08-23 12:16:54,886 main:
2026-08-23 12:16:54,886 main: ********************************************************************************
2026-08-23 12:16:54,886 main: Processing observation 41210
2026-08-23 12:16:54,886 main: ********************************************************************************
2026-08-23 12:16:54,888 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:54,890 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:57,363 __init__: ObsID 41210 has insufficient telemetry, skipping
2026-08-23 12:16:57,363 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/41210/index.html
2026-08-23 12:16:57,370 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/41210/info.json
2026-08-23 12:16:57,371 main:
2026-08-23 12:16:57,371 main: ********************************************************************************
2026-08-23 12:16:57,371 main: Processing observation 41209
2026-08-23 12:16:57,371 main: ********************************************************************************
2026-08-23 12:16:57,372 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:57,373 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:16:59,891 __init__: ObsID 41209 has no maneuver event in telemetry, skipping
2026-08-23 12:16:59,892 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/41209/index.html
2026-08-23 12:16:59,897 info: could not get attribute kalman_start for obsid 41209
2026-08-23 12:16:59,897 info: could not get attribute kalman_stop for obsid 41209
2026-08-23 12:16:59,897 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/41209/info.json
2026-08-23 12:16:59,901 main:
2026-08-23 12:16:59,901 main: ********************************************************************************
2026-08-23 12:16:59,901 main: Processing observation 41208
2026-08-23 12:16:59,901 main: ********************************************************************************
2026-08-23 12:16:59,902 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:16:59,903 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:17:03,006 __init__: ObsID 41208 has no maneuver event in telemetry, skipping
2026-08-23 12:17:03,007 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/41208/index.html
2026-08-23 12:17:03,013 info: could not get attribute kalman_start for obsid 41208
2026-08-23 12:17:03,013 info: could not get attribute kalman_stop for obsid 41208
2026-08-23 12:17:03,013 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/41208/info.json
2026-08-23 12:17:03,015 main:
2026-08-23 12:17:03,015 main: ********************************************************************************
2026-08-23 12:17:03,015 main: Processing observation 32502
2026-08-23 12:17:03,015 main: ********************************************************************************
2026-08-23 12:17:03,015 obs_link_from_info: No /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32502/info.json file found, obs=None
2026-08-23 12:17:03,019 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/last.html
2026-08-23 12:17:03,020 write_redirect_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/last.html
2026-08-23 12:17:05,909 __init__: ObsID 32502 has no maneuver event in telemetry, skipping
2026-08-23 12:17:05,912 write_index_html: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32502/index.html
2026-08-23 12:17:05,921 info: could not get attribute kalman_start for obsid 32502
2026-08-23 12:17:05,922 info: could not get attribute kalman_stop for obsid 32502
2026-08-23 12:17:05,922 write_info_json: Writing /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports/2026/AUG1726A/32502/info.json
2026-08-23 12:17:05,932 main:
2026-08-23 13:17:08,797 run_check: Starting centroid dashboard continuity check
2026-08-23 13:17:08,800 collect_observations: Scanning observations in /proj/sot/ska3/aca/www/ASPECT_ICXC/centroid_reports
2026-08-23 13:17:08,807 collect_observations: Processing year 2020
2026-08-23 13:17:16,466 collect_observations: Processing year 2021
2026-08-23 13:17:28,158 collect_observations: Processing year 2022
2026-08-23 13:17:41,075 collect_observations: Processing year 2023
2026-08-23 13:17:57,076 collect_observations: Processing year 2024
2026-08-23 13:18:12,189 collect_observations: Processing year 2025
2026-08-23 13:18:23,931 collect_observations: Processing year 2026
2026-08-23 13:18:30,836 collect_observations: Collected 14456 observations from 4-digit years
2026-08-23 13:18:30,841 sort_observations_by_date: Sorted observations by date
2026-08-23 13:18:30,841 check_continuity: Starting continuity check from most recent: ObsID 32502 (AUG1726A) at 2026:235:16:40:59.999
2026-08-23 13:18:30,915 check_continuity: Reached chain start at ObsID 47337 (MAR3020A) at 2020:092:05:29:19.712
2026-08-23 13:18:30,915 check_continuity: Chain complete: visited 14456 observations out of 14456 total
2026-08-23 13:18:30,916 run_check: ✓ Observation chain continuity check PASSED
2026-08-23 13:18:30,916 run_check: Summary: 14456 observations from 4-digit years, all properly linked