Prev
Index
Next
kalman_watch3: Thu Aug 6 08:37:53 2026
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kalman_watch3 |
NOT OK
|
0.09 | 1.0 |
Thu Aug 6 08:37:53 2026 |
Errors:
- Line 299: 2026-08-06 08:37:52,519 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
File contents:
2026-08-06 08:31:45,365 log_run_info: ******************************************
2026-08-06 08:31:45,365 log_run_info: Running: /proj/sot/ska3/aca-test/lib/python3.13/site-packages/kalman_watch/kalman_perigee_mon.py
2026-08-06 08:31:45,365 log_run_info: Version: 0.6.2
2026-08-06 08:31:45,365 log_run_info: Time: Thu Aug 6 08:31:45 2026
2026-08-06 08:31:45,365 log_run_info: User: aca
2026-08-06 08:31:45,365 log_run_info: Machine: kady.cfa.harvard.edu
2026-08-06 08:31:45,365 log_run_info: Processing args:
2026-08-06 08:31:45,365 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3'),
2026-08-06 08:31:45,365 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-08-06 08:31:45,365 log_run_info: 'lookback': 14,
2026-08-06 08:31:45,365 log_run_info: 'make_html': True,
2026-08-06 08:31:45,365 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca-test/data/stk/radiation_data.fits'),
2026-08-06 08:31:45,365 log_run_info: 'stop': None}
2026-08-06 08:31:45,365 log_run_info: ******************************************
2026-08-06 08:31:45,369 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-08-06 08:31:45,416 get_evts_perigee: Getting perigee events between 2026:204:12:31:45.366 and 2026:218:12:31:45.366
2026-08-06 08:31:49,309 _get_tlm: Getting telemetry for 2026:216:23:26:42.311
2026-08-06 08:31:50,118 get_evts_perigee: Found 1 new perigee event(s)
2026-08-06 08:31:50,120 obss: Getting observations from kadi commands for 2026/Aug-04
2026-08-06 08:31:50,927 write_data: Writing perigee data to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Aug-04/data.npz
2026-08-06 08:31:50,946 write_info: Writing info to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Aug-04/info.json
2026-08-06 08:31:50,958 main: Writing perigee data /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-08-06 08:31:50,980 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Aug-04/data.npz
2026-08-06 08:31:57,342 get_manvrs_perigee: Getting maneuvers from 2026:216:17:53:22.311 to 2026:217:05:00:02.311
2026-08-06 08:31:57,358 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:216:17:53:22.311 to 2026:217:05:00:02.311
2026-08-06 08:31:57,548 get_mon_dataset: Getting MON data from 2026:216:22:25:28.187 to 2026:216:22:55:55.762
2026-08-06 08:31:57,549 get_aca_images_cached: Getting ACA images from 2026:216:22:25:28.187 to 2026:216:22:55:55.762
2026-08-06 08:32:03,195 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-08-06 08:34:23,821 get_mon_dataset: Getting MON data from 2026:216:23:49:59.888 to 2026:217:00:39:11.888
2026-08-06 08:34:23,821 get_aca_images_cached: Getting ACA images from 2026:216:23:49:59.888 to 2026:217:00:39:11.888
2026-08-06 08:34:32,446 get_kalman_drops_nman: processing NMAN data
2026-08-06 08:34:32,471 _get_tlm: Getting telemetry for 2026:216:23:26:42.311
2026-08-06 08:34:33,257 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Aug-04/index.html
2026-08-06 08:34:33,262 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Aug-02/data.npz
2026-08-06 08:34:33,367 get_manvrs_perigee: Getting maneuvers from 2026:214:02:25:19.068 to 2026:214:13:31:59.068
2026-08-06 08:34:33,399 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:214:02:25:19.068 to 2026:214:13:31:59.068
2026-08-06 08:34:33,922 get_mon_dataset: Getting MON data from 2026:214:07:02:35.997 to 2026:214:07:30:55.447
2026-08-06 08:34:33,922 get_aca_images_cached: Getting ACA images from 2026:214:07:02:35.997 to 2026:214:07:30:55.447
2026-08-06 08:34:34,134 get_mon_dataset: Getting MON data from 2026:214:09:03:19.672 to 2026:214:09:41:23.373
2026-08-06 08:34:34,134 get_aca_images_cached: Getting ACA images from 2026:214:09:03:19.672 to 2026:214:09:41:23.373
2026-08-06 08:34:34,370 get_kalman_drops_nman: processing NMAN data
2026-08-06 08:34:34,392 _get_tlm: Getting telemetry for 2026:214:07:58:39.068
2026-08-06 08:34:34,902 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Aug-02/index.html
2026-08-06 08:34:34,908 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Jul-30/data.npz
2026-08-06 08:34:34,991 get_manvrs_perigee: Getting maneuvers from 2026:211:10:57:41.229 to 2026:211:21:39:01.737
2026-08-06 08:34:35,022 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:211:10:57:41.229 to 2026:211:21:39:01.737
2026-08-06 08:34:35,308 get_manvrs_perigee: Excluding Earth block from 2026:211:16:57:41.907 to 2026:211:17:07:38.457
2026-08-06 08:34:35,312 get_mon_dataset: Getting MON data from 2026:211:14:39:29.656 to 2026:211:15:05:55.332
2026-08-06 08:34:35,312 get_aca_images_cached: Getting ACA images from 2026:211:14:39:29.656 to 2026:211:15:05:55.332
2026-08-06 08:34:35,345 get_mon_dataset: Not enough images for slot 0 found 0)
2026-08-06 08:34:35,346 get_mon_dataset: Not enough images for slot 1 found 0)
2026-08-06 08:34:35,346 get_mon_dataset: Not enough images for slot 2 found 0)
2026-08-06 08:34:35,347 get_mon_dataset: Not enough images for slot 3 found 0)
2026-08-06 08:34:35,347 get_mon_dataset: Not enough images for slot 4 found 0)
2026-08-06 08:34:35,348 get_mon_dataset: Not enough images for slot 5 found 0)
2026-08-06 08:34:35,348 get_mon_dataset: Not enough images for slot 6 found 0)
2026-08-06 08:34:35,349 get_mon_dataset: Not enough images for slot 7 found 0)
2026-08-06 08:34:35,350 get_mon_dataset: Getting MON data from 2026:211:16:49:59.632 to 2026:211:16:57:41.907
2026-08-06 08:34:35,350 get_aca_images_cached: Getting ACA images from 2026:211:16:49:59.632 to 2026:211:16:57:41.907
2026-08-06 08:34:35,382 get_mon_dataset: Not enough images for slot 0 found 0)
2026-08-06 08:34:35,383 get_mon_dataset: Not enough images for slot 1 found 0)
2026-08-06 08:34:35,383 get_mon_dataset: Not enough images for slot 2 found 0)
2026-08-06 08:34:35,384 get_mon_dataset: Not enough images for slot 3 found 0)
2026-08-06 08:34:35,384 get_mon_dataset: Not enough images for slot 4 found 0)
2026-08-06 08:34:35,385 get_mon_dataset: Not enough images for slot 5 found 0)
2026-08-06 08:34:35,386 get_mon_dataset: Not enough images for slot 6 found 0)
2026-08-06 08:34:35,386 get_mon_dataset: Not enough images for slot 7 found 0)
2026-08-06 08:34:35,387 get_mon_dataset: Getting MON data from 2026:211:17:07:38.457 to 2026:211:17:29:35.582
2026-08-06 08:34:35,387 get_aca_images_cached: Getting ACA images from 2026:211:17:07:38.457 to 2026:211:17:29:35.582
2026-08-06 08:34:35,422 get_mon_dataset: Not enough images for slot 0 found 0)
2026-08-06 08:34:35,422 get_mon_dataset: Not enough images for slot 1 found 0)
2026-08-06 08:34:35,423 get_mon_dataset: Not enough images for slot 2 found 0)
2026-08-06 08:34:35,423 get_mon_dataset: Not enough images for slot 3 found 0)
2026-08-06 08:34:35,424 get_mon_dataset: Not enough images for slot 4 found 0)
2026-08-06 08:34:35,424 get_mon_dataset: Not enough images for slot 5 found 0)
2026-08-06 08:34:35,425 get_mon_dataset: Not enough images for slot 6 found 0)
2026-08-06 08:34:35,425 get_mon_dataset: Not enough images for slot 7 found 0)
2026-08-06 08:34:35,426 get_kalman_drops_nman: processing NMAN data
2026-08-06 08:34:35,426 _get_tlm: Getting telemetry for 2026:211:16:31:01.229
2026-08-06 08:34:36,028 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Jul-30/index.html
2026-08-06 08:34:36,034 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Jul-28/data.npz
2026-08-06 08:34:36,148 get_manvrs_perigee: Getting maneuvers from 2026:208:19:29:52.421 to 2026:209:06:36:32.421
2026-08-06 08:34:36,181 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:208:19:29:52.421 to 2026:209:06:36:32.421
2026-08-06 08:34:36,506 get_manvrs_perigee: Excluding Earth block from 2026:209:01:40:54.617 to 2026:209:01:53:52.592
2026-08-06 08:34:36,509 get_mon_dataset: Getting MON data from 2026:208:23:27:06.816 to 2026:208:23:55:55.991
2026-08-06 08:34:36,509 get_aca_images_cached: Getting ACA images from 2026:208:23:27:06.816 to 2026:208:23:55:55.991
2026-08-06 08:34:36,715 get_mon_dataset: Getting MON data from 2026:209:01:40:00.292 to 2026:209:01:40:54.617
2026-08-06 08:34:36,715 get_aca_images_cached: Getting ACA images from 2026:209:01:40:00.292 to 2026:209:01:40:54.617
2026-08-06 08:34:36,885 get_mon_dataset: Getting MON data from 2026:209:01:53:52.592 to 2026:209:02:19:45.467
2026-08-06 08:34:36,885 get_aca_images_cached: Getting ACA images from 2026:209:01:53:52.592 to 2026:209:02:19:45.467
2026-08-06 08:34:37,301 get_kalman_drops_nman: processing NMAN data
2026-08-06 08:34:37,314 get_kalman_drops_nman: Skipping NMAN from 2026:209:01:40:00.292 to 2026:209:01:40:54.617 due to insufficient monitor window data within 100 minutes of perigee
2026-08-06 08:34:37,326 _get_tlm: Getting telemetry for 2026:209:01:03:12.421
2026-08-06 08:34:38,028 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Jul-28/index.html
2026-08-06 08:34:38,034 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Jul-25/data.npz
2026-08-06 08:34:38,157 get_manvrs_perigee: Getting maneuvers from 2026:206:04:01:45.546 to 2026:206:15:08:25.546
2026-08-06 08:34:38,193 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:206:04:01:45.546 to 2026:206:15:08:25.546
2026-08-06 08:34:38,410 get_mon_dataset: Getting MON data from 2026:206:07:44:09.226 to 2026:206:08:15:55.726
2026-08-06 08:34:38,410 get_aca_images_cached: Getting ACA images from 2026:206:07:44:09.226 to 2026:206:08:15:55.726
2026-08-06 08:34:38,643 get_mon_dataset: Getting MON data from 2026:206:08:52:34.351 to 2026:206:09:25:56.176
2026-08-06 08:34:38,643 get_aca_images_cached: Getting ACA images from 2026:206:08:52:34.351 to 2026:206:09:25:56.176
2026-08-06 08:34:38,860 get_mon_dataset: Getting MON data from 2026:206:10:39:37.002 to 2026:206:11:25:55.777
2026-08-06 08:34:38,860 get_aca_images_cached: Getting ACA images from 2026:206:10:39:37.002 to 2026:206:11:25:55.777
2026-08-06 08:34:39,086 get_kalman_drops_nman: processing NMAN data
2026-08-06 08:34:39,117 _get_tlm: Getting telemetry for 2026:206:09:35:05.546
2026-08-06 08:34:39,852 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Jul-25/index.html
2026-08-06 08:34:39,879 make_index_list_pages: Writing recent index list page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/index.html
2026-08-06 08:34:39,898 make_index_list_pages: Writing index list page for 2025 to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2025/index.html
2026-08-06 08:34:39,906 make_index_list_pages: Writing index list page for 2026 to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/index.html
2026-08-06 08:34:44,874 get_manvrs_perigee: Getting maneuvers from 2026:173:12:34:44.873 to 2026:217:12:34:44.874
2026-08-06 08:34:48,746 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:173:12:34:44.873 to 2026:217:12:34:44.874
2026-08-06 08:34:57,281 get_manvrs_perigee: Excluding Earth block from 2026:195:21:46:36.541 to 2026:195:21:47:53.416
2026-08-06 08:34:57,281 get_manvrs_perigee: Excluding Earth block from 2026:196:00:46:42.092 to 2026:196:00:53:30.042
2026-08-06 08:34:57,281 get_manvrs_perigee: Excluding Earth block from 2026:203:20:54:00.137 to 2026:203:21:02:00.862
2026-08-06 08:34:57,282 get_manvrs_perigee: Excluding Earth block from 2026:203:23:13:50.787 to 2026:203:23:21:01.287
2026-08-06 08:34:57,282 get_manvrs_perigee: Excluding Earth block from 2026:204:06:21:36.789 to 2026:204:06:28:58.564
2026-08-06 08:34:57,282 get_manvrs_perigee: Excluding Earth block from 2026:209:01:40:54.617 to 2026:209:01:53:52.592
2026-08-06 08:34:57,283 get_manvrs_perigee: Excluding Earth block from 2026:211:16:57:41.907 to 2026:211:17:07:38.457
2026-08-06 08:34:57,283 get_manvrs_perigee: Excluding Earth block from 2026:213:04:47:15.616 to 2026:213:04:53:05.141
2026-08-06 08:34:57,405 get_mon_dataset: Getting MON data from 2026:174:14:16:33.143 to 2026:174:14:55:55.768
2026-08-06 08:34:57,405 get_aca_images_cached: Getting ACA images from 2026:174:14:16:33.143 to 2026:174:14:55:55.768
2026-08-06 08:34:57,656 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-08-06 08:37:21,125 get_mon_dataset: Getting MON data from 2026:174:17:14:10.069 to 2026:174:17:21:21.594
2026-08-06 08:37:21,125 get_aca_images_cached: Getting ACA images from 2026:174:17:14:10.069 to 2026:174:17:21:21.594
2026-08-06 08:37:21,157 get_mon_dataset: Not enough images for slot 0 found 0)
2026-08-06 08:37:21,158 get_mon_dataset: Not enough images for slot 1 found 0)
2026-08-06 08:37:21,159 get_mon_dataset: Not enough images for slot 2 found 0)
2026-08-06 08:37:21,160 get_mon_dataset: Not enough images for slot 3 found 0)
2026-08-06 08:37:21,161 get_mon_dataset: Not enough images for slot 4 found 0)
2026-08-06 08:37:21,161 get_mon_dataset: Not enough images for slot 5 found 0)
2026-08-06 08:37:21,162 get_mon_dataset: Not enough images for slot 6 found 0)
2026-08-06 08:37:21,163 get_mon_dataset: Not enough images for slot 7 found 0)
2026-08-06 08:37:21,164 get_mon_dataset: Getting MON data from 2026:177:07:06:41.034 to 2026:177:07:25:56.209
2026-08-06 08:37:21,164 get_aca_images_cached: Getting ACA images from 2026:177:07:06:41.034 to 2026:177:07:25:56.209
2026-08-06 08:37:21,384 get_mon_dataset: Getting MON data from 2026:182:12:11:40.989 to 2026:182:12:45:56.114
2026-08-06 08:37:21,384 get_aca_images_cached: Getting ACA images from 2026:182:12:11:40.989 to 2026:182:12:45:56.114
2026-08-06 08:37:21,593 get_mon_dataset: Getting MON data from 2026:182:15:51:40.940 to 2026:182:16:25:56.065
2026-08-06 08:37:21,593 get_aca_images_cached: Getting ACA images from 2026:182:15:51:40.940 to 2026:182:16:25:56.065
2026-08-06 08:37:22,014 get_mon_dataset: Getting MON data from 2026:185:04:24:00.554 to 2026:185:04:55:56.279
2026-08-06 08:37:22,015 get_aca_images_cached: Getting ACA images from 2026:185:04:24:00.554 to 2026:185:04:55:56.279
2026-08-06 08:37:22,231 get_mon_dataset: Getting MON data from 2026:187:19:16:48.744 to 2026:187:19:55:55.994
2026-08-06 08:37:22,231 get_aca_images_cached: Getting ACA images from 2026:187:19:16:48.744 to 2026:187:19:55:55.994
2026-08-06 08:37:22,439 get_mon_dataset: Getting MON data from 2026:187:20:50:00.120 to 2026:187:21:29:09.420
2026-08-06 08:37:22,439 get_aca_images_cached: Getting ACA images from 2026:187:20:50:00.120 to 2026:187:21:29:09.420
2026-08-06 08:37:22,644 get_mon_dataset: Getting MON data from 2026:187:22:23:13.545 to 2026:187:22:55:01.070
2026-08-06 08:37:22,644 get_aca_images_cached: Getting ACA images from 2026:187:22:23:13.545 to 2026:187:22:55:01.070
2026-08-06 08:37:22,836 get_mon_dataset: Getting MON data from 2026:190:10:52:31.735 to 2026:190:11:25:55.610
2026-08-06 08:37:22,836 get_aca_images_cached: Getting ACA images from 2026:190:10:52:31.735 to 2026:190:11:25:55.610
2026-08-06 08:37:23,026 get_mon_dataset: Getting MON data from 2026:190:12:20:00.760 to 2026:190:13:10:19.385
2026-08-06 08:37:23,026 get_aca_images_cached: Getting ACA images from 2026:190:12:20:00.760 to 2026:190:13:10:19.385
2026-08-06 08:37:23,268 get_mon_dataset: Getting MON data from 2026:190:14:04:23.510 to 2026:190:14:54:42.136
2026-08-06 08:37:23,268 get_aca_images_cached: Getting ACA images from 2026:190:14:04:23.510 to 2026:190:14:54:42.136
2026-08-06 08:37:23,487 get_mon_dataset: Getting MON data from 2026:193:02:40:45.025 to 2026:193:03:15:55.500
2026-08-06 08:37:23,487 get_aca_images_cached: Getting ACA images from 2026:193:02:40:45.025 to 2026:193:03:15:55.500
2026-08-06 08:37:23,691 get_mon_dataset: Getting MON data from 2026:193:04:09:59.625 to 2026:193:04:49:00.725
2026-08-06 08:37:23,691 get_aca_images_cached: Getting ACA images from 2026:193:04:09:59.625 to 2026:193:04:49:00.725
2026-08-06 08:37:23,894 get_mon_dataset: Getting MON data from 2026:195:21:22:20.016 to 2026:195:21:46:36.541
2026-08-06 08:37:23,894 get_aca_images_cached: Getting ACA images from 2026:195:21:22:20.016 to 2026:195:21:46:36.541
2026-08-06 08:37:24,089 get_mon_dataset: Getting MON data from 2026:198:12:19:09.081 to 2026:198:12:26:20.606
2026-08-06 08:37:24,089 get_aca_images_cached: Getting ACA images from 2026:198:12:19:09.081 to 2026:198:12:26:20.606
2026-08-06 08:37:24,125 get_mon_dataset: Not enough images for slot 0 found 0)
2026-08-06 08:37:24,126 get_mon_dataset: Not enough images for slot 1 found 0)
2026-08-06 08:37:24,127 get_mon_dataset: Not enough images for slot 2 found 0)
2026-08-06 08:37:24,127 get_mon_dataset: Not enough images for slot 3 found 0)
2026-08-06 08:37:24,128 get_mon_dataset: Not enough images for slot 4 found 0)
2026-08-06 08:37:24,129 get_mon_dataset: Not enough images for slot 5 found 0)
2026-08-06 08:37:24,130 get_mon_dataset: Not enough images for slot 6 found 0)
2026-08-06 08:37:24,131 get_mon_dataset: Not enough images for slot 7 found 0)
2026-08-06 08:37:24,132 get_mon_dataset: Getting MON data from 2026:201:01:55:12.971 to 2026:201:02:25:55.921
2026-08-06 08:37:24,132 get_aca_images_cached: Getting ACA images from 2026:201:01:55:12.971 to 2026:201:02:25:55.921
2026-08-06 08:37:24,382 get_mon_dataset: Getting MON data from 2026:201:03:46:38.021 to 2026:201:04:25:55.521
2026-08-06 08:37:24,382 get_aca_images_cached: Getting ACA images from 2026:201:03:46:38.021 to 2026:201:04:25:55.521
2026-08-06 08:37:24,603 get_mon_dataset: Getting MON data from 2026:203:16:09:47.211 to 2026:203:16:40:55.786
2026-08-06 08:37:24,603 get_aca_images_cached: Getting ACA images from 2026:203:16:09:47.211 to 2026:203:16:40:55.786
2026-08-06 08:37:24,823 get_mon_dataset: Getting MON data from 2026:203:17:33:04.086 to 2026:203:18:05:56.186
2026-08-06 08:37:24,823 get_aca_images_cached: Getting ACA images from 2026:203:17:33:04.086 to 2026:203:18:05:56.186
2026-08-06 08:37:25,264 get_mon_dataset: Getting MON data from 2026:203:18:44:10.136 to 2026:203:18:51:21.661
2026-08-06 08:37:25,264 get_aca_images_cached: Getting ACA images from 2026:203:18:44:10.136 to 2026:203:18:51:21.661
2026-08-06 08:37:25,307 get_mon_dataset: Not enough images for slot 0 found 0)
2026-08-06 08:37:25,308 get_mon_dataset: Not enough images for slot 1 found 0)
2026-08-06 08:37:25,309 get_mon_dataset: Not enough images for slot 2 found 0)
2026-08-06 08:37:25,310 get_mon_dataset: Not enough images for slot 3 found 0)
2026-08-06 08:37:25,311 get_mon_dataset: Not enough images for slot 4 found 0)
2026-08-06 08:37:25,312 get_mon_dataset: Not enough images for slot 5 found 0)
2026-08-06 08:37:25,312 get_mon_dataset: Not enough images for slot 6 found 0)
2026-08-06 08:37:25,313 get_mon_dataset: Not enough images for slot 7 found 0)
2026-08-06 08:37:25,314 get_mon_dataset: Getting MON data from 2026:203:19:20:22.111 to 2026:203:19:55:56.162
2026-08-06 08:37:25,314 get_aca_images_cached: Getting ACA images from 2026:203:19:20:22.111 to 2026:203:19:55:56.162
2026-08-06 08:37:25,536 get_mon_dataset: Getting MON data from 2026:206:07:44:09.226 to 2026:206:08:15:55.726
2026-08-06 08:37:25,536 get_aca_images_cached: Getting ACA images from 2026:206:07:44:09.226 to 2026:206:08:15:55.726
2026-08-06 08:37:25,732 get_mon_dataset: Getting MON data from 2026:206:08:52:34.351 to 2026:206:09:25:56.176
2026-08-06 08:37:25,732 get_aca_images_cached: Getting ACA images from 2026:206:08:52:34.351 to 2026:206:09:25:56.176
2026-08-06 08:37:25,933 get_mon_dataset: Getting MON data from 2026:206:10:39:37.002 to 2026:206:11:25:55.777
2026-08-06 08:37:25,933 get_aca_images_cached: Getting ACA images from 2026:206:10:39:37.002 to 2026:206:11:25:55.777
2026-08-06 08:37:26,150 get_mon_dataset: Getting MON data from 2026:208:23:27:06.816 to 2026:208:23:55:55.991
2026-08-06 08:37:26,150 get_aca_images_cached: Getting ACA images from 2026:208:23:27:06.816 to 2026:208:23:55:55.991
2026-08-06 08:37:26,343 get_mon_dataset: Getting MON data from 2026:209:01:40:00.292 to 2026:209:01:40:54.617
2026-08-06 08:37:26,343 get_aca_images_cached: Getting ACA images from 2026:209:01:40:00.292 to 2026:209:01:40:54.617
2026-08-06 08:37:26,624 get_mon_dataset: Getting MON data from 2026:209:01:53:52.592 to 2026:209:02:19:45.467
2026-08-06 08:37:26,624 get_aca_images_cached: Getting ACA images from 2026:209:01:53:52.592 to 2026:209:02:19:45.467
2026-08-06 08:37:26,812 get_mon_dataset: Getting MON data from 2026:211:14:39:29.656 to 2026:211:15:05:55.332
2026-08-06 08:37:26,812 get_aca_images_cached: Getting ACA images from 2026:211:14:39:29.656 to 2026:211:15:05:55.332
2026-08-06 08:37:26,830 get_mon_dataset: Not enough images for slot 0 found 0)
2026-08-06 08:37:26,830 get_mon_dataset: Not enough images for slot 1 found 0)
2026-08-06 08:37:26,831 get_mon_dataset: Not enough images for slot 2 found 0)
2026-08-06 08:37:26,832 get_mon_dataset: Not enough images for slot 3 found 0)
2026-08-06 08:37:26,832 get_mon_dataset: Not enough images for slot 4 found 0)
2026-08-06 08:37:26,833 get_mon_dataset: Not enough images for slot 5 found 0)
2026-08-06 08:37:26,833 get_mon_dataset: Not enough images for slot 6 found 0)
2026-08-06 08:37:26,834 get_mon_dataset: Not enough images for slot 7 found 0)
2026-08-06 08:37:26,834 get_mon_dataset: Getting MON data from 2026:211:16:49:59.632 to 2026:211:16:57:41.907
2026-08-06 08:37:26,834 get_aca_images_cached: Getting ACA images from 2026:211:16:49:59.632 to 2026:211:16:57:41.907
2026-08-06 08:37:26,851 get_mon_dataset: Not enough images for slot 0 found 0)
2026-08-06 08:37:26,852 get_mon_dataset: Not enough images for slot 1 found 0)
2026-08-06 08:37:26,853 get_mon_dataset: Not enough images for slot 2 found 0)
2026-08-06 08:37:26,853 get_mon_dataset: Not enough images for slot 3 found 0)
2026-08-06 08:37:26,854 get_mon_dataset: Not enough images for slot 4 found 0)
2026-08-06 08:37:26,854 get_mon_dataset: Not enough images for slot 5 found 0)
2026-08-06 08:37:26,855 get_mon_dataset: Not enough images for slot 6 found 0)
2026-08-06 08:37:26,855 get_mon_dataset: Not enough images for slot 7 found 0)
2026-08-06 08:37:26,856 get_mon_dataset: Getting MON data from 2026:211:17:07:38.457 to 2026:211:17:29:35.582
2026-08-06 08:37:26,856 get_aca_images_cached: Getting ACA images from 2026:211:17:07:38.457 to 2026:211:17:29:35.582
2026-08-06 08:37:26,873 get_mon_dataset: Not enough images for slot 0 found 0)
2026-08-06 08:37:26,873 get_mon_dataset: Not enough images for slot 1 found 0)
2026-08-06 08:37:26,874 get_mon_dataset: Not enough images for slot 2 found 0)
2026-08-06 08:37:26,874 get_mon_dataset: Not enough images for slot 3 found 0)
2026-08-06 08:37:26,875 get_mon_dataset: Not enough images for slot 4 found 0)
2026-08-06 08:37:26,876 get_mon_dataset: Not enough images for slot 5 found 0)
2026-08-06 08:37:26,876 get_mon_dataset: Not enough images for slot 6 found 0)
2026-08-06 08:37:26,877 get_mon_dataset: Not enough images for slot 7 found 0)
2026-08-06 08:37:26,877 get_mon_dataset: Getting MON data from 2026:214:07:02:35.997 to 2026:214:07:30:55.447
2026-08-06 08:37:26,877 get_aca_images_cached: Getting ACA images from 2026:214:07:02:35.997 to 2026:214:07:30:55.447
2026-08-06 08:37:27,068 get_mon_dataset: Getting MON data from 2026:214:09:03:19.672 to 2026:214:09:41:23.373
2026-08-06 08:37:27,068 get_aca_images_cached: Getting ACA images from 2026:214:09:03:19.672 to 2026:214:09:41:23.373
2026-08-06 08:37:27,274 get_mon_dataset: Getting MON data from 2026:216:22:25:28.187 to 2026:216:22:55:55.762
2026-08-06 08:37:27,274 get_aca_images_cached: Getting ACA images from 2026:216:22:25:28.187 to 2026:216:22:55:55.762
2026-08-06 08:37:27,492 get_mon_dataset: Getting MON data from 2026:216:23:49:59.888 to 2026:217:00:39:11.888
2026-08-06 08:37:27,493 get_aca_images_cached: Getting ACA images from 2026:216:23:49:59.888 to 2026:217:00:39:11.888
2026-08-06 08:37:27,745 get_kalman_drops_nman: processing NMAN data
2026-08-06 08:37:27,768 get_kalman_drops_nman: Skipping NMAN from 2026:182:12:11:40.989 to 2026:182:12:45:56.114 due to insufficient monitor window data within 100 minutes of perigee
2026-08-06 08:37:27,862 get_kalman_drops_nman: Skipping NMAN from 2026:195:21:22:20.016 to 2026:195:21:46:36.541 due to insufficient monitor window data within 100 minutes of perigee
2026-08-06 08:37:27,945 get_kalman_drops_nman: Skipping NMAN from 2026:209:01:40:00.292 to 2026:209:01:40:54.617 due to insufficient monitor window data within 100 minutes of perigee
2026-08-06 07:37:31,051 _get_tlm: Getting telemetry for 2026:174:15:56:43.956
2026-08-06 07:37:31,760 obss: Getting observations from kadi commands for 2026/Jun-23
2026-08-06 07:37:31,773 _get_tlm: Getting telemetry for 2026:177:07:24:39.671
2026-08-06 07:37:32,155 obss: Getting observations from kadi commands for 2026/Jun-26
2026-08-06 07:37:32,170 _get_tlm: Getting telemetry for 2026:179:22:52:53.972
2026-08-06 07:37:32,485 obss: Getting observations from kadi commands for 2026/Jun-28
2026-08-06 07:37:32,502 _get_tlm: Getting telemetry for 2026:182:14:21:06.581
2026-08-06 07:37:32,884 obss: Getting observations from kadi commands for 2026/Jul-01
2026-08-06 07:37:32,901 _get_tlm: Getting telemetry for 2026:185:05:48:58.192
2026-08-06 07:37:33,297 obss: Getting observations from kadi commands for 2026/Jul-04
2026-08-06 07:37:33,313 _get_tlm: Getting telemetry for 2026:187:21:16:49.234
2026-08-06 07:37:33,679 obss: Getting observations from kadi commands for 2026/Jul-06
2026-08-06 07:37:33,689 _get_tlm: Getting telemetry for 2026:190:12:45:16.694
2026-08-06 07:37:33,973 obss: Getting observations from kadi commands for 2026/Jul-09
2026-08-06 07:37:33,983 _get_tlm: Getting telemetry for 2026:193:04:14:27.793
2026-08-06 07:37:34,394 obss: Getting observations from kadi commands for 2026/Jul-12
2026-08-06 07:37:34,405 _get_tlm: Getting telemetry for 2026:195:19:43:35.299
2026-08-06 07:37:34,738 obss: Getting observations from kadi commands for 2026/Jul-14
2026-08-06 07:37:34,753 _get_tlm: Getting telemetry for 2026:198:11:11:46.111
2026-08-06 07:37:35,105 obss: Getting observations from kadi commands for 2026/Jul-17
2026-08-06 07:37:35,121 _get_tlm: Getting telemetry for 2026:201:02:39:24.314
2026-08-06 07:37:35,390 obss: Getting observations from kadi commands for 2026/Jul-20
2026-08-06 07:37:35,401 _get_tlm: Getting telemetry for 2026:203:18:07:06.114
2026-08-06 07:37:35,711 obss: Getting observations from kadi commands for 2026/Jul-22
2026-08-06 07:37:35,721 _get_tlm: Getting telemetry for 2026:206:09:35:05.546
2026-08-06 07:37:35,961 obss: Getting observations from kadi commands for 2026/Jul-25
2026-08-06 07:37:35,971 _get_tlm: Getting telemetry for 2026:209:01:03:12.421
2026-08-06 07:37:36,208 obss: Getting observations from kadi commands for 2026/Jul-28
2026-08-06 07:37:36,220 _get_tlm: Getting telemetry for 2026:211:16:31:01.229
2026-08-06 07:37:36,448 obss: Getting observations from kadi commands for 2026/Jul-30
2026-08-06 07:37:36,461 _get_tlm: Getting telemetry for 2026:214:07:58:39.068
2026-08-06 07:37:36,686 obss: Getting observations from kadi commands for 2026/Aug-02
2026-08-06 07:37:36,698 _get_tlm: Getting telemetry for 2026:216:23:26:42.311
2026-08-06 07:37:36,929 obss: Getting observations from kadi commands for 2026/Aug-04
2026-08-06 07:37:48,110 get_color_marker_for_perigee_plotly: Perigee 2026:174:15:56:43.956 color='rgb(229, 134, 6)' marker='circle'
2026-08-06 07:37:48,110 get_color_marker_for_perigee_plotly: Perigee 2026:177:07:24:39.671 color='rgb(93, 105, 177)' marker='square'
2026-08-06 07:37:48,110 get_color_marker_for_perigee_plotly: Perigee 2026:179:22:52:53.972 color='rgb(82, 188, 163)' marker='diamond'
2026-08-06 07:37:48,111 get_color_marker_for_perigee_plotly: Perigee 2026:182:14:21:06.581 color='rgb(153, 201, 69)' marker='triangle-up'
2026-08-06 07:37:48,111 get_color_marker_for_perigee_plotly: Perigee 2026:185:05:48:58.192 color='rgb(204, 97, 176)' marker='triangle-down'
2026-08-06 07:37:48,111 get_color_marker_for_perigee_plotly: Perigee 2026:187:21:16:49.234 color='rgb(36, 121, 108)' marker='triangle-left'
2026-08-06 07:37:48,111 get_color_marker_for_perigee_plotly: Perigee 2026:190:12:45:16.694 color='rgb(218, 165, 27)' marker='triangle-right'
2026-08-06 07:37:48,111 get_color_marker_for_perigee_plotly: Perigee 2026:193:04:14:27.793 color='rgb(47, 138, 196)' marker='circle'
2026-08-06 07:37:48,112 get_color_marker_for_perigee_plotly: Perigee 2026:195:19:43:35.299 color='rgb(118, 78, 159)' marker='square'
2026-08-06 07:37:48,112 get_color_marker_for_perigee_plotly: Perigee 2026:198:11:11:46.111 color='rgb(237, 100, 90)' marker='diamond'
2026-08-06 07:37:48,112 get_color_marker_for_perigee_plotly: Perigee 2026:201:02:39:24.314 color='rgb(165, 170, 153)' marker='triangle-up'
2026-08-06 07:37:48,112 get_color_marker_for_perigee_plotly: Perigee 2026:203:18:07:06.114 color='rgb(229, 134, 6)' marker='triangle-down'
2026-08-06 07:37:48,112 get_color_marker_for_perigee_plotly: Perigee 2026:206:09:35:05.546 color='rgb(93, 105, 177)' marker='triangle-left'
2026-08-06 07:37:48,113 get_color_marker_for_perigee_plotly: Perigee 2026:209:01:03:12.421 color='rgb(82, 188, 163)' marker='triangle-right'
2026-08-06 07:37:48,113 get_color_marker_for_perigee_plotly: Perigee 2026:211:16:31:01.229 color='rgb(153, 201, 69)' marker='circle'
2026-08-06 07:37:48,113 get_color_marker_for_perigee_plotly: Perigee 2026:214:07:58:39.068 color='rgb(204, 97, 176)' marker='square'
2026-08-06 07:37:48,113 get_color_marker_for_perigee_plotly: Perigee 2026:216:23:26:42.311 color='rgb(36, 121, 108)' marker='diamond'
2026-08-06 07:37:48,113 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-08-06 07:37:48,546 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-08-06 07:37:48,613 clean_aca_images_cache: Deleting /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/aca_imgs_cache/aca_imgs_2026:124:11:19:16.580_2026:124:11:55:56.230.fits.gz
2026-08-06 07:37:48,613 clean_aca_images_cache: Deleting /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/aca_imgs_cache/aca_imgs_2026:127:00:30:24.995_2026:127:00:55:55.320.fits.gz
2026-08-06 08:37:52,231 main: Overriding starting time with the time of latest low-kalman event
2026-08-06 08:37:52,231 get_lowkals_new: Getting telemetry between 2026:217:03:41:49.645 and 2026:218:12:37:52.222
2026-08-06 08:37:52,519 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
2026-08-06 08:37:52,522 main: Updating events file /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-08-06 08:37:52,865 make_web_page: Writing HTML to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/index.html
2026:217:03:41:49.645 2026:218:12:37:52.222