Prev
Index
Next
kalman_watch3: Sat Nov 14 08:37:17 2026
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
| kalman_watch3 |
OK
|
0.09 | 1.0 |
Sat Nov 14 08:37:17 2026 |
No errors
File contents:
2026-11-14 08:31:15,849 log_run_info: ******************************************
2026-11-14 08:31:15,849 log_run_info: Running: /proj/sot/ska3/aca-test/lib/python3.13/site-packages/kalman_watch/kalman_perigee_mon.py
2026-11-14 08:31:15,849 log_run_info: Version: 0.6.2
2026-11-14 08:31:15,849 log_run_info: Time: Sat Nov 14 08:31:15 2026
2026-11-14 08:31:15,849 log_run_info: User: aca
2026-11-14 08:31:15,849 log_run_info: Machine: kady.cfa.harvard.edu
2026-11-14 08:31:15,849 log_run_info: Processing args:
2026-11-14 08:31:15,849 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3'),
2026-11-14 08:31:15,849 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-11-14 08:31:15,849 log_run_info: 'lookback': 14,
2026-11-14 08:31:15,849 log_run_info: 'make_html': True,
2026-11-14 08:31:15,849 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca-test/data/stk/radiation_data.fits'),
2026-11-14 08:31:15,849 log_run_info: 'stop': None}
2026-11-14 08:31:15,849 log_run_info: ******************************************
2026-11-14 08:31:15,852 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-11-14 08:31:15,872 get_evts_perigee: Getting perigee events between 2026:304:13:31:15.849 and 2026:318:13:31:15.849
2026-11-14 08:31:20,154 _get_tlm: Getting telemetry for 2026:317:11:08:28.148
2026-11-14 08:31:20,603 get_evts_perigee: Found 1 new perigee event(s)
2026-11-14 08:31:20,604 obss: Getting observations from kadi commands for 2026/Nov-13
2026-11-14 08:31:21,321 write_data: Writing perigee data to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-13/data.npz
2026-11-14 08:31:21,328 write_info: Writing info to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-13/info.json
2026-11-14 08:31:21,338 main: Writing perigee data /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-11-14 08:31:21,361 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-13/data.npz
2026-11-14 08:31:27,386 get_manvrs_perigee: Getting maneuvers from 2026:317:05:35:08.148 to 2026:317:16:02:35.689
2026-11-14 08:31:27,402 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:317:05:35:08.148 to 2026:317:16:02:35.689
2026-11-14 08:31:27,553 get_manvrs_perigee: Excluding Earth block from 2026:317:11:04:57.918 to 2026:317:11:17:00.543
2026-11-14 08:31:27,557 get_mon_dataset: Getting MON data from 2026:317:09:16:28.142 to 2026:317:09:55:55.892
2026-11-14 08:31:27,557 get_aca_images_cached: Getting ACA images from 2026:317:09:16:28.142 to 2026:317:09:55:55.892
2026-11-14 08:31:35,040 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-11-14 08:33:57,532 get_mon_dataset: Getting MON data from 2026:317:11:00:30.393 to 2026:317:11:04:57.918
2026-11-14 08:33:57,532 get_aca_images_cached: Getting ACA images from 2026:317:11:00:30.393 to 2026:317:11:04:57.918
2026-11-14 08:33:58,556 get_mon_dataset: Getting MON data from 2026:317:11:17:00.543 to 2026:317:11:40:55.543
2026-11-14 08:33:58,556 get_aca_images_cached: Getting ACA images from 2026:317:11:17:00.543 to 2026:317:11:40:55.543
2026-11-14 08:34:03,360 get_kalman_drops_nman: processing NMAN data
2026-11-14 08:34:03,374 get_kalman_drops_nman: Skipping NMAN from 2026:317:11:00:30.393 to 2026:317:11:04:57.918 due to insufficient monitor window data within 100 minutes of perigee
2026-11-14 08:34:03,386 _get_tlm: Getting telemetry for 2026:317:11:08:28.148
2026-11-14 08:34:03,775 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-13/index.html
2026-11-14 08:34:03,780 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-10/data.npz
2026-11-14 08:34:03,861 get_manvrs_perigee: Getting maneuvers from 2026:314:14:07:02.379 to 2026:315:01:05:59.216
2026-11-14 08:34:03,896 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:314:14:07:02.379 to 2026:315:01:05:59.216
2026-11-14 08:34:04,065 get_manvrs_perigee: Excluding Earth block from 2026:314:19:39:17.627 to 2026:314:19:51:28.452
2026-11-14 08:34:04,068 get_mon_dataset: Getting MON data from 2026:314:18:06:20.602 to 2026:314:18:45:55.527
2026-11-14 08:34:04,068 get_aca_images_cached: Getting ACA images from 2026:314:18:06:20.602 to 2026:314:18:45:55.527
2026-11-14 08:34:04,290 get_mon_dataset: Getting MON data from 2026:314:19:35:38.277 to 2026:314:19:39:17.627
2026-11-14 08:34:04,290 get_aca_images_cached: Getting ACA images from 2026:314:19:35:38.277 to 2026:314:19:39:17.627
2026-11-14 08:34:04,456 get_mon_dataset: Getting MON data from 2026:314:19:51:28.452 to 2026:314:20:15:56.253
2026-11-14 08:34:04,456 get_aca_images_cached: Getting ACA images from 2026:314:19:51:28.452 to 2026:314:20:15:56.253
2026-11-14 08:34:04,652 get_kalman_drops_nman: processing NMAN data
2026-11-14 08:34:04,667 get_kalman_drops_nman: Skipping NMAN from 2026:314:19:35:38.277 to 2026:314:19:39:17.627 due to insufficient monitor window data within 100 minutes of perigee
2026-11-14 08:34:04,678 _get_tlm: Getting telemetry for 2026:314:19:40:22.379
2026-11-14 08:34:05,098 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-10/index.html
2026-11-14 08:34:05,104 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-08/data.npz
2026-11-14 08:34:05,164 get_manvrs_perigee: Getting maneuvers from 2026:311:22:39:12.030 to 2026:312:08:06:58.636
2026-11-14 08:34:05,199 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:311:22:39:12.030 to 2026:312:08:06:58.636
2026-11-14 08:34:05,366 get_manvrs_perigee: Excluding Earth block from 2026:311:22:44:51.211 to 2026:311:22:51:42.236
2026-11-14 08:34:05,366 get_manvrs_perigee: Excluding Earth block from 2026:312:00:14:35.536 to 2026:312:00:18:05.661
2026-11-14 08:34:05,369 get_mon_dataset: Getting MON data from 2026:312:05:26:58.687 to 2026:312:06:05:55.688
2026-11-14 08:34:05,370 get_aca_images_cached: Getting ACA images from 2026:312:05:26:58.687 to 2026:312:06:05:55.688
2026-11-14 08:34:05,581 get_kalman_drops_nman: processing NMAN data
2026-11-14 08:34:05,592 _get_tlm: Getting telemetry for 2026:312:04:12:32.030
2026-11-14 08:34:06,502 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-08/index.html
2026-11-14 08:34:06,515 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-05/data.npz
2026-11-14 08:34:06,585 get_manvrs_perigee: Getting maneuvers from 2026:309:07:11:40.098 to 2026:309:17:45:59.627
2026-11-14 08:34:06,728 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:309:07:11:40.098 to 2026:309:17:45:59.627
2026-11-14 08:34:07,968 get_mon_dataset: Getting MON data from 2026:309:11:25:46.797 to 2026:309:11:55:55.922
2026-11-14 08:34:07,968 get_aca_images_cached: Getting ACA images from 2026:309:11:25:46.797 to 2026:309:11:55:55.922
2026-11-14 08:34:08,188 get_kalman_drops_nman: processing NMAN data
2026-11-14 08:34:08,199 _get_tlm: Getting telemetry for 2026:309:12:45:00.098
2026-11-14 08:34:08,909 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-05/index.html
2026-11-14 08:34:08,914 from_npz: Loading perigee event from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-02/data.npz
2026-11-14 08:34:08,978 get_manvrs_perigee: Getting maneuvers from 2026:306:15:43:59.377 to 2026:307:02:28:58.410
2026-11-14 08:34:09,010 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:306:15:43:59.377 to 2026:307:02:28:58.410
2026-11-14 08:34:09,176 get_manvrs_perigee: Excluding Earth block from 2026:306:20:58:25.856 to 2026:306:21:52:39.207
2026-11-14 08:34:09,180 get_mon_dataset: Getting MON data from 2026:306:19:07:02.856 to 2026:306:19:40:55.431
2026-11-14 08:34:09,180 get_aca_images_cached: Getting ACA images from 2026:306:19:07:02.856 to 2026:306:19:40:55.431
2026-11-14 08:34:09,383 get_mon_dataset: Getting MON data from 2026:306:20:58:00.231 to 2026:306:20:58:25.856
2026-11-14 08:34:09,384 get_aca_images_cached: Getting ACA images from 2026:306:20:58:00.231 to 2026:306:20:58:25.856
2026-11-14 08:34:09,404 get_mon_dataset: Not enough images for slot 0 found 3)
2026-11-14 08:34:09,405 get_mon_dataset: Not enough images for slot 1 found 3)
2026-11-14 08:34:09,406 get_mon_dataset: Not enough images for slot 2 found 3)
2026-11-14 08:34:09,406 get_mon_dataset: Not enough images for slot 3 found 3)
2026-11-14 08:34:09,407 get_mon_dataset: Not enough images for slot 4 found 3)
2026-11-14 08:34:09,408 get_mon_dataset: Not enough images for slot 5 found 3)
2026-11-14 08:34:09,409 get_mon_dataset: Not enough images for slot 6 found 3)
2026-11-14 08:34:09,410 get_mon_dataset: Not enough images for slot 7 found 3)
2026-11-14 08:34:09,411 get_mon_dataset: Getting MON data from 2026:306:21:52:39.207 to 2026:306:21:53:05.857
2026-11-14 08:34:09,411 get_aca_images_cached: Getting ACA images from 2026:306:21:52:39.207 to 2026:306:21:53:05.857
2026-11-14 08:34:09,430 get_mon_dataset: Not enough images for slot 0 found 4)
2026-11-14 08:34:09,431 get_mon_dataset: Not enough images for slot 1 found 4)
2026-11-14 08:34:09,432 get_mon_dataset: Not enough images for slot 2 found 4)
2026-11-14 08:34:09,433 get_mon_dataset: Not enough images for slot 3 found 4)
2026-11-14 08:34:09,434 get_mon_dataset: Not enough images for slot 4 found 4)
2026-11-14 08:34:09,434 get_mon_dataset: Not enough images for slot 5 found 4)
2026-11-14 08:34:09,435 get_mon_dataset: Not enough images for slot 6 found 4)
2026-11-14 08:34:09,436 get_mon_dataset: Not enough images for slot 7 found 4)
2026-11-14 08:34:09,436 get_kalman_drops_nman: processing NMAN data
2026-11-14 08:34:09,442 get_kalman_drops_nman: Skipping NMAN from 2026:306:19:07:02.856 to 2026:306:19:40:55.431 due to insufficient monitor window data within 100 minutes of perigee
2026-11-14 08:34:09,443 _get_tlm: Getting telemetry for 2026:306:21:17:19.377
2026-11-14 08:34:09,866 make_detail_page: Writing perigee detail page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/Nov-02/index.html
2026-11-14 08:34:09,879 make_index_list_pages: Writing recent index list page to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/index.html
2026-11-14 08:34:09,889 make_index_list_pages: Writing index list page for 2025 to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2025/index.html
2026-11-14 08:34:09,897 make_index_list_pages: Writing index list page for 2026 to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/2026/index.html
2026-11-14 08:34:15,777 get_manvrs_perigee: Getting maneuvers from 2026:273:13:34:15.776 to 2026:317:13:34:15.776
2026-11-14 08:34:20,386 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:273:13:34:15.776 to 2026:317:13:34:15.776
2026-11-14 08:34:29,559 get_manvrs_perigee: Excluding Earth block from 2026:273:14:27:53.689 to 2026:273:14:32:21.214
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:273:22:47:07.266 to 2026:273:22:49:57.416
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:274:02:55:31.792 to 2026:274:03:00:42.367
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:274:07:03:37.868 to 2026:274:07:09:31.493
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:274:11:12:39.294 to 2026:274:11:18:01.144
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:274:15:24:21.645 to 2026:274:15:24:57.520
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:276:01:17:52.528 to 2026:276:01:22:50.803
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:276:04:50:20.454 to 2026:276:04:55:16.679
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:276:08:14:22.030 to 2026:276:08:19:59.255
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:276:11:47:11.481 to 2026:276:11:52:50.756
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:278:11:15:03.092 to 2026:278:11:21:32.592
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:279:17:52:38.250 to 2026:279:17:55:50.950
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:280:04:42:45.652 to 2026:280:04:44:13.802
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:281:12:28:52.085 to 2026:281:12:33:24.735
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:282:08:21:57.065 to 2026:282:08:27:10.715
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:285:14:10:13.708 to 2026:285:14:18:48.258
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:285:15:42:35.884 to 2026:285:15:46:38.809
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:288:00:23:58.522 to 2026:288:00:29:57.272
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:288:02:28:45.123 to 2026:288:02:33:38.273
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:288:04:39:01.773 to 2026:288:04:46:26.624
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:292:04:15:02.972 to 2026:292:04:20:37.122
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:292:08:37:55.673 to 2026:292:08:42:37.548
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:292:12:24:29.223 to 2026:292:12:27:07.073
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:297:09:04:55.802 to 2026:297:09:10:30.977
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:298:16:56:29.209 to 2026:298:17:03:27.409
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:306:20:58:25.856 to 2026:306:21:52:39.207
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:308:06:00:57.114 to 2026:308:06:14:22.765
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:311:22:44:51.211 to 2026:311:22:51:42.236
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:312:00:14:35.536 to 2026:312:00:18:05.661
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:312:20:28:44.341 to 2026:312:20:36:16.366
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:314:19:39:17.627 to 2026:314:19:51:28.452
2026-11-14 08:34:29,560 get_manvrs_perigee: Excluding Earth block from 2026:317:11:04:57.918 to 2026:317:11:17:00.543
2026-11-14 08:34:29,650 get_mon_dataset: Getting MON data from 2026:275:03:34:59.873 to 2026:275:03:55:51.398
2026-11-14 08:34:29,650 get_aca_images_cached: Getting ACA images from 2026:275:03:34:59.873 to 2026:275:03:55:51.398
2026-11-14 08:34:29,824 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-11-14 08:36:53,631 get_mon_dataset: Getting MON data from 2026:277:17:22:37.688 to 2026:277:17:55:55.413
2026-11-14 08:36:53,631 get_aca_images_cached: Getting ACA images from 2026:277:17:22:37.688 to 2026:277:17:55:55.413
2026-11-14 08:36:53,660 get_mon_dataset: Not enough images for slot 0 found 0)
2026-11-14 08:36:53,660 get_mon_dataset: Not enough images for slot 1 found 0)
2026-11-14 08:36:53,661 get_mon_dataset: Not enough images for slot 2 found 0)
2026-11-14 08:36:53,662 get_mon_dataset: Not enough images for slot 3 found 0)
2026-11-14 08:36:53,662 get_mon_dataset: Not enough images for slot 4 found 0)
2026-11-14 08:36:53,663 get_mon_dataset: Not enough images for slot 5 found 0)
2026-11-14 08:36:53,663 get_mon_dataset: Not enough images for slot 6 found 0)
2026-11-14 08:36:53,664 get_mon_dataset: Not enough images for slot 7 found 0)
2026-11-14 08:36:53,665 get_mon_dataset: Getting MON data from 2026:277:20:44:54.714 to 2026:277:21:15:56.114
2026-11-14 08:36:53,665 get_aca_images_cached: Getting ACA images from 2026:277:20:44:54.714 to 2026:277:21:15:56.114
2026-11-14 08:36:53,849 get_mon_dataset: Getting MON data from 2026:280:11:24:32.629 to 2026:280:11:55:55.554
2026-11-14 08:36:53,849 get_aca_images_cached: Getting ACA images from 2026:280:11:24:32.629 to 2026:280:11:55:55.554
2026-11-14 08:36:54,037 get_mon_dataset: Getting MON data from 2026:283:00:16:16.644 to 2026:283:00:55:55.669
2026-11-14 08:36:54,037 get_aca_images_cached: Getting ACA images from 2026:283:00:16:16.644 to 2026:283:00:55:55.669
2026-11-14 08:36:54,232 get_mon_dataset: Getting MON data from 2026:283:03:16:17.069 to 2026:283:03:55:56.094
2026-11-14 08:36:54,232 get_aca_images_cached: Getting ACA images from 2026:283:03:16:17.069 to 2026:283:03:55:56.094
2026-11-14 08:36:54,433 get_mon_dataset: Getting MON data from 2026:285:15:46:38.809 to 2026:285:15:55:55.384
2026-11-14 08:36:54,433 get_aca_images_cached: Getting ACA images from 2026:285:15:46:38.809 to 2026:285:15:55:55.384
2026-11-14 08:36:54,595 get_mon_dataset: Getting MON data from 2026:285:19:10:51.660 to 2026:285:19:40:55.660
2026-11-14 08:36:54,595 get_aca_images_cached: Getting ACA images from 2026:285:19:10:51.660 to 2026:285:19:40:55.660
2026-11-14 08:36:54,779 get_mon_dataset: Getting MON data from 2026:288:08:00:59.324 to 2026:288:08:25:55.824
2026-11-14 08:36:54,779 get_aca_images_cached: Getting ACA images from 2026:288:08:00:59.324 to 2026:288:08:25:55.824
2026-11-14 08:36:54,958 get_mon_dataset: Getting MON data from 2026:288:09:40:25.850 to 2026:288:10:10:55.475
2026-11-14 08:36:54,958 get_aca_images_cached: Getting ACA images from 2026:288:09:40:25.850 to 2026:288:10:10:55.475
2026-11-14 08:36:55,148 get_mon_dataset: Getting MON data from 2026:288:10:33:44.875 to 2026:288:11:12:56.225
2026-11-14 08:36:55,148 get_aca_images_cached: Getting ACA images from 2026:288:10:33:44.875 to 2026:288:11:12:56.225
2026-11-14 08:36:55,350 get_mon_dataset: Getting MON data from 2026:290:23:11:47.865 to 2026:290:23:55:56.465
2026-11-14 08:36:55,350 get_aca_images_cached: Getting ACA images from 2026:290:23:11:47.865 to 2026:290:23:55:56.465
2026-11-14 08:36:55,557 get_mon_dataset: Getting MON data from 2026:291:00:37:26.190 to 2026:291:01:05:55.890
2026-11-14 08:36:55,557 get_aca_images_cached: Getting ACA images from 2026:291:00:37:26.190 to 2026:291:01:05:55.890
2026-11-14 08:36:55,742 get_mon_dataset: Getting MON data from 2026:291:01:28:15.565 to 2026:291:02:07:55.615
2026-11-14 08:36:55,742 get_aca_images_cached: Getting ACA images from 2026:291:01:28:15.565 to 2026:291:02:07:55.615
2026-11-14 08:36:55,945 get_mon_dataset: Getting MON data from 2026:293:14:31:44.780 to 2026:293:14:55:56.180
2026-11-14 08:36:55,945 get_aca_images_cached: Getting ACA images from 2026:293:14:31:44.780 to 2026:293:14:55:56.180
2026-11-14 08:36:56,125 get_mon_dataset: Getting MON data from 2026:293:17:25:54.655 to 2026:293:17:55:55.581
2026-11-14 08:36:56,125 get_aca_images_cached: Getting ACA images from 2026:293:17:25:54.655 to 2026:293:17:55:55.581
2026-11-14 08:36:56,316 get_mon_dataset: Getting MON data from 2026:296:08:11:45.671 to 2026:296:08:55:56.321
2026-11-14 08:36:56,316 get_aca_images_cached: Getting ACA images from 2026:296:08:11:45.671 to 2026:296:08:55:56.321
2026-11-14 08:36:56,524 get_mon_dataset: Getting MON data from 2026:298:21:01:08.235 to 2026:298:21:28:55.910
2026-11-14 08:36:56,525 get_aca_images_cached: Getting ACA images from 2026:298:21:01:08.235 to 2026:298:21:28:55.910
2026-11-14 08:36:56,721 get_mon_dataset: Getting MON data from 2026:298:23:33:45.586 to 2026:298:23:55:56.036
2026-11-14 08:36:56,721 get_aca_images_cached: Getting ACA images from 2026:298:23:33:45.586 to 2026:298:23:55:56.036
2026-11-14 08:36:56,911 get_mon_dataset: Getting MON data from 2026:301:12:45:22.701 to 2026:301:13:15:55.401
2026-11-14 08:36:56,911 get_aca_images_cached: Getting ACA images from 2026:301:12:45:22.701 to 2026:301:13:15:55.401
2026-11-14 08:36:57,112 get_mon_dataset: Getting MON data from 2026:301:14:10:00.551 to 2026:301:14:37:12.351
2026-11-14 08:36:57,112 get_aca_images_cached: Getting ACA images from 2026:301:14:10:00.551 to 2026:301:14:37:12.351
2026-11-14 08:36:57,310 get_mon_dataset: Getting MON data from 2026:301:14:57:56.701 to 2026:301:15:24:39.801
2026-11-14 08:36:57,310 get_aca_images_cached: Getting ACA images from 2026:301:14:57:56.701 to 2026:301:15:24:39.801
2026-11-14 08:36:57,505 get_mon_dataset: Getting MON data from 2026:301:15:45:24.151 to 2026:301:16:15:02.526
2026-11-14 08:36:57,506 get_aca_images_cached: Getting ACA images from 2026:301:15:45:24.151 to 2026:301:16:15:02.526
2026-11-14 08:36:57,705 get_mon_dataset: Getting MON data from 2026:304:05:31:25.616 to 2026:304:06:10:56.441
2026-11-14 08:36:57,705 get_aca_images_cached: Getting ACA images from 2026:304:05:31:25.616 to 2026:304:06:10:56.441
2026-11-14 08:36:57,917 get_mon_dataset: Getting MON data from 2026:306:19:07:02.856 to 2026:306:19:40:55.431
2026-11-14 08:36:57,917 get_aca_images_cached: Getting ACA images from 2026:306:19:07:02.856 to 2026:306:19:40:55.431
2026-11-14 08:36:58,118 get_mon_dataset: Getting MON data from 2026:306:20:58:00.231 to 2026:306:20:58:25.856
2026-11-14 08:36:58,118 get_aca_images_cached: Getting ACA images from 2026:306:20:58:00.231 to 2026:306:20:58:25.856
2026-11-14 08:36:58,138 get_mon_dataset: Not enough images for slot 0 found 3)
2026-11-14 08:36:58,139 get_mon_dataset: Not enough images for slot 1 found 3)
2026-11-14 08:36:58,140 get_mon_dataset: Not enough images for slot 2 found 3)
2026-11-14 08:36:58,141 get_mon_dataset: Not enough images for slot 3 found 3)
2026-11-14 08:36:58,141 get_mon_dataset: Not enough images for slot 4 found 3)
2026-11-14 08:36:58,142 get_mon_dataset: Not enough images for slot 5 found 3)
2026-11-14 08:36:58,143 get_mon_dataset: Not enough images for slot 6 found 3)
2026-11-14 08:36:58,144 get_mon_dataset: Not enough images for slot 7 found 3)
2026-11-14 08:36:58,145 get_mon_dataset: Getting MON data from 2026:306:21:52:39.207 to 2026:306:21:53:05.857
2026-11-14 08:36:58,145 get_aca_images_cached: Getting ACA images from 2026:306:21:52:39.207 to 2026:306:21:53:05.857
2026-11-14 08:36:58,164 get_mon_dataset: Not enough images for slot 0 found 4)
2026-11-14 08:36:58,165 get_mon_dataset: Not enough images for slot 1 found 4)
2026-11-14 08:36:58,166 get_mon_dataset: Not enough images for slot 2 found 4)
2026-11-14 08:36:58,166 get_mon_dataset: Not enough images for slot 3 found 4)
2026-11-14 08:36:58,167 get_mon_dataset: Not enough images for slot 4 found 4)
2026-11-14 08:36:58,168 get_mon_dataset: Not enough images for slot 5 found 4)
2026-11-14 08:36:58,169 get_mon_dataset: Not enough images for slot 6 found 4)
2026-11-14 08:36:58,170 get_mon_dataset: Not enough images for slot 7 found 4)
2026-11-14 08:36:58,171 get_mon_dataset: Getting MON data from 2026:309:11:25:46.797 to 2026:309:11:55:55.922
2026-11-14 08:36:58,171 get_aca_images_cached: Getting ACA images from 2026:309:11:25:46.797 to 2026:309:11:55:55.922
2026-11-14 08:36:58,372 get_mon_dataset: Getting MON data from 2026:312:05:26:58.687 to 2026:312:06:05:55.688
2026-11-14 08:36:58,372 get_aca_images_cached: Getting ACA images from 2026:312:05:26:58.687 to 2026:312:06:05:55.688
2026-11-14 08:36:58,702 get_mon_dataset: Getting MON data from 2026:314:18:06:20.602 to 2026:314:18:45:55.527
2026-11-14 08:36:58,702 get_aca_images_cached: Getting ACA images from 2026:314:18:06:20.602 to 2026:314:18:45:55.527
2026-11-14 08:36:58,917 get_mon_dataset: Getting MON data from 2026:314:19:35:38.277 to 2026:314:19:39:17.627
2026-11-14 08:36:58,917 get_aca_images_cached: Getting ACA images from 2026:314:19:35:38.277 to 2026:314:19:39:17.627
2026-11-14 08:36:59,082 get_mon_dataset: Getting MON data from 2026:314:19:51:28.452 to 2026:314:20:15:56.253
2026-11-14 08:36:59,082 get_aca_images_cached: Getting ACA images from 2026:314:19:51:28.452 to 2026:314:20:15:56.253
2026-11-14 08:36:59,275 get_mon_dataset: Getting MON data from 2026:317:09:16:28.142 to 2026:317:09:55:55.892
2026-11-14 08:36:59,275 get_aca_images_cached: Getting ACA images from 2026:317:09:16:28.142 to 2026:317:09:55:55.892
2026-11-14 08:36:59,497 get_mon_dataset: Getting MON data from 2026:317:11:00:30.393 to 2026:317:11:04:57.918
2026-11-14 08:36:59,497 get_aca_images_cached: Getting ACA images from 2026:317:11:00:30.393 to 2026:317:11:04:57.918
2026-11-14 08:36:59,672 get_mon_dataset: Getting MON data from 2026:317:11:17:00.543 to 2026:317:11:40:55.543
2026-11-14 08:36:59,672 get_aca_images_cached: Getting ACA images from 2026:317:11:17:00.543 to 2026:317:11:40:55.543
2026-11-14 08:36:59,901 get_kalman_drops_nman: processing NMAN data
2026-11-14 08:36:59,914 get_kalman_drops_nman: Skipping NMAN from 2026:277:20:44:54.714 to 2026:277:21:15:56.114 due to insufficient monitor window data within 100 minutes of perigee
2026-11-14 08:36:59,946 get_kalman_drops_nman: Skipping NMAN from 2026:285:15:46:38.809 to 2026:285:15:55:55.384 due to insufficient monitor window data within 100 minutes of perigee
2026-11-14 08:36:59,951 get_kalman_drops_nman: Skipping NMAN from 2026:285:19:10:51.660 to 2026:285:19:40:55.660 due to insufficient monitor window data within 100 minutes of perigee
2026-11-14 08:37:00,095 get_kalman_drops_nman: Skipping NMAN from 2026:306:19:07:02.856 to 2026:306:19:40:55.431 due to insufficient monitor window data within 100 minutes of perigee
2026-11-14 08:37:00,128 get_kalman_drops_nman: Skipping NMAN from 2026:314:19:35:38.277 to 2026:314:19:39:17.627 due to insufficient monitor window data within 100 minutes of perigee
2026-11-14 08:37:00,150 get_kalman_drops_nman: Skipping NMAN from 2026:317:11:00:30.393 to 2026:317:11:04:57.918 due to insufficient monitor window data within 100 minutes of perigee
2026-11-14 07:37:01,964 _get_tlm: Getting telemetry for 2026:275:03:41:15.015
2026-11-14 07:37:02,338 obss: Getting observations from kadi commands for 2026/Oct-02
2026-11-14 07:37:02,353 _get_tlm: Getting telemetry for 2026:277:19:09:51.718
2026-11-14 07:37:02,739 obss: Getting observations from kadi commands for 2026/Oct-04
2026-11-14 07:37:02,754 _get_tlm: Getting telemetry for 2026:280:10:37:44.962
2026-11-14 07:37:03,169 obss: Getting observations from kadi commands for 2026/Oct-07
2026-11-14 07:37:03,183 _get_tlm: Getting telemetry for 2026:283:02:05:06.148
2026-11-14 07:37:03,569 obss: Getting observations from kadi commands for 2026/Oct-10
2026-11-14 07:37:03,582 _get_tlm: Getting telemetry for 2026:285:17:32:26.957
2026-11-14 07:37:03,935 obss: Getting observations from kadi commands for 2026/Oct-12
2026-11-14 07:37:03,950 _get_tlm: Getting telemetry for 2026:288:09:00:09.561
2026-11-14 07:37:04,252 obss: Getting observations from kadi commands for 2026/Oct-15
2026-11-14 07:37:04,264 _get_tlm: Getting telemetry for 2026:291:00:28:02.332
2026-11-14 07:37:04,791 obss: Getting observations from kadi commands for 2026/Oct-18
2026-11-14 07:37:04,800 _get_tlm: Getting telemetry for 2026:293:15:55:42.147
2026-11-14 07:37:05,218 obss: Getting observations from kadi commands for 2026/Oct-20
2026-11-14 07:37:05,232 _get_tlm: Getting telemetry for 2026:296:07:23:13.605
2026-11-14 07:37:05,571 obss: Getting observations from kadi commands for 2026/Oct-23
2026-11-14 07:37:05,584 _get_tlm: Getting telemetry for 2026:298:22:51:21.297
2026-11-14 07:37:05,898 obss: Getting observations from kadi commands for 2026/Oct-25
2026-11-14 07:37:05,911 _get_tlm: Getting telemetry for 2026:301:14:20:12.626
2026-11-14 07:37:06,253 obss: Getting observations from kadi commands for 2026/Oct-28
2026-11-14 07:37:06,263 _get_tlm: Getting telemetry for 2026:304:05:49:05.932
2026-11-14 07:37:06,535 obss: Getting observations from kadi commands for 2026/Oct-31
2026-11-14 07:37:06,549 _get_tlm: Getting telemetry for 2026:306:21:17:19.377
2026-11-14 07:37:06,814 obss: Getting observations from kadi commands for 2026/Nov-02
2026-11-14 07:37:06,827 _get_tlm: Getting telemetry for 2026:309:12:45:00.098
2026-11-14 07:37:07,091 obss: Getting observations from kadi commands for 2026/Nov-05
2026-11-14 07:37:07,105 _get_tlm: Getting telemetry for 2026:312:04:12:32.030
2026-11-14 07:37:07,404 obss: Getting observations from kadi commands for 2026/Nov-08
2026-11-14 07:37:07,419 _get_tlm: Getting telemetry for 2026:314:19:40:22.379
2026-11-14 07:37:07,786 obss: Getting observations from kadi commands for 2026/Nov-10
2026-11-14 07:37:07,796 _get_tlm: Getting telemetry for 2026:317:11:08:28.148
2026-11-14 07:37:08,700 obss: Getting observations from kadi commands for 2026/Nov-13
2026-11-14 07:37:12,887 get_color_marker_for_perigee_plotly: Perigee 2026:275:03:41:15.015 color='rgb(229, 134, 6)' marker='circle'
2026-11-14 07:37:12,887 get_color_marker_for_perigee_plotly: Perigee 2026:277:19:09:51.718 color='rgb(93, 105, 177)' marker='square'
2026-11-14 07:37:12,888 get_color_marker_for_perigee_plotly: Perigee 2026:280:10:37:44.962 color='rgb(82, 188, 163)' marker='diamond'
2026-11-14 07:37:12,888 get_color_marker_for_perigee_plotly: Perigee 2026:283:02:05:06.148 color='rgb(153, 201, 69)' marker='triangle-up'
2026-11-14 07:37:12,888 get_color_marker_for_perigee_plotly: Perigee 2026:285:17:32:26.957 color='rgb(204, 97, 176)' marker='triangle-down'
2026-11-14 07:37:12,888 get_color_marker_for_perigee_plotly: Perigee 2026:288:09:00:09.561 color='rgb(36, 121, 108)' marker='triangle-left'
2026-11-14 07:37:12,888 get_color_marker_for_perigee_plotly: Perigee 2026:291:00:28:02.332 color='rgb(218, 165, 27)' marker='triangle-right'
2026-11-14 07:37:12,889 get_color_marker_for_perigee_plotly: Perigee 2026:293:15:55:42.147 color='rgb(47, 138, 196)' marker='circle'
2026-11-14 07:37:12,889 get_color_marker_for_perigee_plotly: Perigee 2026:296:07:23:13.605 color='rgb(118, 78, 159)' marker='square'
2026-11-14 07:37:12,889 get_color_marker_for_perigee_plotly: Perigee 2026:298:22:51:21.297 color='rgb(237, 100, 90)' marker='diamond'
2026-11-14 07:37:12,889 get_color_marker_for_perigee_plotly: Perigee 2026:301:14:20:12.626 color='rgb(165, 170, 153)' marker='triangle-up'
2026-11-14 07:37:12,889 get_color_marker_for_perigee_plotly: Perigee 2026:304:05:49:05.932 color='rgb(229, 134, 6)' marker='triangle-down'
2026-11-14 07:37:12,890 get_color_marker_for_perigee_plotly: Perigee 2026:306:21:17:19.377 color='rgb(93, 105, 177)' marker='triangle-left'
2026-11-14 07:37:12,890 get_color_marker_for_perigee_plotly: Perigee 2026:309:12:45:00.098 color='rgb(82, 188, 163)' marker='triangle-right'
2026-11-14 07:37:12,890 get_color_marker_for_perigee_plotly: Perigee 2026:312:04:12:32.030 color='rgb(153, 201, 69)' marker='circle'
2026-11-14 07:37:12,890 get_color_marker_for_perigee_plotly: Perigee 2026:314:19:40:22.379 color='rgb(204, 97, 176)' marker='square'
2026-11-14 07:37:12,890 get_color_marker_for_perigee_plotly: Perigee 2026:317:11:08:28.148 color='rgb(36, 121, 108)' marker='diamond'
2026-11-14 07:37:12,891 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-11-14 07:37:13,443 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-11-14 07:37:13,446 clean_aca_images_cache: Deleting /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/aca_imgs_cache/aca_imgs_2026:209:01:40:00.292_2026:209:01:40:54.617.fits.gz
2026-11-14 07:37:13,447 clean_aca_images_cache: Deleting /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/aca_imgs_cache/aca_imgs_2026:209:01:53:52.592_2026:209:02:19:45.467.fits.gz
2026-11-14 07:37:13,447 clean_aca_images_cache: Deleting /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/aca_imgs_cache/aca_imgs_2026:211:14:39:29.656_2026:211:15:05:55.332.fits.gz
2026-11-14 08:37:16,930 main: Overriding starting time with the time of latest low-kalman event
2026-11-14 08:37:16,930 get_lowkals_new: Getting telemetry between 2026:317:03:29:27.819 and 2026:318:13:37:16.920
2026-11-14 08:37:17,290 get_lowkals_new: Finding intervals of low kalman stars
2026-11-14 08:37:17,311 get_lowkals_new: Last telemetry date: 2026:318:03:29:55.828
2026-11-14 08:37:17,314 main: Updating events file /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-11-14 08:37:17,690 make_web_page: Writing HTML to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/index.html
2026:317:03:29:27.819 2026:318:13:37:16.920