Prev
Index
Next
kalman_watch3: Sun Sep 6 08:35:06 2026
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kalman_watch3 |
NOT OK
|
0.09 | 1.0 |
Sun Sep 6 08:35:06 2026 |
Errors:
- Line 182: 2026-09-06 08:35:05,616 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
File contents:
2026-09-06 08:31:48,417 log_run_info: ******************************************
2026-09-06 08:31:48,417 log_run_info: Running: /proj/sot/ska3/aca-test/lib/python3.13/site-packages/kalman_watch/kalman_perigee_mon.py
2026-09-06 08:31:48,417 log_run_info: Version: 0.6.2
2026-09-06 08:31:48,417 log_run_info: Time: Sun Sep 6 08:31:48 2026
2026-09-06 08:31:48,417 log_run_info: User: aca
2026-09-06 08:31:48,417 log_run_info: Machine: kady.cfa.harvard.edu
2026-09-06 08:31:48,417 log_run_info: Processing args:
2026-09-06 08:31:48,417 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3'),
2026-09-06 08:31:48,417 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-09-06 08:31:48,417 log_run_info: 'lookback': 14,
2026-09-06 08:31:48,417 log_run_info: 'make_html': True,
2026-09-06 08:31:48,417 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca-test/data/stk/radiation_data.fits'),
2026-09-06 08:31:48,417 log_run_info: 'stop': None}
2026-09-06 08:31:48,417 log_run_info: ******************************************
2026-09-06 08:31:48,429 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-09-06 08:31:48,461 get_evts_perigee: Getting perigee events between 2026:235:12:31:48.418 and 2026:249:12:31:48.418
2026-09-06 08:31:50,579 _get_tlm: Getting telemetry for 2026:248:17:03:08.998
2026-09-06 08:31:50,979 get_evts_perigee: No TLM found for perigee event at 2026:248:17:03:08.998, skipping
2026-09-06 08:31:50,979 get_evts_perigee: Found 0 new perigee event(s)
2026-09-06 08:31:50,979 main: No new perigee events, exiting
2026-09-06 08:31:55,358 get_manvrs_perigee: Getting maneuvers from 2026:204:12:31:55.357 to 2026:248:12:31:55.358
2026-09-06 08:31:58,713 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:204:12:31:55.357 to 2026:248:12:31:55.358
2026-09-06 08:32:06,346 get_manvrs_perigee: Excluding Earth block from 2026:209:01:40:54.617 to 2026:209:01:53:52.592
2026-09-06 08:32:06,346 get_manvrs_perigee: Excluding Earth block from 2026:211:16:57:41.907 to 2026:211:17:07:38.457
2026-09-06 08:32:06,346 get_manvrs_perigee: Excluding Earth block from 2026:213:04:47:15.616 to 2026:213:04:53:05.141
2026-09-06 08:32:06,346 get_manvrs_perigee: Excluding Earth block from 2026:220:18:46:59.759 to 2026:220:18:50:58.584
2026-09-06 08:32:06,346 get_manvrs_perigee: Excluding Earth block from 2026:221:06:02:12.887 to 2026:221:06:08:03.437
2026-09-06 08:32:06,346 get_manvrs_perigee: Excluding Earth block from 2026:222:09:41:02.444 to 2026:222:09:46:48.894
2026-09-06 08:32:06,346 get_manvrs_perigee: Excluding Earth block from 2026:223:03:15:19.298 to 2026:223:03:20:43.198
2026-09-06 08:32:06,346 get_manvrs_perigee: Excluding Earth block from 2026:224:21:56:04.758 to 2026:224:22:06:01.308
2026-09-06 08:32:06,346 get_manvrs_perigee: Excluding Earth block from 2026:238:09:06:46.461 to 2026:238:09:10:40.161
2026-09-06 08:32:06,346 get_manvrs_perigee: Excluding Earth block from 2026:238:13:36:24.037 to 2026:238:13:40:24.912
2026-09-06 08:32:06,408 get_mon_dataset: Getting MON data from 2026:206:07:44:09.226 to 2026:206:08:15:55.726
2026-09-06 08:32:06,408 get_aca_images_cached: Getting ACA images from 2026:206:07:44:09.226 to 2026:206:08:15:55.726
2026-09-06 08:32:06,973 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-09-06 08:34:30,690 get_mon_dataset: Getting MON data from 2026:206:08:52:34.351 to 2026:206:09:25:56.176
2026-09-06 08:34:30,690 get_aca_images_cached: Getting ACA images from 2026:206:08:52:34.351 to 2026:206:09:25:56.176
2026-09-06 08:34:30,904 get_mon_dataset: Getting MON data from 2026:206:10:39:37.002 to 2026:206:11:25:55.777
2026-09-06 08:34:30,904 get_aca_images_cached: Getting ACA images from 2026:206:10:39:37.002 to 2026:206:11:25:55.777
2026-09-06 08:34:31,123 get_mon_dataset: Getting MON data from 2026:208:23:27:06.816 to 2026:208:23:55:55.991
2026-09-06 08:34:31,123 get_aca_images_cached: Getting ACA images from 2026:208:23:27:06.816 to 2026:208:23:55:55.991
2026-09-06 08:34:31,581 get_mon_dataset: Getting MON data from 2026:209:01:40:00.292 to 2026:209:01:40:54.617
2026-09-06 08:34:31,581 get_aca_images_cached: Getting ACA images from 2026:209:01:40:00.292 to 2026:209:01:40:54.617
2026-09-06 08:34:31,750 get_mon_dataset: Getting MON data from 2026:209:01:53:52.592 to 2026:209:02:19:45.467
2026-09-06 08:34:31,750 get_aca_images_cached: Getting ACA images from 2026:209:01:53:52.592 to 2026:209:02:19:45.467
2026-09-06 08:34:31,976 get_mon_dataset: Getting MON data from 2026:211:14:39:29.656 to 2026:211:15:05:55.332
2026-09-06 08:34:31,976 get_aca_images_cached: Getting ACA images from 2026:211:14:39:29.656 to 2026:211:15:05:55.332
2026-09-06 08:34:31,995 get_mon_dataset: Not enough images for slot 0 found 0)
2026-09-06 08:34:31,996 get_mon_dataset: Not enough images for slot 1 found 0)
2026-09-06 08:34:31,996 get_mon_dataset: Not enough images for slot 2 found 0)
2026-09-06 08:34:31,997 get_mon_dataset: Not enough images for slot 3 found 0)
2026-09-06 08:34:31,997 get_mon_dataset: Not enough images for slot 4 found 0)
2026-09-06 08:34:31,998 get_mon_dataset: Not enough images for slot 5 found 0)
2026-09-06 08:34:31,999 get_mon_dataset: Not enough images for slot 6 found 0)
2026-09-06 08:34:31,999 get_mon_dataset: Not enough images for slot 7 found 0)
2026-09-06 08:34:32,000 get_mon_dataset: Getting MON data from 2026:211:16:49:59.632 to 2026:211:16:57:41.907
2026-09-06 08:34:32,000 get_aca_images_cached: Getting ACA images from 2026:211:16:49:59.632 to 2026:211:16:57:41.907
2026-09-06 08:34:32,018 get_mon_dataset: Not enough images for slot 0 found 0)
2026-09-06 08:34:32,019 get_mon_dataset: Not enough images for slot 1 found 0)
2026-09-06 08:34:32,019 get_mon_dataset: Not enough images for slot 2 found 0)
2026-09-06 08:34:32,020 get_mon_dataset: Not enough images for slot 3 found 0)
2026-09-06 08:34:32,020 get_mon_dataset: Not enough images for slot 4 found 0)
2026-09-06 08:34:32,021 get_mon_dataset: Not enough images for slot 5 found 0)
2026-09-06 08:34:32,021 get_mon_dataset: Not enough images for slot 6 found 0)
2026-09-06 08:34:32,022 get_mon_dataset: Not enough images for slot 7 found 0)
2026-09-06 08:34:32,023 get_mon_dataset: Getting MON data from 2026:211:17:07:38.457 to 2026:211:17:29:35.582
2026-09-06 08:34:32,023 get_aca_images_cached: Getting ACA images from 2026:211:17:07:38.457 to 2026:211:17:29:35.582
2026-09-06 08:34:32,041 get_mon_dataset: Not enough images for slot 0 found 0)
2026-09-06 08:34:32,041 get_mon_dataset: Not enough images for slot 1 found 0)
2026-09-06 08:34:32,042 get_mon_dataset: Not enough images for slot 2 found 0)
2026-09-06 08:34:32,042 get_mon_dataset: Not enough images for slot 3 found 0)
2026-09-06 08:34:32,043 get_mon_dataset: Not enough images for slot 4 found 0)
2026-09-06 08:34:32,044 get_mon_dataset: Not enough images for slot 5 found 0)
2026-09-06 08:34:32,044 get_mon_dataset: Not enough images for slot 6 found 0)
2026-09-06 08:34:32,045 get_mon_dataset: Not enough images for slot 7 found 0)
2026-09-06 08:34:32,045 get_mon_dataset: Getting MON data from 2026:214:07:02:35.997 to 2026:214:07:30:55.447
2026-09-06 08:34:32,045 get_aca_images_cached: Getting ACA images from 2026:214:07:02:35.997 to 2026:214:07:30:55.447
2026-09-06 08:34:32,244 get_mon_dataset: Getting MON data from 2026:214:09:03:19.672 to 2026:214:09:41:23.373
2026-09-06 08:34:32,244 get_aca_images_cached: Getting ACA images from 2026:214:09:03:19.672 to 2026:214:09:41:23.373
2026-09-06 08:34:32,458 get_mon_dataset: Getting MON data from 2026:216:22:25:28.187 to 2026:216:22:55:55.762
2026-09-06 08:34:32,458 get_aca_images_cached: Getting ACA images from 2026:216:22:25:28.187 to 2026:216:22:55:55.762
2026-09-06 08:34:32,688 get_mon_dataset: Getting MON data from 2026:216:23:49:59.888 to 2026:217:00:39:11.888
2026-09-06 08:34:32,688 get_aca_images_cached: Getting ACA images from 2026:216:23:49:59.888 to 2026:217:00:39:11.888
2026-09-06 08:34:32,938 get_mon_dataset: Getting MON data from 2026:219:14:52:02.603 to 2026:219:15:15:55.553
2026-09-06 08:34:32,938 get_aca_images_cached: Getting ACA images from 2026:219:14:52:02.603 to 2026:219:15:15:55.553
2026-09-06 08:34:33,152 get_mon_dataset: Getting MON data from 2026:219:16:10:00.703 to 2026:219:16:36:13.053
2026-09-06 08:34:33,152 get_aca_images_cached: Getting ACA images from 2026:219:16:10:00.703 to 2026:219:16:36:13.053
2026-09-06 08:34:33,426 get_mon_dataset: Getting MON data from 2026:222:04:50:00.543 to 2026:222:05:23:02.893
2026-09-06 08:34:33,426 get_aca_images_cached: Getting ACA images from 2026:222:04:50:00.543 to 2026:222:05:23:02.893
2026-09-06 08:34:33,658 get_mon_dataset: Getting MON data from 2026:224:21:40:34.058 to 2026:224:21:56:04.758
2026-09-06 08:34:33,658 get_aca_images_cached: Getting ACA images from 2026:224:21:40:34.058 to 2026:224:21:56:04.758
2026-09-06 08:34:33,857 get_mon_dataset: Getting MON data from 2026:224:22:06:01.308 to 2026:224:22:19:55.658
2026-09-06 08:34:33,857 get_aca_images_cached: Getting ACA images from 2026:224:22:06:01.308 to 2026:224:22:19:55.658
2026-09-06 08:34:34,042 get_mon_dataset: Getting MON data from 2026:227:11:23:39.223 to 2026:227:11:55:55.448
2026-09-06 08:34:34,042 get_aca_images_cached: Getting ACA images from 2026:227:11:23:39.223 to 2026:227:11:55:55.448
2026-09-06 08:34:34,270 get_mon_dataset: Getting MON data from 2026:230:03:17:08.213 to 2026:230:03:55:55.988
2026-09-06 08:34:34,270 get_aca_images_cached: Getting ACA images from 2026:230:03:17:08.213 to 2026:230:03:55:55.988
2026-09-06 08:34:34,550 get_mon_dataset: Getting MON data from 2026:232:18:45:59.154 to 2026:232:19:25:55.604
2026-09-06 08:34:34,551 get_aca_images_cached: Getting ACA images from 2026:232:18:45:59.154 to 2026:232:19:25:55.604
2026-09-06 08:34:34,760 get_mon_dataset: Getting MON data from 2026:235:10:26:53.744 to 2026:235:10:55:55.219
2026-09-06 08:34:34,760 get_aca_images_cached: Getting ACA images from 2026:235:10:26:53.744 to 2026:235:10:55:55.219
2026-09-06 08:34:35,077 get_mon_dataset: Getting MON data from 2026:235:11:34:22.494 to 2026:235:12:05:55.669
2026-09-06 08:34:35,077 get_aca_images_cached: Getting ACA images from 2026:235:11:34:22.494 to 2026:235:12:05:55.669
2026-09-06 08:34:35,332 get_mon_dataset: Getting MON data from 2026:238:01:21:28.534 to 2026:238:01:55:55.959
2026-09-06 08:34:35,332 get_aca_images_cached: Getting ACA images from 2026:238:01:21:28.534 to 2026:238:01:55:55.959
2026-09-06 08:34:35,578 get_mon_dataset: Getting MON data from 2026:240:16:42:39.249 to 2026:240:17:15:55.949
2026-09-06 08:34:35,578 get_aca_images_cached: Getting ACA images from 2026:240:16:42:39.249 to 2026:240:17:15:55.949
2026-09-06 08:34:35,866 get_mon_dataset: Getting MON data from 2026:240:19:09:09.650 to 2026:240:19:16:20.150
2026-09-06 08:34:35,866 get_aca_images_cached: Getting ACA images from 2026:240:19:09:09.650 to 2026:240:19:16:20.150
2026-09-06 08:34:36,000 get_mon_dataset: Not enough images for slot 0 found 0)
2026-09-06 08:34:36,001 get_mon_dataset: Not enough images for slot 1 found 0)
2026-09-06 08:34:36,002 get_mon_dataset: Not enough images for slot 2 found 0)
2026-09-06 08:34:36,003 get_mon_dataset: Not enough images for slot 3 found 0)
2026-09-06 08:34:36,004 get_mon_dataset: Not enough images for slot 4 found 0)
2026-09-06 08:34:36,005 get_mon_dataset: Not enough images for slot 5 found 0)
2026-09-06 08:34:36,006 get_mon_dataset: Not enough images for slot 6 found 0)
2026-09-06 08:34:36,007 get_mon_dataset: Not enough images for slot 7 found 0)
2026-09-06 08:34:36,008 get_mon_dataset: Getting MON data from 2026:243:08:52:32.240 to 2026:243:09:25:56.115
2026-09-06 08:34:36,008 get_aca_images_cached: Getting ACA images from 2026:243:08:52:32.240 to 2026:243:09:25:56.115
2026-09-06 08:34:36,254 get_mon_dataset: Getting MON data from 2026:243:10:51:46.740 to 2026:243:11:25:55.715
2026-09-06 08:34:36,254 get_aca_images_cached: Getting ACA images from 2026:243:10:51:46.740 to 2026:243:11:25:55.715
2026-09-06 08:34:36,474 get_mon_dataset: Getting MON data from 2026:246:00:22:32.880 to 2026:246:00:55:55.730
2026-09-06 08:34:36,474 get_aca_images_cached: Getting ACA images from 2026:246:00:22:32.880 to 2026:246:00:55:55.730
2026-09-06 08:34:36,685 get_mon_dataset: Getting MON data from 2026:246:02:36:02.230 to 2026:246:03:10:56.306
2026-09-06 08:34:36,686 get_aca_images_cached: Getting ACA images from 2026:246:02:36:02.230 to 2026:246:03:10:56.306
2026-09-06 08:34:36,923 get_kalman_drops_nman: processing NMAN data
2026-09-06 08:34:36,964 get_kalman_drops_nman: Skipping NMAN from 2026:209:01:40:00.292 to 2026:209:01:40:54.617 due to insufficient monitor window data within 100 minutes of perigee
2026-09-06 07:34:39,946 _get_tlm: Getting telemetry for 2026:206:09:35:05.546
2026-09-06 07:34:40,700 obss: Getting observations from kadi commands for 2026/Jul-25
2026-09-06 07:34:40,711 _get_tlm: Getting telemetry for 2026:209:01:03:12.421
2026-09-06 07:34:41,064 obss: Getting observations from kadi commands for 2026/Jul-28
2026-09-06 07:34:41,076 _get_tlm: Getting telemetry for 2026:211:16:31:01.229
2026-09-06 07:34:41,491 obss: Getting observations from kadi commands for 2026/Jul-30
2026-09-06 07:34:41,504 _get_tlm: Getting telemetry for 2026:214:07:58:39.068
2026-09-06 07:34:41,944 obss: Getting observations from kadi commands for 2026/Aug-02
2026-09-06 07:34:41,956 _get_tlm: Getting telemetry for 2026:216:23:26:42.311
2026-09-06 07:34:42,285 obss: Getting observations from kadi commands for 2026/Aug-04
2026-09-06 07:34:42,296 _get_tlm: Getting telemetry for 2026:219:14:55:30.764
2026-09-06 07:34:42,679 obss: Getting observations from kadi commands for 2026/Aug-07
2026-09-06 07:34:42,692 _get_tlm: Getting telemetry for 2026:222:06:24:31.116
2026-09-06 07:34:43,327 obss: Getting observations from kadi commands for 2026/Aug-10
2026-09-06 07:34:43,341 _get_tlm: Getting telemetry for 2026:224:21:52:48.916
2026-09-06 07:34:43,654 obss: Getting observations from kadi commands for 2026/Aug-12
2026-09-06 07:34:43,667 _get_tlm: Getting telemetry for 2026:227:13:20:18.857
2026-09-06 07:34:44,131 obss: Getting observations from kadi commands for 2026/Aug-15
2026-09-06 07:34:44,146 _get_tlm: Getting telemetry for 2026:230:04:47:40.149
2026-09-06 07:34:44,532 obss: Getting observations from kadi commands for 2026/Aug-18
2026-09-06 07:34:44,545 _get_tlm: Getting telemetry for 2026:232:20:15:17.080
2026-09-06 07:34:44,914 obss: Getting observations from kadi commands for 2026/Aug-20
2026-09-06 07:34:44,928 _get_tlm: Getting telemetry for 2026:235:11:43:07.898
2026-09-06 07:34:45,671 obss: Getting observations from kadi commands for 2026/Aug-23
2026-09-06 07:34:45,683 _get_tlm: Getting telemetry for 2026:238:03:10:47.135
2026-09-06 07:34:46,073 obss: Getting observations from kadi commands for 2026/Aug-26
2026-09-06 07:34:46,087 _get_tlm: Getting telemetry for 2026:240:18:38:11.096
2026-09-06 07:34:46,473 obss: Getting observations from kadi commands for 2026/Aug-28
2026-09-06 07:34:46,487 _get_tlm: Getting telemetry for 2026:243:10:05:52.240
2026-09-06 07:34:46,824 obss: Getting observations from kadi commands for 2026/Aug-31
2026-09-06 07:34:46,835 _get_tlm: Getting telemetry for 2026:246:01:34:19.196
2026-09-06 07:34:47,257 obss: Getting observations from kadi commands for 2026/Sep-03
2026-09-06 07:34:47,268 _get_tlm: Getting telemetry for 2026:248:17:03:08.998
2026-09-06 07:34:47,493 get_kalman_drops_npnt: No telemetry for perigee 2026:248:17:03:08.998
2026-09-06 07:34:58,928 get_color_marker_for_perigee_plotly: Perigee 2026:206:09:35:05.546 color='rgb(229, 134, 6)' marker='circle'
2026-09-06 07:34:58,929 get_color_marker_for_perigee_plotly: Perigee 2026:209:01:03:12.421 color='rgb(93, 105, 177)' marker='square'
2026-09-06 07:34:58,929 get_color_marker_for_perigee_plotly: Perigee 2026:211:16:31:01.229 color='rgb(82, 188, 163)' marker='diamond'
2026-09-06 07:34:58,929 get_color_marker_for_perigee_plotly: Perigee 2026:214:07:58:39.068 color='rgb(153, 201, 69)' marker='triangle-up'
2026-09-06 07:34:58,929 get_color_marker_for_perigee_plotly: Perigee 2026:216:23:26:42.311 color='rgb(204, 97, 176)' marker='triangle-down'
2026-09-06 07:34:58,930 get_color_marker_for_perigee_plotly: Perigee 2026:219:14:55:30.764 color='rgb(36, 121, 108)' marker='triangle-left'
2026-09-06 07:34:58,930 get_color_marker_for_perigee_plotly: Perigee 2026:222:06:24:31.116 color='rgb(218, 165, 27)' marker='triangle-right'
2026-09-06 07:34:58,930 get_color_marker_for_perigee_plotly: Perigee 2026:224:21:52:48.916 color='rgb(47, 138, 196)' marker='circle'
2026-09-06 07:34:58,930 get_color_marker_for_perigee_plotly: Perigee 2026:227:13:20:18.857 color='rgb(118, 78, 159)' marker='square'
2026-09-06 07:34:58,930 get_color_marker_for_perigee_plotly: Perigee 2026:230:04:47:40.149 color='rgb(237, 100, 90)' marker='diamond'
2026-09-06 07:34:58,931 get_color_marker_for_perigee_plotly: Perigee 2026:232:20:15:17.080 color='rgb(165, 170, 153)' marker='triangle-up'
2026-09-06 07:34:58,931 get_color_marker_for_perigee_plotly: Perigee 2026:235:11:43:07.898 color='rgb(229, 134, 6)' marker='triangle-down'
2026-09-06 07:34:58,931 get_color_marker_for_perigee_plotly: Perigee 2026:238:03:10:47.135 color='rgb(93, 105, 177)' marker='triangle-left'
2026-09-06 07:34:58,931 get_color_marker_for_perigee_plotly: Perigee 2026:240:18:38:11.096 color='rgb(82, 188, 163)' marker='triangle-right'
2026-09-06 07:34:58,931 get_color_marker_for_perigee_plotly: Perigee 2026:243:10:05:52.240 color='rgb(153, 201, 69)' marker='circle'
2026-09-06 07:34:58,932 get_color_marker_for_perigee_plotly: Perigee 2026:246:01:34:19.196 color='rgb(204, 97, 176)' marker='square'
2026-09-06 07:34:58,932 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-09-06 07:34:58,938 plot_mon_win_and_aokalstr_composite_plotly: Skipping prediction for 2026:248:17:03:08.998 because there is no observed data
2026-09-06 07:34:59,891 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-09-06 08:35:05,175 main: Overriding starting time with the time of latest low-kalman event
2026-09-06 08:35:05,176 get_lowkals_new: Getting telemetry between 2026:248:02:00:24.224 and 2026:249:12:35:05.168
2026-09-06 08:35:05,616 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
2026-09-06 08:35:05,619 main: Updating events file /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-09-06 08:35:06,533 make_web_page: Writing HTML to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/index.html
2026:248:02:00:24.224 2026:249:12:35:05.168