Prev
Index
Next
kalman_watch3: Mon Jul 27 08:34:30 2026
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kalman_watch3 |
NOT OK
|
0.09 | 1.0 |
Mon Jul 27 08:34:30 2026 |
Errors:
- Line 187: 2026-07-27 08:34:29,981 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
File contents:
2026-07-27 08:31:22,439 log_run_info: ******************************************
2026-07-27 08:31:22,440 log_run_info: Running: /proj/sot/ska3/aca-test/lib/python3.13/site-packages/kalman_watch/kalman_perigee_mon.py
2026-07-27 08:31:22,440 log_run_info: Version: 0.6.2
2026-07-27 08:31:22,440 log_run_info: Time: Mon Jul 27 08:31:22 2026
2026-07-27 08:31:22,440 log_run_info: User: aca
2026-07-27 08:31:22,440 log_run_info: Machine: kady.cfa.harvard.edu
2026-07-27 08:31:22,440 log_run_info: Processing args:
2026-07-27 08:31:22,440 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3'),
2026-07-27 08:31:22,440 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-07-27 08:31:22,440 log_run_info: 'lookback': 14,
2026-07-27 08:31:22,440 log_run_info: 'make_html': True,
2026-07-27 08:31:22,440 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca-test/data/stk/radiation_data.fits'),
2026-07-27 08:31:22,440 log_run_info: 'stop': None}
2026-07-27 08:31:22,440 log_run_info: ******************************************
2026-07-27 08:31:22,444 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-07-27 08:31:22,477 get_evts_perigee: Getting perigee events between 2026:194:12:31:22.440 and 2026:208:12:31:22.440
2026-07-27 08:31:24,531 get_evts_perigee: Found 0 new perigee event(s)
2026-07-27 08:31:24,531 main: No new perigee events, exiting
2026-07-27 08:31:29,205 get_manvrs_perigee: Getting maneuvers from 2026:163:12:31:29.204 to 2026:207:12:31:29.205
2026-07-27 08:31:33,530 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:163:12:31:29.204 to 2026:207:12:31:29.205
2026-07-27 08:31:42,778 get_manvrs_perigee: Excluding Earth block from 2026:169:08:42:16.338 to 2026:169:09:30:24.788
2026-07-27 08:31:42,778 get_manvrs_perigee: Excluding Earth block from 2026:195:21:46:36.541 to 2026:195:21:47:53.416
2026-07-27 08:31:42,778 get_manvrs_perigee: Excluding Earth block from 2026:196:00:46:42.092 to 2026:196:00:53:30.042
2026-07-27 08:31:42,778 get_manvrs_perigee: Excluding Earth block from 2026:203:20:54:00.137 to 2026:203:21:02:00.862
2026-07-27 08:31:42,778 get_manvrs_perigee: Excluding Earth block from 2026:203:23:13:50.787 to 2026:203:23:21:01.287
2026-07-27 08:31:42,778 get_manvrs_perigee: Excluding Earth block from 2026:204:06:21:36.789 to 2026:204:06:28:58.564
2026-07-27 08:31:42,864 get_mon_dataset: Getting MON data from 2026:164:00:55:52.183 to 2026:164:01:25:56.183
2026-07-27 08:31:42,864 get_aca_images_cached: Getting ACA images from 2026:164:00:55:52.183 to 2026:164:01:25:56.183
2026-07-27 08:31:43,377 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-07-27 08:34:05,135 get_mon_dataset: Getting MON data from 2026:164:02:20:00.308 to 2026:164:03:00:34.683
2026-07-27 08:34:05,135 get_aca_images_cached: Getting ACA images from 2026:164:02:20:00.308 to 2026:164:03:00:34.683
2026-07-27 08:34:05,400 get_mon_dataset: Getting MON data from 2026:169:07:07:36.813 to 2026:169:07:34:30.163
2026-07-27 08:34:05,400 get_aca_images_cached: Getting ACA images from 2026:169:07:07:36.813 to 2026:169:07:34:30.163
2026-07-27 08:34:05,620 get_mon_dataset: Getting MON data from 2026:169:08:41:30.213 to 2026:169:08:42:16.338
2026-07-27 08:34:05,620 get_aca_images_cached: Getting ACA images from 2026:169:08:41:30.213 to 2026:169:08:42:16.338
2026-07-27 08:34:05,656 get_mon_dataset: Not enough images for slot 0 found 8)
2026-07-27 08:34:05,657 get_mon_dataset: Not enough images for slot 1 found 8)
2026-07-27 08:34:05,658 get_mon_dataset: Not enough images for slot 2 found 8)
2026-07-27 08:34:05,659 get_mon_dataset: Not enough images for slot 3 found 8)
2026-07-27 08:34:05,660 get_mon_dataset: Not enough images for slot 4 found 8)
2026-07-27 08:34:05,661 get_mon_dataset: Not enough images for slot 5 found 8)
2026-07-27 08:34:05,662 get_mon_dataset: Not enough images for slot 6 found 8)
2026-07-27 08:34:05,662 get_mon_dataset: Not enough images for slot 7 found 8)
2026-07-27 08:34:05,663 get_mon_dataset: Getting MON data from 2026:169:09:30:24.788 to 2026:169:09:39:55.713
2026-07-27 08:34:05,663 get_aca_images_cached: Getting ACA images from 2026:169:09:30:24.788 to 2026:169:09:39:55.713
2026-07-27 08:34:05,874 get_mon_dataset: Getting MON data from 2026:172:01:59:09.379 to 2026:172:02:06:19.879
2026-07-27 08:34:05,874 get_aca_images_cached: Getting ACA images from 2026:172:01:59:09.379 to 2026:172:02:06:19.879
2026-07-27 08:34:05,951 get_mon_dataset: Not enough images for slot 0 found 0)
2026-07-27 08:34:05,952 get_mon_dataset: Not enough images for slot 1 found 0)
2026-07-27 08:34:05,953 get_mon_dataset: Not enough images for slot 2 found 0)
2026-07-27 08:34:05,954 get_mon_dataset: Not enough images for slot 3 found 0)
2026-07-27 08:34:05,955 get_mon_dataset: Not enough images for slot 4 found 0)
2026-07-27 08:34:05,956 get_mon_dataset: Not enough images for slot 5 found 0)
2026-07-27 08:34:05,957 get_mon_dataset: Not enough images for slot 6 found 0)
2026-07-27 08:34:05,958 get_mon_dataset: Not enough images for slot 7 found 0)
2026-07-27 08:34:05,959 get_mon_dataset: Getting MON data from 2026:174:14:16:33.143 to 2026:174:14:55:55.768
2026-07-27 08:34:05,959 get_aca_images_cached: Getting ACA images from 2026:174:14:16:33.143 to 2026:174:14:55:55.768
2026-07-27 08:34:06,197 get_mon_dataset: Getting MON data from 2026:174:17:14:10.069 to 2026:174:17:21:21.594
2026-07-27 08:34:06,197 get_aca_images_cached: Getting ACA images from 2026:174:17:14:10.069 to 2026:174:17:21:21.594
2026-07-27 08:34:06,250 get_mon_dataset: Not enough images for slot 0 found 0)
2026-07-27 08:34:06,251 get_mon_dataset: Not enough images for slot 1 found 0)
2026-07-27 08:34:06,252 get_mon_dataset: Not enough images for slot 2 found 0)
2026-07-27 08:34:06,253 get_mon_dataset: Not enough images for slot 3 found 0)
2026-07-27 08:34:06,254 get_mon_dataset: Not enough images for slot 4 found 0)
2026-07-27 08:34:06,255 get_mon_dataset: Not enough images for slot 5 found 0)
2026-07-27 08:34:06,256 get_mon_dataset: Not enough images for slot 6 found 0)
2026-07-27 08:34:06,257 get_mon_dataset: Not enough images for slot 7 found 0)
2026-07-27 08:34:06,257 get_mon_dataset: Getting MON data from 2026:177:07:06:41.034 to 2026:177:07:25:56.209
2026-07-27 08:34:06,257 get_aca_images_cached: Getting ACA images from 2026:177:07:06:41.034 to 2026:177:07:25:56.209
2026-07-27 08:34:06,468 get_mon_dataset: Getting MON data from 2026:182:12:11:40.989 to 2026:182:12:45:56.114
2026-07-27 08:34:06,468 get_aca_images_cached: Getting ACA images from 2026:182:12:11:40.989 to 2026:182:12:45:56.114
2026-07-27 08:34:06,720 get_mon_dataset: Getting MON data from 2026:182:15:51:40.940 to 2026:182:16:25:56.065
2026-07-27 08:34:06,720 get_aca_images_cached: Getting ACA images from 2026:182:15:51:40.940 to 2026:182:16:25:56.065
2026-07-27 08:34:06,997 get_mon_dataset: Getting MON data from 2026:185:04:24:00.554 to 2026:185:04:55:56.279
2026-07-27 08:34:06,997 get_aca_images_cached: Getting ACA images from 2026:185:04:24:00.554 to 2026:185:04:55:56.279
2026-07-27 08:34:07,498 get_mon_dataset: Getting MON data from 2026:187:19:16:48.744 to 2026:187:19:55:55.994
2026-07-27 08:34:07,498 get_aca_images_cached: Getting ACA images from 2026:187:19:16:48.744 to 2026:187:19:55:55.994
2026-07-27 08:34:07,768 get_mon_dataset: Getting MON data from 2026:187:20:50:00.120 to 2026:187:21:29:09.420
2026-07-27 08:34:07,769 get_aca_images_cached: Getting ACA images from 2026:187:20:50:00.120 to 2026:187:21:29:09.420
2026-07-27 08:34:08,057 get_mon_dataset: Getting MON data from 2026:187:22:23:13.545 to 2026:187:22:55:01.070
2026-07-27 08:34:08,057 get_aca_images_cached: Getting ACA images from 2026:187:22:23:13.545 to 2026:187:22:55:01.070
2026-07-27 08:34:08,324 get_mon_dataset: Getting MON data from 2026:190:10:52:31.735 to 2026:190:11:25:55.610
2026-07-27 08:34:08,324 get_aca_images_cached: Getting ACA images from 2026:190:10:52:31.735 to 2026:190:11:25:55.610
2026-07-27 08:34:08,568 get_mon_dataset: Getting MON data from 2026:190:12:20:00.760 to 2026:190:13:10:19.385
2026-07-27 08:34:08,568 get_aca_images_cached: Getting ACA images from 2026:190:12:20:00.760 to 2026:190:13:10:19.385
2026-07-27 08:34:08,825 get_mon_dataset: Getting MON data from 2026:190:14:04:23.510 to 2026:190:14:54:42.136
2026-07-27 08:34:08,825 get_aca_images_cached: Getting ACA images from 2026:190:14:04:23.510 to 2026:190:14:54:42.136
2026-07-27 08:34:09,094 get_mon_dataset: Getting MON data from 2026:193:02:40:45.025 to 2026:193:03:15:55.500
2026-07-27 08:34:09,094 get_aca_images_cached: Getting ACA images from 2026:193:02:40:45.025 to 2026:193:03:15:55.500
2026-07-27 08:34:09,340 get_mon_dataset: Getting MON data from 2026:193:04:09:59.625 to 2026:193:04:49:00.725
2026-07-27 08:34:09,340 get_aca_images_cached: Getting ACA images from 2026:193:04:09:59.625 to 2026:193:04:49:00.725
2026-07-27 08:34:09,572 get_mon_dataset: Getting MON data from 2026:195:21:22:20.016 to 2026:195:21:46:36.541
2026-07-27 08:34:09,572 get_aca_images_cached: Getting ACA images from 2026:195:21:22:20.016 to 2026:195:21:46:36.541
2026-07-27 08:34:09,773 get_mon_dataset: Getting MON data from 2026:198:12:19:09.081 to 2026:198:12:26:20.606
2026-07-27 08:34:09,773 get_aca_images_cached: Getting ACA images from 2026:198:12:19:09.081 to 2026:198:12:26:20.606
2026-07-27 08:34:09,824 get_mon_dataset: Not enough images for slot 0 found 0)
2026-07-27 08:34:09,825 get_mon_dataset: Not enough images for slot 1 found 0)
2026-07-27 08:34:09,825 get_mon_dataset: Not enough images for slot 2 found 0)
2026-07-27 08:34:09,826 get_mon_dataset: Not enough images for slot 3 found 0)
2026-07-27 08:34:09,827 get_mon_dataset: Not enough images for slot 4 found 0)
2026-07-27 08:34:09,828 get_mon_dataset: Not enough images for slot 5 found 0)
2026-07-27 08:34:09,829 get_mon_dataset: Not enough images for slot 6 found 0)
2026-07-27 08:34:09,830 get_mon_dataset: Not enough images for slot 7 found 0)
2026-07-27 08:34:09,831 get_mon_dataset: Getting MON data from 2026:201:01:55:12.971 to 2026:201:02:25:55.921
2026-07-27 08:34:09,831 get_aca_images_cached: Getting ACA images from 2026:201:01:55:12.971 to 2026:201:02:25:55.921
2026-07-27 08:34:10,165 get_mon_dataset: Getting MON data from 2026:201:03:46:38.021 to 2026:201:04:25:55.521
2026-07-27 08:34:10,165 get_aca_images_cached: Getting ACA images from 2026:201:03:46:38.021 to 2026:201:04:25:55.521
2026-07-27 08:34:10,374 get_mon_dataset: Getting MON data from 2026:203:16:09:47.211 to 2026:203:16:40:55.786
2026-07-27 08:34:10,374 get_aca_images_cached: Getting ACA images from 2026:203:16:09:47.211 to 2026:203:16:40:55.786
2026-07-27 08:34:10,573 get_mon_dataset: Getting MON data from 2026:203:17:33:04.086 to 2026:203:18:05:56.186
2026-07-27 08:34:10,573 get_aca_images_cached: Getting ACA images from 2026:203:17:33:04.086 to 2026:203:18:05:56.186
2026-07-27 08:34:10,776 get_mon_dataset: Getting MON data from 2026:203:18:44:10.136 to 2026:203:18:51:21.661
2026-07-27 08:34:10,776 get_aca_images_cached: Getting ACA images from 2026:203:18:44:10.136 to 2026:203:18:51:21.661
2026-07-27 08:34:10,804 get_mon_dataset: Not enough images for slot 0 found 0)
2026-07-27 08:34:10,805 get_mon_dataset: Not enough images for slot 1 found 0)
2026-07-27 08:34:10,806 get_mon_dataset: Not enough images for slot 2 found 0)
2026-07-27 08:34:10,807 get_mon_dataset: Not enough images for slot 3 found 0)
2026-07-27 08:34:10,808 get_mon_dataset: Not enough images for slot 4 found 0)
2026-07-27 08:34:10,809 get_mon_dataset: Not enough images for slot 5 found 0)
2026-07-27 08:34:10,810 get_mon_dataset: Not enough images for slot 6 found 0)
2026-07-27 08:34:10,811 get_mon_dataset: Not enough images for slot 7 found 0)
2026-07-27 08:34:10,812 get_mon_dataset: Getting MON data from 2026:203:19:20:22.111 to 2026:203:19:55:56.162
2026-07-27 08:34:10,812 get_aca_images_cached: Getting ACA images from 2026:203:19:20:22.111 to 2026:203:19:55:56.162
2026-07-27 08:34:11,034 get_mon_dataset: Getting MON data from 2026:206:07:44:09.226 to 2026:206:08:15:55.726
2026-07-27 08:34:11,034 get_aca_images_cached: Getting ACA images from 2026:206:07:44:09.226 to 2026:206:08:15:55.726
2026-07-27 08:34:11,296 get_mon_dataset: Getting MON data from 2026:206:08:52:34.351 to 2026:206:09:25:56.176
2026-07-27 08:34:11,296 get_aca_images_cached: Getting ACA images from 2026:206:08:52:34.351 to 2026:206:09:25:56.176
2026-07-27 08:34:11,507 get_mon_dataset: Getting MON data from 2026:206:10:39:37.002 to 2026:206:11:25:55.777
2026-07-27 08:34:11,507 get_aca_images_cached: Getting ACA images from 2026:206:10:39:37.002 to 2026:206:11:25:55.777
2026-07-27 08:34:11,740 get_kalman_drops_nman: processing NMAN data
2026-07-27 08:34:11,795 get_kalman_drops_nman: Skipping NMAN from 2026:182:12:11:40.989 to 2026:182:12:45:56.114 due to insufficient monitor window data within 100 minutes of perigee
2026-07-27 08:34:11,890 get_kalman_drops_nman: Skipping NMAN from 2026:195:21:22:20.016 to 2026:195:21:46:36.541 due to insufficient monitor window data within 100 minutes of perigee
2026-07-27 07:34:12,797 _get_tlm: Getting telemetry for 2026:164:02:02:28.112
2026-07-27 07:34:13,063 obss: Getting observations from kadi commands for 2026/Jun-13
2026-07-27 07:34:13,075 _get_tlm: Getting telemetry for 2026:166:17:31:53.459
2026-07-27 07:34:13,317 obss: Getting observations from kadi commands for 2026/Jun-15
2026-07-27 07:34:13,338 _get_tlm: Getting telemetry for 2026:169:09:00:49.551
2026-07-27 07:34:13,591 obss: Getting observations from kadi commands for 2026/Jun-18
2026-07-27 07:34:13,603 _get_tlm: Getting telemetry for 2026:172:00:28:55.299
2026-07-27 07:34:13,860 obss: Getting observations from kadi commands for 2026/Jun-21
2026-07-27 07:34:13,875 _get_tlm: Getting telemetry for 2026:174:15:56:43.956
2026-07-27 07:34:14,135 obss: Getting observations from kadi commands for 2026/Jun-23
2026-07-27 07:34:14,148 _get_tlm: Getting telemetry for 2026:177:07:24:39.671
2026-07-27 07:34:14,389 obss: Getting observations from kadi commands for 2026/Jun-26
2026-07-27 07:34:14,403 _get_tlm: Getting telemetry for 2026:179:22:52:53.972
2026-07-27 07:34:14,633 obss: Getting observations from kadi commands for 2026/Jun-28
2026-07-27 07:34:14,649 _get_tlm: Getting telemetry for 2026:182:14:21:06.581
2026-07-27 07:34:14,899 obss: Getting observations from kadi commands for 2026/Jul-01
2026-07-27 07:34:14,914 _get_tlm: Getting telemetry for 2026:185:05:48:58.192
2026-07-27 07:34:15,155 obss: Getting observations from kadi commands for 2026/Jul-04
2026-07-27 07:34:15,169 _get_tlm: Getting telemetry for 2026:187:21:16:49.234
2026-07-27 07:34:15,403 obss: Getting observations from kadi commands for 2026/Jul-06
2026-07-27 07:34:15,413 _get_tlm: Getting telemetry for 2026:190:12:45:16.694
2026-07-27 07:34:15,638 obss: Getting observations from kadi commands for 2026/Jul-09
2026-07-27 07:34:15,648 _get_tlm: Getting telemetry for 2026:193:04:14:27.793
2026-07-27 07:34:15,885 obss: Getting observations from kadi commands for 2026/Jul-12
2026-07-27 07:34:15,897 _get_tlm: Getting telemetry for 2026:195:19:43:35.299
2026-07-27 07:34:16,137 obss: Getting observations from kadi commands for 2026/Jul-14
2026-07-27 07:34:16,152 _get_tlm: Getting telemetry for 2026:198:11:11:46.111
2026-07-27 07:34:16,400 obss: Getting observations from kadi commands for 2026/Jul-17
2026-07-27 07:34:16,415 _get_tlm: Getting telemetry for 2026:201:02:39:24.314
2026-07-27 07:34:16,654 obss: Getting observations from kadi commands for 2026/Jul-20
2026-07-27 07:34:16,666 _get_tlm: Getting telemetry for 2026:203:18:07:06.114
2026-07-27 07:34:16,909 obss: Getting observations from kadi commands for 2026/Jul-22
2026-07-27 07:34:16,919 _get_tlm: Getting telemetry for 2026:206:09:35:05.546
2026-07-27 07:34:17,154 obss: Getting observations from kadi commands for 2026/Jul-25
2026-07-27 07:34:25,922 get_color_marker_for_perigee_plotly: Perigee 2026:164:02:02:28.112 color='rgb(229, 134, 6)' marker='circle'
2026-07-27 07:34:25,922 get_color_marker_for_perigee_plotly: Perigee 2026:166:17:31:53.459 color='rgb(93, 105, 177)' marker='square'
2026-07-27 07:34:25,922 get_color_marker_for_perigee_plotly: Perigee 2026:169:09:00:49.551 color='rgb(82, 188, 163)' marker='diamond'
2026-07-27 07:34:25,923 get_color_marker_for_perigee_plotly: Perigee 2026:172:00:28:55.299 color='rgb(153, 201, 69)' marker='triangle-up'
2026-07-27 07:34:25,923 get_color_marker_for_perigee_plotly: Perigee 2026:174:15:56:43.956 color='rgb(204, 97, 176)' marker='triangle-down'
2026-07-27 07:34:25,923 get_color_marker_for_perigee_plotly: Perigee 2026:177:07:24:39.671 color='rgb(36, 121, 108)' marker='triangle-left'
2026-07-27 07:34:25,923 get_color_marker_for_perigee_plotly: Perigee 2026:179:22:52:53.972 color='rgb(218, 165, 27)' marker='triangle-right'
2026-07-27 07:34:25,923 get_color_marker_for_perigee_plotly: Perigee 2026:182:14:21:06.581 color='rgb(47, 138, 196)' marker='circle'
2026-07-27 07:34:25,924 get_color_marker_for_perigee_plotly: Perigee 2026:185:05:48:58.192 color='rgb(118, 78, 159)' marker='square'
2026-07-27 07:34:25,924 get_color_marker_for_perigee_plotly: Perigee 2026:187:21:16:49.234 color='rgb(237, 100, 90)' marker='diamond'
2026-07-27 07:34:25,924 get_color_marker_for_perigee_plotly: Perigee 2026:190:12:45:16.694 color='rgb(165, 170, 153)' marker='triangle-up'
2026-07-27 07:34:25,924 get_color_marker_for_perigee_plotly: Perigee 2026:193:04:14:27.793 color='rgb(229, 134, 6)' marker='triangle-down'
2026-07-27 07:34:25,925 get_color_marker_for_perigee_plotly: Perigee 2026:195:19:43:35.299 color='rgb(93, 105, 177)' marker='triangle-left'
2026-07-27 07:34:25,925 get_color_marker_for_perigee_plotly: Perigee 2026:198:11:11:46.111 color='rgb(82, 188, 163)' marker='triangle-right'
2026-07-27 07:34:25,925 get_color_marker_for_perigee_plotly: Perigee 2026:201:02:39:24.314 color='rgb(153, 201, 69)' marker='circle'
2026-07-27 07:34:25,925 get_color_marker_for_perigee_plotly: Perigee 2026:203:18:07:06.114 color='rgb(204, 97, 176)' marker='square'
2026-07-27 07:34:25,926 get_color_marker_for_perigee_plotly: Perigee 2026:206:09:35:05.546 color='rgb(36, 121, 108)' marker='diamond'
2026-07-27 07:34:25,926 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-07-27 07:34:26,726 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-07-27 08:34:29,714 main: Overriding starting time with the time of latest low-kalman event
2026-07-27 08:34:29,714 get_lowkals_new: Getting telemetry between 2026:207:00:49:19.984 and 2026:208:12:34:29.707
2026-07-27 08:34:29,981 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
2026-07-27 08:34:29,984 main: Updating events file /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-07-27 08:34:30,306 make_web_page: Writing HTML to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/index.html
2026:207:00:49:19.984 2026:208:12:34:29.707