Prev
Index
Next
kalman_watch3: Mon Jun 22 08:34:26 2026
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kalman_watch3 |
NOT OK
|
0.09 | 1.0 |
Mon Jun 22 08:34:26 2026 |
Errors:
- Line 169: 2026-06-22 08:34:25,460 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
File contents:
2026-06-22 08:31:18,551 log_run_info: ******************************************
2026-06-22 08:31:18,551 log_run_info: Running: /proj/sot/ska3/aca-test/lib/python3.13/site-packages/kalman_watch/kalman_perigee_mon.py
2026-06-22 08:31:18,551 log_run_info: Version: 0.6.2
2026-06-22 08:31:18,551 log_run_info: Time: Mon Jun 22 08:31:18 2026
2026-06-22 08:31:18,551 log_run_info: User: aca
2026-06-22 08:31:18,551 log_run_info: Machine: kady.cfa.harvard.edu
2026-06-22 08:31:18,551 log_run_info: Processing args:
2026-06-22 08:31:18,551 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3'),
2026-06-22 08:31:18,551 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-06-22 08:31:18,551 log_run_info: 'lookback': 14,
2026-06-22 08:31:18,551 log_run_info: 'make_html': True,
2026-06-22 08:31:18,551 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca-test/data/stk/radiation_data.fits'),
2026-06-22 08:31:18,551 log_run_info: 'stop': None}
2026-06-22 08:31:18,551 log_run_info: ******************************************
2026-06-22 08:31:18,554 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-06-22 08:31:18,573 get_evts_perigee: Getting perigee events between 2026:159:12:31:18.551 and 2026:173:12:31:18.551
2026-06-22 08:31:20,214 _get_tlm: Getting telemetry for 2026:172:00:28:55.299
2026-06-22 08:31:20,822 get_evts_perigee: No TLM found for perigee event at 2026:172:00:28:55.299, skipping
2026-06-22 08:31:20,823 get_evts_perigee: Found 0 new perigee event(s)
2026-06-22 08:31:20,823 main: No new perigee events, exiting
2026-06-22 08:31:27,012 get_manvrs_perigee: Getting maneuvers from 2026:128:12:31:27.011 to 2026:172:12:31:27.012
2026-06-22 08:31:31,125 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:128:12:31:27.011 to 2026:172:12:31:27.012
2026-06-22 08:31:39,461 get_manvrs_perigee: Excluding Earth block from 2026:135:04:04:15.517 to 2026:135:04:11:26.017
2026-06-22 08:31:39,461 get_manvrs_perigee: Excluding Earth block from 2026:137:16:31:36.856 to 2026:137:16:41:20.081
2026-06-22 08:31:39,462 get_manvrs_perigee: Excluding Earth block from 2026:150:19:35:15.807 to 2026:150:19:45:28.757
2026-06-22 08:31:39,462 get_manvrs_perigee: Excluding Earth block from 2026:153:12:31:07.072 to 2026:153:12:50:15.072
2026-06-22 08:31:39,462 get_manvrs_perigee: Excluding Earth block from 2026:158:19:11:22.427 to 2026:158:20:02:05.653
2026-06-22 08:31:39,462 get_manvrs_perigee: Excluding Earth block from 2026:161:16:09:23.069 to 2026:161:16:16:05.894
2026-06-22 08:31:39,462 get_manvrs_perigee: Excluding Earth block from 2026:169:08:42:16.338 to 2026:169:09:30:24.788
2026-06-22 08:31:39,527 get_mon_dataset: Getting MON data from 2026:129:15:41:47.360 to 2026:129:16:15:55.310
2026-06-22 08:31:39,527 get_aca_images_cached: Getting ACA images from 2026:129:15:41:47.360 to 2026:129:16:15:55.310
2026-06-22 08:31:39,755 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-06-22 08:34:01,807 get_mon_dataset: Getting MON data from 2026:132:06:21:37.575 to 2026:132:06:55:55.775
2026-06-22 08:34:01,807 get_aca_images_cached: Getting ACA images from 2026:132:06:21:37.575 to 2026:132:06:55:55.775
2026-06-22 08:34:02,038 get_mon_dataset: Getting MON data from 2026:132:07:49:59.900 to 2026:132:08:03:13.250
2026-06-22 08:34:02,038 get_aca_images_cached: Getting ACA images from 2026:132:07:49:59.900 to 2026:132:08:03:13.250
2026-06-22 08:34:02,210 get_mon_dataset: Getting MON data from 2026:134:23:52:06.516 to 2026:135:00:25:56.016
2026-06-22 08:34:02,210 get_aca_images_cached: Getting ACA images from 2026:134:23:52:06.516 to 2026:135:00:25:56.016
2026-06-22 08:34:02,420 get_mon_dataset: Getting MON data from 2026:137:13:19:54.305 to 2026:137:13:55:56.030
2026-06-22 08:34:02,420 get_aca_images_cached: Getting ACA images from 2026:137:13:19:54.305 to 2026:137:13:55:56.030
2026-06-22 08:34:02,650 get_mon_dataset: Getting MON data from 2026:137:16:19:53.706 to 2026:137:16:31:36.856
2026-06-22 08:34:02,650 get_aca_images_cached: Getting ACA images from 2026:137:16:19:53.706 to 2026:137:16:31:36.856
2026-06-22 08:34:02,819 get_mon_dataset: Getting MON data from 2026:137:16:41:20.081 to 2026:137:16:55:55.431
2026-06-22 08:34:02,819 get_aca_images_cached: Getting ACA images from 2026:137:16:41:20.081 to 2026:137:16:55:55.431
2026-06-22 08:34:03,220 get_mon_dataset: Getting MON data from 2026:140:07:54:55.696 to 2026:140:08:25:56.071
2026-06-22 08:34:03,220 get_aca_images_cached: Getting ACA images from 2026:140:07:54:55.696 to 2026:140:08:25:56.071
2026-06-22 08:34:03,409 get_mon_dataset: Getting MON data from 2026:142:22:59:13.711 to 2026:142:23:35:55.411
2026-06-22 08:34:03,409 get_aca_images_cached: Getting ACA images from 2026:142:22:59:13.711 to 2026:142:23:35:55.411
2026-06-22 08:34:03,605 get_mon_dataset: Getting MON data from 2026:145:13:23:01.451 to 2026:145:13:55:55.601
2026-06-22 08:34:03,606 get_aca_images_cached: Getting ACA images from 2026:145:13:23:01.451 to 2026:145:13:55:55.601
2026-06-22 08:34:03,794 get_mon_dataset: Getting MON data from 2026:145:15:03:01.802 to 2026:145:15:35:55.952
2026-06-22 08:34:03,795 get_aca_images_cached: Getting ACA images from 2026:145:15:03:01.802 to 2026:145:15:35:55.952
2026-06-22 08:34:03,990 get_mon_dataset: Getting MON data from 2026:148:03:54:33.516 to 2026:148:04:45:55.691
2026-06-22 08:34:03,990 get_aca_images_cached: Getting ACA images from 2026:148:03:54:33.516 to 2026:148:04:45:55.691
2026-06-22 08:34:04,214 get_mon_dataset: Getting MON data from 2026:148:05:21:42.042 to 2026:148:05:55:56.142
2026-06-22 08:34:04,214 get_aca_images_cached: Getting ACA images from 2026:148:05:21:42.042 to 2026:148:05:55:56.142
2026-06-22 08:34:04,412 get_mon_dataset: Getting MON data from 2026:150:19:09:09.606 to 2026:150:19:35:15.807
2026-06-22 08:34:04,412 get_aca_images_cached: Getting ACA images from 2026:150:19:09:09.606 to 2026:150:19:35:15.807
2026-06-22 08:34:04,597 get_mon_dataset: Getting MON data from 2026:150:19:45:28.757 to 2026:150:19:55:56.057
2026-06-22 08:34:04,597 get_aca_images_cached: Getting ACA images from 2026:150:19:45:28.757 to 2026:150:19:55:56.057
2026-06-22 08:34:04,773 get_mon_dataset: Getting MON data from 2026:153:10:33:29.947 to 2026:153:10:55:55.772
2026-06-22 08:34:04,773 get_aca_images_cached: Getting ACA images from 2026:153:10:33:29.947 to 2026:153:10:55:55.772
2026-06-22 08:34:04,974 get_mon_dataset: Getting MON data from 2026:153:12:28:16.922 to 2026:153:12:31:07.072
2026-06-22 08:34:04,974 get_aca_images_cached: Getting ACA images from 2026:153:12:28:16.922 to 2026:153:12:31:07.072
2026-06-22 08:34:05,144 get_mon_dataset: Getting MON data from 2026:153:12:50:15.072 to 2026:153:12:50:56.072
2026-06-22 08:34:05,145 get_aca_images_cached: Getting ACA images from 2026:153:12:50:15.072 to 2026:153:12:50:56.072
2026-06-22 08:34:05,171 get_mon_dataset: Not enough images for slot 0 found 6)
2026-06-22 08:34:05,171 get_mon_dataset: Not enough images for slot 1 found 6)
2026-06-22 08:34:05,172 get_mon_dataset: Not enough images for slot 2 found 6)
2026-06-22 08:34:05,173 get_mon_dataset: Not enough images for slot 3 found 6)
2026-06-22 08:34:05,174 get_mon_dataset: Not enough images for slot 4 found 6)
2026-06-22 08:34:05,174 get_mon_dataset: Not enough images for slot 5 found 6)
2026-06-22 08:34:05,175 get_mon_dataset: Not enough images for slot 6 found 6)
2026-06-22 08:34:05,176 get_mon_dataset: Not enough images for slot 7 found 6)
2026-06-22 08:34:05,177 get_mon_dataset: Getting MON data from 2026:153:13:45:00.197 to 2026:153:14:14:04.748
2026-06-22 08:34:05,177 get_aca_images_cached: Getting ACA images from 2026:153:13:45:00.197 to 2026:153:14:14:04.748
2026-06-22 08:34:05,384 get_mon_dataset: Getting MON data from 2026:156:02:24:07.762 to 2026:156:02:55:56.312
2026-06-22 08:34:05,384 get_aca_images_cached: Getting ACA images from 2026:156:02:24:07.762 to 2026:156:02:55:56.312
2026-06-22 08:34:05,595 get_mon_dataset: Getting MON data from 2026:156:03:50:00.437 to 2026:156:04:09:56.612
2026-06-22 08:34:05,595 get_aca_images_cached: Getting ACA images from 2026:156:03:50:00.437 to 2026:156:04:09:56.612
2026-06-22 08:34:05,807 get_mon_dataset: Getting MON data from 2026:158:17:45:50.252 to 2026:158:18:10:55.977
2026-06-22 08:34:05,808 get_aca_images_cached: Getting ACA images from 2026:158:17:45:50.252 to 2026:158:18:10:55.977
2026-06-22 08:34:06,133 get_mon_dataset: Getting MON data from 2026:158:19:05:00.102 to 2026:158:19:11:22.427
2026-06-22 08:34:06,133 get_aca_images_cached: Getting ACA images from 2026:158:19:05:00.102 to 2026:158:19:11:22.427
2026-06-22 08:34:06,339 get_mon_dataset: Getting MON data from 2026:158:20:02:05.653 to 2026:158:20:03:25.603
2026-06-22 08:34:06,339 get_aca_images_cached: Getting ACA images from 2026:158:20:02:05.653 to 2026:158:20:03:25.603
2026-06-22 08:34:06,535 get_mon_dataset: Getting MON data from 2026:158:20:23:11.528 to 2026:158:20:51:03.303
2026-06-22 08:34:06,535 get_aca_images_cached: Getting ACA images from 2026:158:20:23:11.528 to 2026:158:20:51:03.303
2026-06-22 08:34:07,063 get_mon_dataset: Getting MON data from 2026:161:10:24:24.218 to 2026:161:10:55:56.368
2026-06-22 08:34:07,063 get_aca_images_cached: Getting ACA images from 2026:161:10:24:24.218 to 2026:161:10:55:56.368
2026-06-22 08:34:07,266 get_mon_dataset: Getting MON data from 2026:161:11:50:00.493 to 2026:161:12:29:27.218
2026-06-22 08:34:07,266 get_aca_images_cached: Getting ACA images from 2026:161:11:50:00.493 to 2026:161:12:29:27.218
2026-06-22 08:34:07,483 get_mon_dataset: Getting MON data from 2026:164:00:55:52.183 to 2026:164:01:25:56.183
2026-06-22 08:34:07,483 get_aca_images_cached: Getting ACA images from 2026:164:00:55:52.183 to 2026:164:01:25:56.183
2026-06-22 08:34:07,684 get_mon_dataset: Getting MON data from 2026:164:02:20:00.308 to 2026:164:03:00:34.683
2026-06-22 08:34:07,684 get_aca_images_cached: Getting ACA images from 2026:164:02:20:00.308 to 2026:164:03:00:34.683
2026-06-22 08:34:07,895 get_mon_dataset: Getting MON data from 2026:169:07:07:36.813 to 2026:169:07:34:30.163
2026-06-22 08:34:07,895 get_aca_images_cached: Getting ACA images from 2026:169:07:07:36.813 to 2026:169:07:34:30.163
2026-06-22 08:34:08,092 get_mon_dataset: Getting MON data from 2026:169:08:41:30.213 to 2026:169:08:42:16.338
2026-06-22 08:34:08,092 get_aca_images_cached: Getting ACA images from 2026:169:08:41:30.213 to 2026:169:08:42:16.338
2026-06-22 08:34:08,113 get_mon_dataset: Not enough images for slot 0 found 8)
2026-06-22 08:34:08,114 get_mon_dataset: Not enough images for slot 1 found 8)
2026-06-22 08:34:08,115 get_mon_dataset: Not enough images for slot 2 found 8)
2026-06-22 08:34:08,115 get_mon_dataset: Not enough images for slot 3 found 8)
2026-06-22 08:34:08,116 get_mon_dataset: Not enough images for slot 4 found 8)
2026-06-22 08:34:08,117 get_mon_dataset: Not enough images for slot 5 found 8)
2026-06-22 08:34:08,118 get_mon_dataset: Not enough images for slot 6 found 8)
2026-06-22 08:34:08,118 get_mon_dataset: Not enough images for slot 7 found 8)
2026-06-22 08:34:08,119 get_mon_dataset: Getting MON data from 2026:169:09:30:24.788 to 2026:169:09:39:55.713
2026-06-22 08:34:08,119 get_aca_images_cached: Getting ACA images from 2026:169:09:30:24.788 to 2026:169:09:39:55.713
2026-06-22 08:34:08,302 get_kalman_drops_nman: processing NMAN data
2026-06-22 08:34:08,442 get_kalman_drops_nman: Skipping NMAN from 2026:153:12:28:16.922 to 2026:153:12:31:07.072 due to insufficient monitor window data within 100 minutes of perigee
2026-06-22 08:34:08,448 get_kalman_drops_nman: Skipping NMAN from 2026:153:13:45:00.197 to 2026:153:14:14:04.748 due to insufficient monitor window data within 100 minutes of perigee
2026-06-22 08:34:08,483 get_kalman_drops_nman: Skipping NMAN from 2026:158:20:02:05.653 to 2026:158:20:03:25.603 due to insufficient monitor window data within 100 minutes of perigee
2026-06-22 07:34:09,360 _get_tlm: Getting telemetry for 2026:129:16:55:10.350
2026-06-22 07:34:09,630 obss: Getting observations from kadi commands for 2026/May-09
2026-06-22 07:34:09,644 _get_tlm: Getting telemetry for 2026:132:08:22:42.333
2026-06-22 07:34:09,919 obss: Getting observations from kadi commands for 2026/May-12
2026-06-22 07:34:09,934 _get_tlm: Getting telemetry for 2026:134:23:50:42.107
2026-06-22 07:34:10,191 obss: Getting observations from kadi commands for 2026/May-14
2026-06-22 07:34:10,204 _get_tlm: Getting telemetry for 2026:137:15:19:44.784
2026-06-22 07:34:10,467 obss: Getting observations from kadi commands for 2026/May-17
2026-06-22 07:34:10,479 _get_tlm: Getting telemetry for 2026:140:06:49:00.062
2026-06-22 07:34:10,742 obss: Getting observations from kadi commands for 2026/May-20
2026-06-22 07:34:10,756 _get_tlm: Getting telemetry for 2026:142:22:17:36.040
2026-06-22 07:34:11,012 obss: Getting observations from kadi commands for 2026/May-22
2026-06-22 07:34:11,026 _get_tlm: Getting telemetry for 2026:145:13:45:34.840
2026-06-22 07:34:11,571 obss: Getting observations from kadi commands for 2026/May-25
2026-06-22 07:34:11,583 _get_tlm: Getting telemetry for 2026:148:05:13:21.213
2026-06-22 07:34:11,834 obss: Getting observations from kadi commands for 2026/May-28
2026-06-22 07:34:11,844 _get_tlm: Getting telemetry for 2026:150:20:41:23.454
2026-06-22 07:34:12,103 obss: Getting observations from kadi commands for 2026/May-30
2026-06-22 07:34:12,116 _get_tlm: Getting telemetry for 2026:153:12:09:40.189
2026-06-22 07:34:12,375 obss: Getting observations from kadi commands for 2026/Jun-02
2026-06-22 07:34:12,388 _get_tlm: Getting telemetry for 2026:156:03:37:49.671
2026-06-22 07:34:12,662 obss: Getting observations from kadi commands for 2026/Jun-05
2026-06-22 07:34:12,675 _get_tlm: Getting telemetry for 2026:158:19:05:39.194
2026-06-22 07:34:12,931 obss: Getting observations from kadi commands for 2026/Jun-07
2026-06-22 07:34:12,941 _get_tlm: Getting telemetry for 2026:161:10:33:38.945
2026-06-22 07:34:13,196 obss: Getting observations from kadi commands for 2026/Jun-10
2026-06-22 07:34:13,209 _get_tlm: Getting telemetry for 2026:164:02:02:28.112
2026-06-22 07:34:13,473 obss: Getting observations from kadi commands for 2026/Jun-13
2026-06-22 07:34:13,484 _get_tlm: Getting telemetry for 2026:166:17:31:53.459
2026-06-22 07:34:13,730 obss: Getting observations from kadi commands for 2026/Jun-15
2026-06-22 07:34:13,746 _get_tlm: Getting telemetry for 2026:169:09:00:49.551
2026-06-22 07:34:13,988 obss: Getting observations from kadi commands for 2026/Jun-18
2026-06-22 07:34:14,000 _get_tlm: Getting telemetry for 2026:172:00:28:55.299
2026-06-22 07:34:14,205 get_kalman_drops_npnt: No telemetry for perigee 2026:172:00:28:55.299
2026-06-22 07:34:21,876 get_color_marker_for_perigee_plotly: Perigee 2026:129:16:55:10.350 color='rgb(229, 134, 6)' marker='circle'
2026-06-22 07:34:21,876 get_color_marker_for_perigee_plotly: Perigee 2026:132:08:22:42.333 color='rgb(93, 105, 177)' marker='square'
2026-06-22 07:34:21,876 get_color_marker_for_perigee_plotly: Perigee 2026:134:23:50:42.107 color='rgb(82, 188, 163)' marker='diamond'
2026-06-22 07:34:21,876 get_color_marker_for_perigee_plotly: Perigee 2026:137:15:19:44.784 color='rgb(153, 201, 69)' marker='triangle-up'
2026-06-22 07:34:21,877 get_color_marker_for_perigee_plotly: Perigee 2026:140:06:49:00.062 color='rgb(204, 97, 176)' marker='triangle-down'
2026-06-22 07:34:21,877 get_color_marker_for_perigee_plotly: Perigee 2026:142:22:17:36.040 color='rgb(36, 121, 108)' marker='triangle-left'
2026-06-22 07:34:21,877 get_color_marker_for_perigee_plotly: Perigee 2026:145:13:45:34.840 color='rgb(218, 165, 27)' marker='triangle-right'
2026-06-22 07:34:21,877 get_color_marker_for_perigee_plotly: Perigee 2026:148:05:13:21.213 color='rgb(47, 138, 196)' marker='circle'
2026-06-22 07:34:21,877 get_color_marker_for_perigee_plotly: Perigee 2026:150:20:41:23.454 color='rgb(118, 78, 159)' marker='square'
2026-06-22 07:34:21,878 get_color_marker_for_perigee_plotly: Perigee 2026:153:12:09:40.189 color='rgb(237, 100, 90)' marker='diamond'
2026-06-22 07:34:21,878 get_color_marker_for_perigee_plotly: Perigee 2026:156:03:37:49.671 color='rgb(165, 170, 153)' marker='triangle-up'
2026-06-22 07:34:21,878 get_color_marker_for_perigee_plotly: Perigee 2026:158:19:05:39.194 color='rgb(229, 134, 6)' marker='triangle-down'
2026-06-22 07:34:21,878 get_color_marker_for_perigee_plotly: Perigee 2026:161:10:33:38.945 color='rgb(93, 105, 177)' marker='triangle-left'
2026-06-22 07:34:21,878 get_color_marker_for_perigee_plotly: Perigee 2026:164:02:02:28.112 color='rgb(82, 188, 163)' marker='triangle-right'
2026-06-22 07:34:21,879 get_color_marker_for_perigee_plotly: Perigee 2026:166:17:31:53.459 color='rgb(153, 201, 69)' marker='circle'
2026-06-22 07:34:21,879 get_color_marker_for_perigee_plotly: Perigee 2026:169:09:00:49.551 color='rgb(204, 97, 176)' marker='square'
2026-06-22 07:34:21,879 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-06-22 07:34:21,884 plot_mon_win_and_aokalstr_composite_plotly: Skipping prediction for 2026:172:00:28:55.299 because there is no observed data
2026-06-22 07:34:22,328 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-06-22 08:34:25,201 main: Overriding starting time with the time of latest low-kalman event
2026-06-22 08:34:25,201 get_lowkals_new: Getting telemetry between 2026:171:16:42:18.982 and 2026:173:12:34:25.192
2026-06-22 08:34:25,460 get_lowkals_new: WARNING: Not enough data to find low Kalman intervals
2026-06-22 08:34:25,463 main: Updating events file /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-06-22 08:34:25,789 make_web_page: Writing HTML to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/index.html
2026:171:16:42:18.982 2026:173:12:34:25.192