Prev
Index
Next
kalman_watch3: Fri Jun 5 08:34:31 2026
File: /proj/sot/ska/data/kalman_watch3/logs/daily.0/kalman_watch.log
| Task | Status | Age | MaxAge | Last Date |
|---|
| kalman_watch3 |
NOT OK
|
0.09 | 1.0 |
Fri Jun 5 08:34:31 2026 |
Errors:
- Line 153: 2026-06-05 08:34:30,775 get_lowkals_new: WARNING: Fewer than two kalman stars at 2026:155:21:47:56.581 for 69.7 secs
File contents:
2026-06-05 08:31:20,544 log_run_info: ******************************************
2026-06-05 08:31:20,544 log_run_info: Running: /proj/sot/ska3/aca-test/lib/python3.13/site-packages/kalman_watch/kalman_perigee_mon.py
2026-06-05 08:31:20,544 log_run_info: Version: 0.6.2
2026-06-05 08:31:20,544 log_run_info: Time: Fri Jun 5 08:31:20 2026
2026-06-05 08:31:20,544 log_run_info: User: aca
2026-06-05 08:31:20,544 log_run_info: Machine: kady.cfa.harvard.edu
2026-06-05 08:31:20,544 log_run_info: Processing args:
2026-06-05 08:31:20,544 log_run_info: {'data_dir': PosixPath('/proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3'),
2026-06-05 08:31:20,544 log_run_info: 'emails': ['aca_alert@cfa.harvard.edu'],
2026-06-05 08:31:20,544 log_run_info: 'lookback': 14,
2026-06-05 08:31:20,544 log_run_info: 'make_html': True,
2026-06-05 08:31:20,544 log_run_info: 'rad_data': PosixPath('/proj/sot/ska3/aca-test/data/stk/radiation_data.fits'),
2026-06-05 08:31:20,544 log_run_info: 'stop': None}
2026-06-05 08:31:20,544 log_run_info: ******************************************
2026-06-05 08:31:20,547 read_kalman_stats: Reading kalman perigee data from /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/perigees/kalman_perigees.ecsv
2026-06-05 08:31:20,866 get_evts_perigee: Getting perigee events between 2026:142:12:31:20.545 and 2026:156:12:31:20.545
2026-06-05 08:31:24,513 _get_tlm: Getting telemetry for 2026:156:03:37:49.671
2026-06-05 08:31:26,207 get_evts_perigee: No TLM found for perigee event at 2026:156:03:37:49.671, skipping
2026-06-05 08:31:26,207 get_evts_perigee: Found 0 new perigee event(s)
2026-06-05 08:31:26,207 main: No new perigee events, exiting
2026-06-05 08:31:30,349 get_manvrs_perigee: Getting maneuvers from 2026:111:12:31:30.348 to 2026:155:12:31:30.349
2026-06-05 08:31:33,854 get_manvrs_perigee: Getting intervals of Earth blocks from 2026:111:12:31:30.348 to 2026:155:12:31:30.349
2026-06-05 08:31:42,661 get_manvrs_perigee: Excluding Earth block from 2026:124:06:38:29.679 to 2026:124:06:46:28.354
2026-06-05 08:31:42,661 get_manvrs_perigee: Excluding Earth block from 2026:126:21:40:02.669 to 2026:126:21:47:49.044
2026-06-05 08:31:42,661 get_manvrs_perigee: Excluding Earth block from 2026:135:04:04:15.517 to 2026:135:04:11:26.017
2026-06-05 08:31:42,661 get_manvrs_perigee: Excluding Earth block from 2026:137:16:31:36.856 to 2026:137:16:41:20.081
2026-06-05 08:31:42,661 get_manvrs_perigee: Excluding Earth block from 2026:150:19:35:15.807 to 2026:150:19:45:28.757
2026-06-05 08:31:42,661 get_manvrs_perigee: Excluding Earth block from 2026:153:12:31:07.072 to 2026:153:12:50:15.072
2026-06-05 08:31:42,722 get_mon_dataset: Getting MON data from 2026:113:21:22:35.944 to 2026:113:21:54:56.270
2026-06-05 08:31:42,722 get_aca_images_cached: Getting ACA images from 2026:113:21:22:35.944 to 2026:113:21:54:56.270
2026-06-05 08:31:42,934 get_ir_thresholds: Getting IR thresholds from 2023:100 to 2023:200
2026-06-05 08:34:06,148 get_mon_dataset: Getting MON data from 2026:116:09:59:09.759 to 2026:116:10:25:55.934
2026-06-05 08:34:06,148 get_aca_images_cached: Getting ACA images from 2026:116:09:59:09.759 to 2026:116:10:25:55.934
2026-06-05 08:34:06,419 get_mon_dataset: Getting MON data from 2026:116:12:32:35.284 to 2026:116:12:55:55.435
2026-06-05 08:34:06,419 get_aca_images_cached: Getting ACA images from 2026:116:12:32:35.284 to 2026:116:12:55:55.435
2026-06-05 08:34:06,628 get_mon_dataset: Getting MON data from 2026:119:01:20:23.549 to 2026:119:01:55:55.549
2026-06-05 08:34:06,628 get_aca_images_cached: Getting ACA images from 2026:119:01:20:23.549 to 2026:119:01:55:55.549
2026-06-05 08:34:06,827 get_mon_dataset: Getting MON data from 2026:119:03:20:23.150 to 2026:119:03:55:56.175
2026-06-05 08:34:06,827 get_aca_images_cached: Getting ACA images from 2026:119:03:20:23.150 to 2026:119:03:55:56.175
2026-06-05 08:34:07,028 get_mon_dataset: Getting MON data from 2026:121:17:22:44.514 to 2026:121:17:55:56.089
2026-06-05 08:34:07,028 get_aca_images_cached: Getting ACA images from 2026:121:17:22:44.514 to 2026:121:17:55:56.089
2026-06-05 08:34:07,233 get_mon_dataset: Getting MON data from 2026:121:18:37:46.315 to 2026:121:19:10:55.840
2026-06-05 08:34:07,233 get_aca_images_cached: Getting ACA images from 2026:121:18:37:46.315 to 2026:121:19:10:55.840
2026-06-05 08:34:07,466 get_mon_dataset: Getting MON data from 2026:121:20:06:09.665 to 2026:121:20:45:55.865
2026-06-05 08:34:07,466 get_aca_images_cached: Getting ACA images from 2026:121:20:06:09.665 to 2026:121:20:45:55.865
2026-06-05 08:34:07,818 get_mon_dataset: Getting MON data from 2026:124:08:19:17.179 to 2026:124:08:55:55.805
2026-06-05 08:34:07,818 get_aca_images_cached: Getting ACA images from 2026:124:08:19:17.179 to 2026:124:08:55:55.805
2026-06-05 08:34:08,040 get_mon_dataset: Getting MON data from 2026:124:11:19:16.580 to 2026:124:11:55:56.230
2026-06-05 08:34:08,040 get_aca_images_cached: Getting ACA images from 2026:124:11:19:16.580 to 2026:124:11:55:56.230
2026-06-05 08:34:08,433 get_mon_dataset: Getting MON data from 2026:127:00:30:24.995 to 2026:127:00:55:55.320
2026-06-05 08:34:08,433 get_aca_images_cached: Getting ACA images from 2026:127:00:30:24.995 to 2026:127:00:55:55.320
2026-06-05 08:34:08,626 get_mon_dataset: Getting MON data from 2026:129:15:41:47.360 to 2026:129:16:15:55.310
2026-06-05 08:34:08,626 get_aca_images_cached: Getting ACA images from 2026:129:15:41:47.360 to 2026:129:16:15:55.310
2026-06-05 08:34:08,819 get_mon_dataset: Getting MON data from 2026:132:06:21:37.575 to 2026:132:06:55:55.775
2026-06-05 08:34:08,819 get_aca_images_cached: Getting ACA images from 2026:132:06:21:37.575 to 2026:132:06:55:55.775
2026-06-05 08:34:09,014 get_mon_dataset: Getting MON data from 2026:132:07:49:59.900 to 2026:132:08:03:13.250
2026-06-05 08:34:09,014 get_aca_images_cached: Getting ACA images from 2026:132:07:49:59.900 to 2026:132:08:03:13.250
2026-06-05 08:34:09,183 get_mon_dataset: Getting MON data from 2026:134:23:52:06.516 to 2026:135:00:25:56.016
2026-06-05 08:34:09,183 get_aca_images_cached: Getting ACA images from 2026:134:23:52:06.516 to 2026:135:00:25:56.016
2026-06-05 08:34:09,376 get_mon_dataset: Getting MON data from 2026:137:13:19:54.305 to 2026:137:13:55:56.030
2026-06-05 08:34:09,376 get_aca_images_cached: Getting ACA images from 2026:137:13:19:54.305 to 2026:137:13:55:56.030
2026-06-05 08:34:09,581 get_mon_dataset: Getting MON data from 2026:137:16:19:53.706 to 2026:137:16:31:36.856
2026-06-05 08:34:09,581 get_aca_images_cached: Getting ACA images from 2026:137:16:19:53.706 to 2026:137:16:31:36.856
2026-06-05 08:34:09,756 get_mon_dataset: Getting MON data from 2026:137:16:41:20.081 to 2026:137:16:55:55.431
2026-06-05 08:34:09,756 get_aca_images_cached: Getting ACA images from 2026:137:16:41:20.081 to 2026:137:16:55:55.431
2026-06-05 08:34:09,934 get_mon_dataset: Getting MON data from 2026:140:07:54:55.696 to 2026:140:08:25:56.071
2026-06-05 08:34:09,934 get_aca_images_cached: Getting ACA images from 2026:140:07:54:55.696 to 2026:140:08:25:56.071
2026-06-05 08:34:10,134 get_mon_dataset: Getting MON data from 2026:142:22:59:13.711 to 2026:142:23:35:55.411
2026-06-05 08:34:10,134 get_aca_images_cached: Getting ACA images from 2026:142:22:59:13.711 to 2026:142:23:35:55.411
2026-06-05 08:34:10,567 get_mon_dataset: Getting MON data from 2026:145:13:23:01.451 to 2026:145:13:55:55.601
2026-06-05 08:34:10,567 get_aca_images_cached: Getting ACA images from 2026:145:13:23:01.451 to 2026:145:13:55:55.601
2026-06-05 08:34:10,767 get_mon_dataset: Getting MON data from 2026:145:15:03:01.802 to 2026:145:15:35:55.952
2026-06-05 08:34:10,767 get_aca_images_cached: Getting ACA images from 2026:145:15:03:01.802 to 2026:145:15:35:55.952
2026-06-05 08:34:10,965 get_mon_dataset: Getting MON data from 2026:148:03:54:33.516 to 2026:148:04:45:55.691
2026-06-05 08:34:10,965 get_aca_images_cached: Getting ACA images from 2026:148:03:54:33.516 to 2026:148:04:45:55.691
2026-06-05 08:34:11,194 get_mon_dataset: Getting MON data from 2026:148:05:21:42.042 to 2026:148:05:55:56.142
2026-06-05 08:34:11,194 get_aca_images_cached: Getting ACA images from 2026:148:05:21:42.042 to 2026:148:05:55:56.142
2026-06-05 08:34:11,393 get_mon_dataset: Getting MON data from 2026:150:19:09:09.606 to 2026:150:19:35:15.807
2026-06-05 08:34:11,393 get_aca_images_cached: Getting ACA images from 2026:150:19:09:09.606 to 2026:150:19:35:15.807
2026-06-05 08:34:11,870 get_mon_dataset: Getting MON data from 2026:150:19:45:28.757 to 2026:150:19:55:56.057
2026-06-05 08:34:11,870 get_aca_images_cached: Getting ACA images from 2026:150:19:45:28.757 to 2026:150:19:55:56.057
2026-06-05 08:34:12,055 get_mon_dataset: Getting MON data from 2026:153:10:33:29.947 to 2026:153:10:55:55.772
2026-06-05 08:34:12,055 get_aca_images_cached: Getting ACA images from 2026:153:10:33:29.947 to 2026:153:10:55:55.772
2026-06-05 08:34:12,509 get_mon_dataset: Getting MON data from 2026:153:12:28:16.922 to 2026:153:12:31:07.072
2026-06-05 08:34:12,509 get_aca_images_cached: Getting ACA images from 2026:153:12:28:16.922 to 2026:153:12:31:07.072
2026-06-05 08:34:12,667 get_mon_dataset: Getting MON data from 2026:153:12:50:15.072 to 2026:153:12:50:56.072
2026-06-05 08:34:12,668 get_aca_images_cached: Getting ACA images from 2026:153:12:50:15.072 to 2026:153:12:50:56.072
2026-06-05 08:34:12,695 get_mon_dataset: Not enough images for slot 0 found 6)
2026-06-05 08:34:12,695 get_mon_dataset: Not enough images for slot 1 found 6)
2026-06-05 08:34:12,696 get_mon_dataset: Not enough images for slot 2 found 6)
2026-06-05 08:34:12,697 get_mon_dataset: Not enough images for slot 3 found 6)
2026-06-05 08:34:12,698 get_mon_dataset: Not enough images for slot 4 found 6)
2026-06-05 08:34:12,698 get_mon_dataset: Not enough images for slot 5 found 6)
2026-06-05 08:34:12,699 get_mon_dataset: Not enough images for slot 6 found 6)
2026-06-05 08:34:12,700 get_mon_dataset: Not enough images for slot 7 found 6)
2026-06-05 08:34:12,701 get_mon_dataset: Getting MON data from 2026:153:13:45:00.197 to 2026:153:14:14:04.748
2026-06-05 08:34:12,701 get_aca_images_cached: Getting ACA images from 2026:153:13:45:00.197 to 2026:153:14:14:04.748
2026-06-05 08:34:12,900 get_kalman_drops_nman: processing NMAN data
2026-06-05 08:34:13,137 get_kalman_drops_nman: Skipping NMAN from 2026:153:12:28:16.922 to 2026:153:12:31:07.072 due to insufficient monitor window data within 100 minutes of perigee
2026-06-05 08:34:13,143 get_kalman_drops_nman: Skipping NMAN from 2026:153:13:45:00.197 to 2026:153:14:14:04.748 due to insufficient monitor window data within 100 minutes of perigee
2026-06-05 07:34:14,021 _get_tlm: Getting telemetry for 2026:113:20:08:06.571
2026-06-05 07:34:14,271 obss: Getting observations from kadi commands for 2026/Apr-23
2026-06-05 07:34:14,286 _get_tlm: Getting telemetry for 2026:116:11:36:16.485
2026-06-05 07:34:14,527 obss: Getting observations from kadi commands for 2026/Apr-26
2026-06-05 07:34:14,540 _get_tlm: Getting telemetry for 2026:119:03:03:52.954
2026-06-05 07:34:15,013 obss: Getting observations from kadi commands for 2026/Apr-29
2026-06-05 07:34:15,025 _get_tlm: Getting telemetry for 2026:121:18:31:24.920
2026-06-05 07:34:15,265 obss: Getting observations from kadi commands for 2026/May-01
2026-06-05 07:34:15,276 _get_tlm: Getting telemetry for 2026:124:09:59:16.668
2026-06-05 07:34:15,514 obss: Getting observations from kadi commands for 2026/May-04
2026-06-05 07:34:15,526 _get_tlm: Getting telemetry for 2026:127:01:27:20.758
2026-06-05 07:34:15,754 obss: Getting observations from kadi commands for 2026/May-07
2026-06-05 07:34:15,769 _get_tlm: Getting telemetry for 2026:129:16:55:10.350
2026-06-05 07:34:16,000 obss: Getting observations from kadi commands for 2026/May-09
2026-06-05 07:34:16,014 _get_tlm: Getting telemetry for 2026:132:08:22:42.333
2026-06-05 07:34:16,254 obss: Getting observations from kadi commands for 2026/May-12
2026-06-05 07:34:16,268 _get_tlm: Getting telemetry for 2026:134:23:50:42.107
2026-06-05 07:34:16,503 obss: Getting observations from kadi commands for 2026/May-14
2026-06-05 07:34:16,517 _get_tlm: Getting telemetry for 2026:137:15:19:44.784
2026-06-05 07:34:16,772 obss: Getting observations from kadi commands for 2026/May-17
2026-06-05 07:34:16,784 _get_tlm: Getting telemetry for 2026:140:06:49:00.062
2026-06-05 07:34:17,042 obss: Getting observations from kadi commands for 2026/May-20
2026-06-05 07:34:17,056 _get_tlm: Getting telemetry for 2026:142:22:17:36.040
2026-06-05 07:34:17,305 obss: Getting observations from kadi commands for 2026/May-22
2026-06-05 07:34:17,319 _get_tlm: Getting telemetry for 2026:145:13:45:34.840
2026-06-05 07:34:17,562 obss: Getting observations from kadi commands for 2026/May-25
2026-06-05 07:34:17,575 _get_tlm: Getting telemetry for 2026:148:05:13:21.213
2026-06-05 07:34:17,812 obss: Getting observations from kadi commands for 2026/May-28
2026-06-05 07:34:17,822 _get_tlm: Getting telemetry for 2026:150:20:41:23.454
2026-06-05 07:34:18,054 obss: Getting observations from kadi commands for 2026/May-30
2026-06-05 07:34:18,066 _get_tlm: Getting telemetry for 2026:153:12:09:40.189
2026-06-05 07:34:18,298 obss: Getting observations from kadi commands for 2026/Jun-02
2026-06-05 07:34:26,394 get_color_marker_for_perigee_plotly: Perigee 2026:113:20:08:06.571 color='rgb(229, 134, 6)' marker='circle'
2026-06-05 07:34:26,394 get_color_marker_for_perigee_plotly: Perigee 2026:116:11:36:16.485 color='rgb(93, 105, 177)' marker='square'
2026-06-05 07:34:26,394 get_color_marker_for_perigee_plotly: Perigee 2026:119:03:03:52.954 color='rgb(82, 188, 163)' marker='diamond'
2026-06-05 07:34:26,395 get_color_marker_for_perigee_plotly: Perigee 2026:121:18:31:24.920 color='rgb(153, 201, 69)' marker='triangle-up'
2026-06-05 07:34:26,395 get_color_marker_for_perigee_plotly: Perigee 2026:124:09:59:16.668 color='rgb(204, 97, 176)' marker='triangle-down'
2026-06-05 07:34:26,395 get_color_marker_for_perigee_plotly: Perigee 2026:127:01:27:20.758 color='rgb(36, 121, 108)' marker='triangle-left'
2026-06-05 07:34:26,395 get_color_marker_for_perigee_plotly: Perigee 2026:129:16:55:10.350 color='rgb(218, 165, 27)' marker='triangle-right'
2026-06-05 07:34:26,395 get_color_marker_for_perigee_plotly: Perigee 2026:132:08:22:42.333 color='rgb(47, 138, 196)' marker='circle'
2026-06-05 07:34:26,396 get_color_marker_for_perigee_plotly: Perigee 2026:134:23:50:42.107 color='rgb(118, 78, 159)' marker='square'
2026-06-05 07:34:26,396 get_color_marker_for_perigee_plotly: Perigee 2026:137:15:19:44.784 color='rgb(237, 100, 90)' marker='diamond'
2026-06-05 07:34:26,396 get_color_marker_for_perigee_plotly: Perigee 2026:140:06:49:00.062 color='rgb(165, 170, 153)' marker='triangle-up'
2026-06-05 07:34:26,396 get_color_marker_for_perigee_plotly: Perigee 2026:142:22:17:36.040 color='rgb(229, 134, 6)' marker='triangle-down'
2026-06-05 07:34:26,396 get_color_marker_for_perigee_plotly: Perigee 2026:145:13:45:34.840 color='rgb(93, 105, 177)' marker='triangle-left'
2026-06-05 07:34:26,397 get_color_marker_for_perigee_plotly: Perigee 2026:148:05:13:21.213 color='rgb(82, 188, 163)' marker='triangle-right'
2026-06-05 07:34:26,397 get_color_marker_for_perigee_plotly: Perigee 2026:150:20:41:23.454 color='rgb(153, 201, 69)' marker='circle'
2026-06-05 07:34:26,397 get_color_marker_for_perigee_plotly: Perigee 2026:153:12:09:40.189 color='rgb(204, 97, 176)' marker='square'
2026-06-05 07:34:26,397 plot_mon_win_and_aokalstr_composite_plotly: plotting predictions
2026-06-05 07:34:27,158 clean_aca_images_cache: Cleaning ACA images cache to keep most recent 70 files
2026-06-05 08:34:30,485 main: Overriding starting time with the time of latest low-kalman event
2026-06-05 08:34:30,485 get_lowkals_new: Getting telemetry between 2026:155:02:43:22.085 and 2026:156:12:34:30.479
2026-06-05 08:34:30,756 get_lowkals_new: Finding intervals of low kalman stars
2026-06-05 08:34:30,775 get_lowkals_new: WARNING: Fewer than two kalman stars at 2026:155:21:47:56.581 for 69.7 secs
2026-06-05 08:34:30,776 get_lowkals_new: Last telemetry date: 2026:155:23:28:40.494
2026-06-05 08:34:30,776 get_lowkals_new: Found 1 new low kalman events
2026-06-05 08:34:30,778 main: Updating events file /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/low_kalman_events.ecsv
2026-06-05 08:34:31,077 make_web_page: Writing HTML to /proj/sot/ska3/aca-test/www/ASPECT/kalman_watch3/index.html
2026:155:02:43:22.085 2026:156:12:34:30.479