2022-04-28 03:12:23,510 INFO repeater task os75nb_lastensq starting 15.5 seconds late 2022-04-28 03:12:25,930 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 03:12:25,931 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:12:03 2022-04-28 03:12:25,931 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 03:17:08 2022-04-28 03:12:25,931 INFO repeater task os75nb_quick starting 17.9 seconds late 2022-04-28 03:12:30,945 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 03:12:30,945 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:12:03 2022-04-28 03:12:30,945 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 03:17:08 2022-04-28 03:12:30,946 INFO repeater task os75nb_lastvec starting 22.9 seconds late 2022-04-28 03:12:31,601 INFO repeater task os75nb_lastvec ended after 0.7 seconds 2022-04-28 03:12:31,602 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:12:03 2022-04-28 03:12:31,602 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 03:17:08 2022-04-28 03:12:31,602 INFO repeater task os75nb_3dayplots starting 22.7 seconds late 2022-04-28 03:12:38,251 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 03:12:38,251 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 03:12:38,251 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 03:17:08 2022-04-28 03:17:08,830 INFO repeater task os75nb_lastensq starting 0.8 seconds late 2022-04-28 03:17:09,476 INFO repeater task os75nb_lastensq ended after 0.6 seconds 2022-04-28 03:17:09,477 WARNING repeater task os75nb_lastensq: Expected update of /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time did not occur, dt = -284.738 2022-04-28 03:17:09,477 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 03:22:13 2022-04-28 03:17:09,477 INFO repeater task os75nb_quick starting 1.5 seconds late 2022-04-28 03:17:14,334 INFO repeater task os75nb_quick ended after 4.9 seconds 2022-04-28 03:17:14,334 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:12:03 2022-04-28 03:17:14,334 INFO repeater task os75nb_quick: added 1 extra increments to time_to_run 2022-04-28 03:17:14,334 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 03:22:13 2022-04-28 03:17:14,335 INFO repeater task os75nb_lastvec starting 6.3 seconds late 2022-04-28 03:17:14,936 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 03:17:14,937 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:12:03 2022-04-28 03:17:14,937 INFO repeater task os75nb_lastvec: added 1 extra increments to time_to_run 2022-04-28 03:17:14,937 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 03:22:13 2022-04-28 03:17:14,937 INFO repeater task os75nb_3dayplots starting 6.1 seconds late 2022-04-28 03:17:21,459 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 03:17:21,460 INFO repeater task os75nb_3dayplots ended after 6.5 seconds 2022-04-28 03:17:21,460 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 03:22:08 2022-04-28 03:22:12,078 INFO repeater task os75nb_3dayplots starting 3.2 seconds late 2022-04-28 03:22:18,679 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 03:22:18,679 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 03:22:18,679 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 03:27:08 2022-04-28 03:22:23,686 INFO repeater task os75nb_lastensq starting 10.7 seconds late 2022-04-28 03:22:26,120 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 03:22:26,120 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:22:03 2022-04-28 03:22:26,120 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 03:27:08 2022-04-28 03:22:26,121 INFO repeater task os75nb_quick starting 13.1 seconds late 2022-04-28 03:22:31,070 INFO repeater task os75nb_quick ended after 4.9 seconds 2022-04-28 03:22:31,071 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:22:03 2022-04-28 03:22:31,071 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 03:27:08 2022-04-28 03:22:31,071 INFO repeater task os75nb_lastvec starting 18.1 seconds late 2022-04-28 03:22:31,742 INFO repeater task os75nb_lastvec ended after 0.7 seconds 2022-04-28 03:22:31,742 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:22:03 2022-04-28 03:22:31,742 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 03:27:08 2022-04-28 03:27:07,344 INFO repeater task os75nb_tsstats starting 3.5 seconds late 2022-04-28 03:27:08,348 INFO repeater task os75nb_tsstats ended after 1.0 seconds 2022-04-28 03:27:08,348 INFO repeater task os75nb_tsstats next time_to_run is 2022/04/28 03:42:03 2022-04-28 03:27:08,348 INFO repeater task os75nb_10pings starting 4.5 seconds late 2022-04-28 03:27:08,578 INFO repeater task os75nb_10pings ended after 0.2 seconds 2022-04-28 03:27:08,578 INFO repeater task os75nb_10pings next time_to_run is 2022/04/28 03:42:03 2022-04-28 03:27:08,579 INFO repeater task os75nb_beamplots starting 4.7 seconds late 2022-04-28 03:27:09,766 INFO repeater task os75nb_beamplots ended after 1.2 seconds 2022-04-28 03:27:09,767 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 03:42:03 2022-04-28 03:27:09,767 INFO repeater task os75nb_beamplots starting 5.9 seconds late 2022-04-28 03:27:10,911 INFO repeater task os75nb_beamplots ended after 1.1 seconds 2022-04-28 03:27:10,911 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 03:42:03 2022-04-28 03:27:10,912 INFO repeater task ggatime_diagnostics starting 7.0 seconds late 2022-04-28 03:27:14,343 INFO repeater task ggatime_diagnostics output: saving figure to /home/adcp/www/figures/ggatime_gpsnav_auto.png and /home/adcp/www/figures/ggatime_gpsnav_autoT.png saving figure to /home/adcp/daily_report/ggatime_gpsnav_auto.png saving figure to /home/adcp/www/figures/ggatime_posmv_auto.png and /home/adcp/www/figures/ggatime_posmv_autoT.png saving figure to /home/adcp/daily_report/ggatime_posmv_auto.png 2022-04-28 03:27:14,344 INFO repeater task ggatime_diagnostics ended after 3.4 seconds 2022-04-28 03:27:14,344 INFO repeater task ggatime_diagnostics next time_to_run is 2022/04/28 03:42:03 2022-04-28 03:27:14,344 INFO repeater task ggatime_hist starting 10.5 seconds late 2022-04-28 03:27:15,185 INFO repeater task ggatime_hist ended after 0.8 seconds 2022-04-28 03:27:15,185 INFO repeater task ggatime_hist next time_to_run is 2022/04/28 03:42:03 2022-04-28 03:27:15,186 INFO repeater task posmv_hcorrstats starting 10.8 seconds late 2022-04-28 03:27:16,441 INFO repeater task posmv_hcorrstats ended after 1.3 seconds 2022-04-28 03:27:16,442 INFO repeater task posmv_hcorrstats next time_to_run is 2022/04/28 03:42:04 2022-04-28 03:27:16,442 INFO repeater task posmv_plotqc starting 12.1 seconds late 2022-04-28 03:27:19,735 INFO repeater task posmv_plotqc ended after 3.3 seconds 2022-04-28 03:27:19,735 INFO repeater task posmv_plotqc next time_to_run is 2022/04/28 03:42:04 2022-04-28 03:27:24,741 INFO repeater task os75nb_lastensq starting 16.7 seconds late 2022-04-28 03:27:27,123 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 03:27:27,123 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:27:03 2022-04-28 03:27:27,124 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 03:32:08 2022-04-28 03:27:27,124 INFO repeater task os75nb_quick starting 19.1 seconds late 2022-04-28 03:27:32,065 INFO repeater task os75nb_quick ended after 4.9 seconds 2022-04-28 03:27:32,065 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:27:03 2022-04-28 03:27:32,065 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 03:32:08 2022-04-28 03:27:32,066 INFO repeater task os75nb_lastvec starting 24.1 seconds late 2022-04-28 03:27:32,670 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 03:27:32,671 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:27:03 2022-04-28 03:27:32,671 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 03:32:08 2022-04-28 03:27:32,671 INFO repeater task os75nb_3dayplots starting 23.8 seconds late 2022-04-28 03:27:39,406 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 03:27:39,407 INFO repeater task os75nb_3dayplots ended after 6.7 seconds 2022-04-28 03:27:39,407 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 03:32:08 2022-04-28 03:32:09,986 INFO repeater task os75nb_lastensq starting 2.0 seconds late 2022-04-28 03:32:12,380 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 03:32:12,381 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:32:03 2022-04-28 03:32:12,381 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 03:37:08 2022-04-28 03:32:12,381 INFO repeater task os75nb_quick starting 4.4 seconds late 2022-04-28 03:32:17,424 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 03:32:17,424 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:32:03 2022-04-28 03:32:17,424 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 03:37:08 2022-04-28 03:32:17,425 INFO repeater task os75nb_lastvec starting 9.4 seconds late 2022-04-28 03:32:18,030 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 03:32:18,031 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:32:03 2022-04-28 03:32:18,031 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 03:37:08 2022-04-28 03:32:18,031 INFO repeater task os75nb_3dayplots starting 9.2 seconds late 2022-04-28 03:32:24,627 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 03:32:24,628 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 03:32:24,628 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 03:37:08 2022-04-28 03:37:10,247 INFO repeater task os75nb_lastensq starting 2.2 seconds late 2022-04-28 03:37:12,589 INFO repeater task os75nb_lastensq ended after 2.3 seconds 2022-04-28 03:37:12,590 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:37:03 2022-04-28 03:37:12,590 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 03:42:08 2022-04-28 03:37:12,590 INFO repeater task os75nb_quick starting 4.6 seconds late 2022-04-28 03:37:17,492 INFO repeater task os75nb_quick ended after 4.9 seconds 2022-04-28 03:37:17,492 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:37:03 2022-04-28 03:37:17,493 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 03:42:08 2022-04-28 03:37:17,493 INFO repeater task os75nb_lastvec starting 9.5 seconds late 2022-04-28 03:37:18,099 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 03:37:18,100 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:37:03 2022-04-28 03:37:18,100 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 03:42:08 2022-04-28 03:37:18,100 INFO repeater task os75nb_3dayplots starting 9.2 seconds late 2022-04-28 03:37:24,625 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 03:37:24,625 INFO repeater task os75nb_3dayplots ended after 6.5 seconds 2022-04-28 03:37:24,625 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 03:42:08 2022-04-28 03:42:05,233 INFO repeater task os75nb_tsstats starting 1.4 seconds late 2022-04-28 03:42:06,245 INFO repeater task os75nb_tsstats ended after 1.0 seconds 2022-04-28 03:42:06,245 INFO repeater task os75nb_tsstats next time_to_run is 2022/04/28 03:57:03 2022-04-28 03:42:06,246 INFO repeater task os75nb_10pings starting 2.4 seconds late 2022-04-28 03:42:06,511 INFO repeater task os75nb_10pings ended after 0.3 seconds 2022-04-28 03:42:06,511 INFO repeater task os75nb_10pings next time_to_run is 2022/04/28 03:57:03 2022-04-28 03:42:06,512 INFO repeater task os75nb_beamplots starting 2.6 seconds late 2022-04-28 03:42:07,663 INFO repeater task os75nb_beamplots ended after 1.2 seconds 2022-04-28 03:42:07,663 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 03:57:03 2022-04-28 03:42:07,663 INFO repeater task os75nb_beamplots starting 3.8 seconds late 2022-04-28 03:42:08,797 INFO repeater task os75nb_beamplots ended after 1.1 seconds 2022-04-28 03:42:08,797 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 03:57:03 2022-04-28 03:42:08,797 INFO repeater task ggatime_diagnostics starting 4.9 seconds late 2022-04-28 03:42:12,171 INFO repeater task ggatime_diagnostics output: saving figure to /home/adcp/www/figures/ggatime_gpsnav_auto.png and /home/adcp/www/figures/ggatime_gpsnav_autoT.png saving figure to /home/adcp/daily_report/ggatime_gpsnav_auto.png saving figure to /home/adcp/www/figures/ggatime_posmv_auto.png and /home/adcp/www/figures/ggatime_posmv_autoT.png saving figure to /home/adcp/daily_report/ggatime_posmv_auto.png 2022-04-28 03:42:12,171 INFO repeater task ggatime_diagnostics ended after 3.4 seconds 2022-04-28 03:42:12,171 INFO repeater task ggatime_diagnostics next time_to_run is 2022/04/28 03:57:03 2022-04-28 03:42:12,171 INFO repeater task ggatime_hist starting 8.3 seconds late 2022-04-28 03:42:13,013 INFO repeater task ggatime_hist ended after 0.8 seconds 2022-04-28 03:42:13,013 INFO repeater task ggatime_hist next time_to_run is 2022/04/28 03:57:03 2022-04-28 03:42:13,014 INFO repeater task posmv_hcorrstats starting 8.7 seconds late 2022-04-28 03:42:14,240 INFO repeater task posmv_hcorrstats ended after 1.2 seconds 2022-04-28 03:42:14,241 INFO repeater task posmv_hcorrstats next time_to_run is 2022/04/28 03:57:04 2022-04-28 03:42:14,241 INFO repeater task posmv_plotqc starting 9.9 seconds late 2022-04-28 03:42:17,477 INFO repeater task posmv_plotqc ended after 3.2 seconds 2022-04-28 03:42:17,477 INFO repeater task posmv_plotqc next time_to_run is 2022/04/28 03:57:04 2022-04-28 03:42:22,483 INFO repeater task os75nb_lastensq starting 14.5 seconds late 2022-04-28 03:42:24,863 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 03:42:24,863 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:42:03 2022-04-28 03:42:24,863 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 03:47:08 2022-04-28 03:42:24,863 INFO repeater task os75nb_quick starting 16.9 seconds late 2022-04-28 03:42:29,888 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 03:42:29,889 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:42:03 2022-04-28 03:42:29,889 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 03:47:08 2022-04-28 03:42:29,889 INFO repeater task os75nb_lastvec starting 21.9 seconds late 2022-04-28 03:42:30,500 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 03:42:30,500 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:42:03 2022-04-28 03:42:30,500 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 03:47:08 2022-04-28 03:42:30,500 INFO repeater task os75nb_3dayplots starting 21.6 seconds late 2022-04-28 03:42:37,005 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 03:42:37,006 INFO repeater task os75nb_3dayplots ended after 6.5 seconds 2022-04-28 03:42:37,006 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 03:47:08 2022-04-28 03:47:12,616 INFO repeater task os75nb_lastensq starting 4.6 seconds late 2022-04-28 03:47:14,995 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 03:47:14,996 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:47:03 2022-04-28 03:47:14,996 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 03:52:08 2022-04-28 03:47:14,996 INFO repeater task os75nb_quick starting 7.0 seconds late 2022-04-28 03:47:19,959 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 03:47:19,960 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:47:03 2022-04-28 03:47:19,960 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 03:52:08 2022-04-28 03:47:19,960 INFO repeater task os75nb_lastvec starting 12.0 seconds late 2022-04-28 03:47:20,571 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 03:47:20,571 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:47:03 2022-04-28 03:47:20,571 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 03:52:08 2022-04-28 03:47:20,572 INFO repeater task os75nb_3dayplots starting 11.7 seconds late 2022-04-28 03:47:27,165 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 03:47:27,166 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 03:47:27,166 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 03:52:08 2022-04-28 03:52:12,789 INFO repeater task os75nb_lastensq starting 4.8 seconds late 2022-04-28 03:52:15,167 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 03:52:15,167 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:52:03 2022-04-28 03:52:15,167 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 03:57:08 2022-04-28 03:52:15,167 INFO repeater task os75nb_quick starting 7.2 seconds late 2022-04-28 03:52:20,202 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 03:52:20,202 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:52:03 2022-04-28 03:52:20,202 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 03:57:08 2022-04-28 03:52:20,202 INFO repeater task os75nb_lastvec starting 12.2 seconds late 2022-04-28 03:52:20,804 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 03:52:20,804 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:52:03 2022-04-28 03:52:20,805 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 03:57:08 2022-04-28 03:52:20,805 INFO repeater task os75nb_3dayplots starting 11.9 seconds late 2022-04-28 03:52:27,552 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 03:52:27,552 INFO repeater task os75nb_3dayplots ended after 6.7 seconds 2022-04-28 03:52:27,552 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 03:57:08 2022-04-28 03:57:08,107 INFO repeater task os75nb_lastensq starting 0.1 seconds late 2022-04-28 03:57:10,481 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 03:57:10,481 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:57:03 2022-04-28 03:57:10,481 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:02:08 2022-04-28 03:57:10,482 INFO repeater task os75nb_quick starting 2.5 seconds late 2022-04-28 03:57:15,447 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 03:57:15,447 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:57:03 2022-04-28 03:57:15,447 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:02:08 2022-04-28 03:57:15,447 INFO repeater task os75nb_lastvec starting 7.4 seconds late 2022-04-28 03:57:16,138 INFO repeater task os75nb_lastvec ended after 0.7 seconds 2022-04-28 03:57:16,138 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 03:57:03 2022-04-28 03:57:16,139 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:02:08 2022-04-28 03:57:16,139 INFO repeater task os75nb_3dayplots starting 7.3 seconds late 2022-04-28 03:57:22,749 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 03:57:22,749 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 03:57:22,749 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:02:08 2022-04-28 03:57:22,749 INFO repeater task os75nb_tsstats starting 18.9 seconds late 2022-04-28 03:57:23,791 INFO repeater task os75nb_tsstats ended after 1.0 seconds 2022-04-28 03:57:23,791 INFO repeater task os75nb_tsstats next time_to_run is 2022/04/28 04:12:03 2022-04-28 03:57:23,792 INFO repeater task os75nb_10pings starting 19.9 seconds late 2022-04-28 03:57:24,019 INFO repeater task os75nb_10pings ended after 0.2 seconds 2022-04-28 03:57:24,019 INFO repeater task os75nb_10pings next time_to_run is 2022/04/28 04:12:03 2022-04-28 03:57:24,020 INFO repeater task os75nb_beamplots starting 20.1 seconds late 2022-04-28 03:57:25,157 INFO repeater task os75nb_beamplots ended after 1.1 seconds 2022-04-28 03:57:25,157 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 04:12:03 2022-04-28 03:57:25,157 INFO repeater task os75nb_beamplots starting 21.3 seconds late 2022-04-28 03:57:26,360 INFO repeater task os75nb_beamplots ended after 1.2 seconds 2022-04-28 03:57:26,360 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 04:12:03 2022-04-28 03:57:26,361 INFO repeater task ggatime_diagnostics starting 22.5 seconds late 2022-04-28 03:57:29,783 INFO repeater task ggatime_diagnostics output: saving figure to /home/adcp/www/figures/ggatime_gpsnav_auto.png and /home/adcp/www/figures/ggatime_gpsnav_autoT.png saving figure to /home/adcp/daily_report/ggatime_gpsnav_auto.png saving figure to /home/adcp/www/figures/ggatime_posmv_auto.png and /home/adcp/www/figures/ggatime_posmv_autoT.png saving figure to /home/adcp/daily_report/ggatime_posmv_auto.png 2022-04-28 03:57:29,783 INFO repeater task ggatime_diagnostics ended after 3.4 seconds 2022-04-28 03:57:29,783 INFO repeater task ggatime_diagnostics next time_to_run is 2022/04/28 04:12:03 2022-04-28 03:57:29,783 INFO repeater task ggatime_hist starting 25.9 seconds late 2022-04-28 03:57:30,669 INFO repeater task ggatime_hist ended after 0.9 seconds 2022-04-28 03:57:30,669 INFO repeater task ggatime_hist next time_to_run is 2022/04/28 04:12:03 2022-04-28 03:57:30,669 INFO repeater task posmv_hcorrstats starting 26.3 seconds late 2022-04-28 03:57:31,905 INFO repeater task posmv_hcorrstats ended after 1.2 seconds 2022-04-28 03:57:31,905 INFO repeater task posmv_hcorrstats next time_to_run is 2022/04/28 04:12:04 2022-04-28 03:57:31,906 INFO repeater task posmv_plotqc starting 27.6 seconds late 2022-04-28 03:57:35,291 INFO repeater task posmv_plotqc ended after 3.4 seconds 2022-04-28 03:57:35,291 INFO repeater task posmv_plotqc next time_to_run is 2022/04/28 04:12:04 2022-04-28 03:57:35,291 INFO repeater task report_generator starting 30.9 seconds late 2022-04-28 03:57:41,201 INFO repeater task report_generator output: cruisename is report_dir is uhdas_dir is 0.0 sec : png archive rsync 2.0 sec : navplot: plot_rnav.py -s300 --noshow --title SH2204_CalCOFI --outfile /home/data/SH2204_CalCOFI/reports/nav_plot_all /home/data/SH2204_CalCOFI/rbin/gpsnav/*.gps.rbin 1.0 sec : db_timerange: plot_db_timeranges.py --outfile /home/data/SH2204_CalCOFI/reports/db_timerange --noshow /home/data/SH2204_CalCOFI 0.0 sec : db_timerange: png_thumbnail.py --width 200 --outdir /home/data/SH2204_CalCOFI/reports /home/data/SH2204_CalCOFI/reports/nav_plot_all_topo 0.0 sec : db_timerange: png_thumbnail.py --width 200 --outdir /home/data/SH2204_CalCOFI/reports /home/data/SH2204_CalCOFI/reports/nav_plot_all_txy 0.0 sec : db_timerange: png_thumbnail.py --width 200 --outdir /home/data/SH2204_CalCOFI/reports /home/data/SH2204_CalCOFI/reports/db_timerange 0.0 sec : png_archive: rsync -au /home/data/SH2204_CalCOFI/proc/os75nb/png_archive/ /home/data/SH2204_CalCOFI/reports/os75nb_pngarchive 0.0 sec : uhdas_overview: uhdas_info.py --overview --logfile /home/data/SH2204_CalCOFI/reports/uhdas_overview.txt /home/data/SH2204_CalCOFI 0.0 sec : adcp_settings: uhdas_info.py --settings --logfile /home/data/SH2204_CalCOFI/reports/ADCP_settings.txt /home/data/SH2204_CalCOFI 0.0 sec : adcp_cals: uhdas_info.py --cals --logfile /home/data/SH2204_CalCOFI/reports/ADCP_cals.txt /home/data/SH2204_CalCOFI 1.0 sec : ens_hcorr: plot_enshcorr.py --infile /home/data/SH2204_CalCOFI/proc/os75nb/cal/rotate/ens_hcorr.asc --outfile /home/data/SH2204_CalCOFI/reports/os75nb_hcorr --yearbase 2022 --titlestring ens_hcorr_pmv 0.0 sec : ens_hcorr: png_thumbnail.py --width 200 --outdir /home/data/SH2204_CalCOFI/reports /home/data/SH2204_CalCOFI/reports/os75nb_hcorr 0.0 sec : pycfg: cp -p /home/data/SH2204_CalCOFI/raw/config/SH2204_CalCOFI_proc.py /home/data/SH2204_CalCOFI/reports/SH2204_CalCOFI_proc.py.txt 0.0 sec : pycfg: cp -p /home/data/SH2204_CalCOFI/raw/config/SH2204_CalCOFI_sensor.py /home/data/SH2204_CalCOFI/reports/SH2204_CalCOFI_sensor.py.txt 5.0 seconds elapsed html page starts here: /home/data/SH2204_CalCOFI/reports/index.html 2022-04-28 03:57:41,201 INFO repeater task report_generator ended after 5.9 seconds 2022-04-28 03:57:41,202 INFO repeater task report_generator next time_to_run is 2022/04/28 04:57:04 2022-04-28 04:02:11,806 INFO repeater task os75nb_lastensq starting 3.8 seconds late 2022-04-28 04:02:14,190 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 04:02:14,190 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:02:03 2022-04-28 04:02:14,190 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:07:08 2022-04-28 04:02:14,191 INFO repeater task os75nb_quick starting 6.2 seconds late 2022-04-28 04:02:19,213 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 04:02:19,214 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:02:03 2022-04-28 04:02:19,214 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:07:08 2022-04-28 04:02:19,214 INFO repeater task os75nb_lastvec starting 11.2 seconds late 2022-04-28 04:02:19,864 INFO repeater task os75nb_lastvec ended after 0.7 seconds 2022-04-28 04:02:19,865 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:02:03 2022-04-28 04:02:19,865 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:07:08 2022-04-28 04:02:19,865 INFO repeater task os75nb_3dayplots starting 11.0 seconds late 2022-04-28 04:02:26,477 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:02:26,478 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 04:02:26,478 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:07:08 2022-04-28 04:07:12,086 INFO repeater task os75nb_lastensq starting 4.1 seconds late 2022-04-28 04:07:14,438 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 04:07:14,438 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:07:03 2022-04-28 04:07:14,439 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:12:08 2022-04-28 04:07:14,439 INFO repeater task os75nb_quick starting 6.4 seconds late 2022-04-28 04:07:19,357 INFO repeater task os75nb_quick ended after 4.9 seconds 2022-04-28 04:07:19,357 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:07:03 2022-04-28 04:07:19,357 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:12:08 2022-04-28 04:07:19,357 INFO repeater task os75nb_lastvec starting 11.4 seconds late 2022-04-28 04:07:19,966 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 04:07:19,966 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:07:03 2022-04-28 04:07:19,966 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:12:08 2022-04-28 04:07:19,966 INFO repeater task os75nb_3dayplots starting 11.1 seconds late 2022-04-28 04:07:26,541 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:07:26,541 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 04:07:26,541 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:12:08 2022-04-28 04:12:07,120 INFO repeater task os75nb_tsstats starting 3.2 seconds late 2022-04-28 04:12:08,161 INFO repeater task os75nb_tsstats ended after 1.0 seconds 2022-04-28 04:12:08,161 INFO repeater task os75nb_tsstats next time_to_run is 2022/04/28 04:27:03 2022-04-28 04:12:08,162 INFO repeater task os75nb_10pings starting 4.3 seconds late 2022-04-28 04:12:08,390 INFO repeater task os75nb_10pings ended after 0.2 seconds 2022-04-28 04:12:08,390 INFO repeater task os75nb_10pings next time_to_run is 2022/04/28 04:27:03 2022-04-28 04:12:08,390 INFO repeater task os75nb_beamplots starting 4.5 seconds late 2022-04-28 04:12:09,543 INFO repeater task os75nb_beamplots ended after 1.2 seconds 2022-04-28 04:12:09,543 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 04:27:03 2022-04-28 04:12:09,544 INFO repeater task os75nb_beamplots starting 5.7 seconds late 2022-04-28 04:12:10,704 INFO repeater task os75nb_beamplots ended after 1.2 seconds 2022-04-28 04:12:10,704 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 04:27:03 2022-04-28 04:12:10,704 INFO repeater task ggatime_diagnostics starting 6.8 seconds late 2022-04-28 04:12:14,132 INFO repeater task ggatime_diagnostics output: saving figure to /home/adcp/www/figures/ggatime_gpsnav_auto.png and /home/adcp/www/figures/ggatime_gpsnav_autoT.png saving figure to /home/adcp/daily_report/ggatime_gpsnav_auto.png saving figure to /home/adcp/www/figures/ggatime_posmv_auto.png and /home/adcp/www/figures/ggatime_posmv_autoT.png saving figure to /home/adcp/daily_report/ggatime_posmv_auto.png 2022-04-28 04:12:14,132 INFO repeater task ggatime_diagnostics ended after 3.4 seconds 2022-04-28 04:12:14,132 INFO repeater task ggatime_diagnostics next time_to_run is 2022/04/28 04:27:03 2022-04-28 04:12:14,132 INFO repeater task ggatime_hist starting 10.3 seconds late 2022-04-28 04:12:15,012 INFO repeater task ggatime_hist ended after 0.9 seconds 2022-04-28 04:12:15,012 INFO repeater task ggatime_hist next time_to_run is 2022/04/28 04:27:03 2022-04-28 04:12:15,013 INFO repeater task posmv_hcorrstats starting 10.7 seconds late 2022-04-28 04:12:16,231 INFO repeater task posmv_hcorrstats ended after 1.2 seconds 2022-04-28 04:12:16,231 INFO repeater task posmv_hcorrstats next time_to_run is 2022/04/28 04:27:04 2022-04-28 04:12:16,232 INFO repeater task posmv_plotqc starting 11.9 seconds late 2022-04-28 04:12:19,427 INFO repeater task posmv_plotqc ended after 3.2 seconds 2022-04-28 04:12:19,428 INFO repeater task posmv_plotqc next time_to_run is 2022/04/28 04:27:04 2022-04-28 04:12:24,434 INFO repeater task os75nb_lastensq starting 16.4 seconds late 2022-04-28 04:12:26,781 INFO repeater task os75nb_lastensq ended after 2.3 seconds 2022-04-28 04:12:26,781 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:12:03 2022-04-28 04:12:26,782 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:17:08 2022-04-28 04:12:26,782 INFO repeater task os75nb_quick starting 18.8 seconds late 2022-04-28 04:12:31,724 INFO repeater task os75nb_quick ended after 4.9 seconds 2022-04-28 04:12:31,725 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:12:03 2022-04-28 04:12:31,725 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:17:08 2022-04-28 04:12:31,725 INFO repeater task os75nb_lastvec starting 23.7 seconds late 2022-04-28 04:12:32,339 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 04:12:32,339 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:12:03 2022-04-28 04:12:32,339 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:17:08 2022-04-28 04:12:32,339 INFO repeater task os75nb_3dayplots starting 23.5 seconds late 2022-04-28 04:12:39,002 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:12:39,002 INFO repeater task os75nb_3dayplots ended after 6.7 seconds 2022-04-28 04:12:39,002 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:17:08 2022-04-28 04:17:09,583 INFO repeater task os75nb_lastensq starting 1.6 seconds late 2022-04-28 04:17:11,947 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 04:17:11,947 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:17:03 2022-04-28 04:17:11,947 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:22:08 2022-04-28 04:17:11,948 INFO repeater task os75nb_quick starting 3.9 seconds late 2022-04-28 04:17:16,883 INFO repeater task os75nb_quick ended after 4.9 seconds 2022-04-28 04:17:16,883 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:17:03 2022-04-28 04:17:16,884 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:22:08 2022-04-28 04:17:16,884 INFO repeater task os75nb_lastvec starting 8.9 seconds late 2022-04-28 04:17:17,519 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 04:17:17,520 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:17:03 2022-04-28 04:17:17,520 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:22:08 2022-04-28 04:17:17,520 INFO repeater task os75nb_3dayplots starting 8.7 seconds late 2022-04-28 04:17:24,141 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:17:24,141 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 04:17:24,141 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:22:08 2022-04-28 04:22:09,724 INFO repeater task os75nb_lastensq starting 1.7 seconds late 2022-04-28 04:22:12,094 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 04:22:12,094 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:22:03 2022-04-28 04:22:12,094 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:27:08 2022-04-28 04:22:12,095 INFO repeater task os75nb_quick starting 4.1 seconds late 2022-04-28 04:22:17,065 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 04:22:17,065 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:22:03 2022-04-28 04:22:17,065 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:27:08 2022-04-28 04:22:17,066 INFO repeater task os75nb_lastvec starting 9.1 seconds late 2022-04-28 04:22:17,670 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 04:22:17,670 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:22:03 2022-04-28 04:22:17,671 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:27:08 2022-04-28 04:22:17,671 INFO repeater task os75nb_3dayplots starting 8.8 seconds late 2022-04-28 04:22:24,417 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:22:24,417 INFO repeater task os75nb_3dayplots ended after 6.7 seconds 2022-04-28 04:22:24,417 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:27:08 2022-04-28 04:27:05,023 INFO repeater task os75nb_tsstats starting 1.2 seconds late 2022-04-28 04:27:06,052 INFO repeater task os75nb_tsstats ended after 1.0 seconds 2022-04-28 04:27:06,053 INFO repeater task os75nb_tsstats next time_to_run is 2022/04/28 04:42:03 2022-04-28 04:27:06,053 INFO repeater task os75nb_10pings starting 2.2 seconds late 2022-04-28 04:27:06,296 INFO repeater task os75nb_10pings ended after 0.2 seconds 2022-04-28 04:27:06,296 INFO repeater task os75nb_10pings next time_to_run is 2022/04/28 04:42:03 2022-04-28 04:27:06,296 INFO repeater task os75nb_beamplots starting 2.4 seconds late 2022-04-28 04:27:07,429 INFO repeater task os75nb_beamplots ended after 1.1 seconds 2022-04-28 04:27:07,429 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 04:42:03 2022-04-28 04:27:07,429 INFO repeater task os75nb_beamplots starting 3.6 seconds late 2022-04-28 04:27:08,607 INFO repeater task os75nb_beamplots ended after 1.2 seconds 2022-04-28 04:27:08,607 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 04:42:03 2022-04-28 04:27:08,607 INFO repeater task ggatime_diagnostics starting 4.7 seconds late 2022-04-28 04:27:11,975 INFO repeater task ggatime_diagnostics output: saving figure to /home/adcp/www/figures/ggatime_gpsnav_auto.png and /home/adcp/www/figures/ggatime_gpsnav_autoT.png saving figure to /home/adcp/daily_report/ggatime_gpsnav_auto.png saving figure to /home/adcp/www/figures/ggatime_posmv_auto.png and /home/adcp/www/figures/ggatime_posmv_autoT.png saving figure to /home/adcp/daily_report/ggatime_posmv_auto.png 2022-04-28 04:27:11,975 INFO repeater task ggatime_diagnostics ended after 3.4 seconds 2022-04-28 04:27:11,975 INFO repeater task ggatime_diagnostics next time_to_run is 2022/04/28 04:42:03 2022-04-28 04:27:11,975 INFO repeater task ggatime_hist starting 8.1 seconds late 2022-04-28 04:27:12,850 INFO repeater task ggatime_hist ended after 0.9 seconds 2022-04-28 04:27:12,850 INFO repeater task ggatime_hist next time_to_run is 2022/04/28 04:42:03 2022-04-28 04:27:12,850 INFO repeater task posmv_hcorrstats starting 8.5 seconds late 2022-04-28 04:27:14,067 INFO repeater task posmv_hcorrstats ended after 1.2 seconds 2022-04-28 04:27:14,067 INFO repeater task posmv_hcorrstats next time_to_run is 2022/04/28 04:42:04 2022-04-28 04:27:14,067 INFO repeater task posmv_plotqc starting 9.7 seconds late 2022-04-28 04:27:17,331 INFO repeater task posmv_plotqc ended after 3.3 seconds 2022-04-28 04:27:17,331 INFO repeater task posmv_plotqc next time_to_run is 2022/04/28 04:42:04 2022-04-28 04:27:22,337 INFO repeater task os75nb_lastensq starting 14.3 seconds late 2022-04-28 04:27:24,700 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 04:27:24,701 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:27:03 2022-04-28 04:27:24,701 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:32:08 2022-04-28 04:27:24,701 INFO repeater task os75nb_quick starting 16.7 seconds late 2022-04-28 04:27:29,692 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 04:27:29,692 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:27:03 2022-04-28 04:27:29,692 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:32:08 2022-04-28 04:27:29,693 INFO repeater task os75nb_lastvec starting 21.7 seconds late 2022-04-28 04:27:30,307 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 04:27:30,307 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:27:03 2022-04-28 04:27:30,307 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:32:08 2022-04-28 04:27:30,308 INFO repeater task os75nb_3dayplots starting 21.4 seconds late 2022-04-28 04:27:36,950 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:27:36,950 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 04:27:36,950 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:32:08 2022-04-28 04:32:12,510 INFO repeater task os75nb_lastensq starting 4.5 seconds late 2022-04-28 04:32:14,873 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 04:32:14,873 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:32:03 2022-04-28 04:32:14,873 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:37:08 2022-04-28 04:32:14,874 INFO repeater task os75nb_quick starting 6.9 seconds late 2022-04-28 04:32:19,965 INFO repeater task os75nb_quick ended after 5.1 seconds 2022-04-28 04:32:19,966 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:32:03 2022-04-28 04:32:19,966 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:37:08 2022-04-28 04:32:19,966 INFO repeater task os75nb_lastvec starting 12.0 seconds late 2022-04-28 04:32:20,588 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 04:32:20,588 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:32:03 2022-04-28 04:32:20,589 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:37:08 2022-04-28 04:32:20,589 INFO repeater task os75nb_3dayplots starting 11.7 seconds late 2022-04-28 04:32:27,195 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:32:27,195 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 04:32:27,195 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:37:08 2022-04-28 04:37:12,802 INFO repeater task os75nb_lastensq starting 4.8 seconds late 2022-04-28 04:37:15,192 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 04:37:15,192 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:37:03 2022-04-28 04:37:15,192 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:42:08 2022-04-28 04:37:15,192 INFO repeater task os75nb_quick starting 7.2 seconds late 2022-04-28 04:37:20,201 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 04:37:20,202 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:37:03 2022-04-28 04:37:20,202 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:42:08 2022-04-28 04:37:20,202 INFO repeater task os75nb_lastvec starting 12.2 seconds late 2022-04-28 04:37:20,858 INFO repeater task os75nb_lastvec ended after 0.7 seconds 2022-04-28 04:37:20,858 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:37:03 2022-04-28 04:37:20,858 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:42:08 2022-04-28 04:37:20,858 INFO repeater task os75nb_3dayplots starting 12.0 seconds late 2022-04-28 04:37:27,500 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:37:27,500 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 04:37:27,501 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:42:08 2022-04-28 04:42:08,115 INFO repeater task os75nb_lastensq starting 0.1 seconds late 2022-04-28 04:42:10,491 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 04:42:10,491 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:42:03 2022-04-28 04:42:10,491 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:47:08 2022-04-28 04:42:10,491 INFO repeater task os75nb_quick starting 2.5 seconds late 2022-04-28 04:42:15,499 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 04:42:15,500 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:42:03 2022-04-28 04:42:15,500 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:47:08 2022-04-28 04:42:15,500 INFO repeater task os75nb_lastvec starting 7.5 seconds late 2022-04-28 04:42:16,108 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 04:42:16,108 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:42:03 2022-04-28 04:42:16,108 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:47:08 2022-04-28 04:42:16,109 INFO repeater task os75nb_3dayplots starting 7.2 seconds late 2022-04-28 04:42:22,722 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:42:22,722 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 04:42:22,722 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:47:08 2022-04-28 04:42:22,723 INFO repeater task os75nb_tsstats starting 18.9 seconds late 2022-04-28 04:42:23,713 INFO repeater task os75nb_tsstats ended after 1.0 seconds 2022-04-28 04:42:23,713 INFO repeater task os75nb_tsstats next time_to_run is 2022/04/28 04:57:03 2022-04-28 04:42:23,714 INFO repeater task os75nb_10pings starting 19.8 seconds late 2022-04-28 04:42:23,942 INFO repeater task os75nb_10pings ended after 0.2 seconds 2022-04-28 04:42:23,942 INFO repeater task os75nb_10pings next time_to_run is 2022/04/28 04:57:03 2022-04-28 04:42:23,942 INFO repeater task os75nb_beamplots starting 20.1 seconds late 2022-04-28 04:42:25,114 INFO repeater task os75nb_beamplots ended after 1.2 seconds 2022-04-28 04:42:25,114 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 04:57:03 2022-04-28 04:42:25,115 INFO repeater task os75nb_beamplots starting 21.2 seconds late 2022-04-28 04:42:26,243 INFO repeater task os75nb_beamplots ended after 1.1 seconds 2022-04-28 04:42:26,243 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 04:57:03 2022-04-28 04:42:26,244 INFO repeater task ggatime_diagnostics starting 22.4 seconds late 2022-04-28 04:42:29,647 INFO repeater task ggatime_diagnostics output: saving figure to /home/adcp/www/figures/ggatime_gpsnav_auto.png and /home/adcp/www/figures/ggatime_gpsnav_autoT.png saving figure to /home/adcp/daily_report/ggatime_gpsnav_auto.png saving figure to /home/adcp/www/figures/ggatime_posmv_auto.png and /home/adcp/www/figures/ggatime_posmv_autoT.png saving figure to /home/adcp/daily_report/ggatime_posmv_auto.png 2022-04-28 04:42:29,647 INFO repeater task ggatime_diagnostics ended after 3.4 seconds 2022-04-28 04:42:29,647 INFO repeater task ggatime_diagnostics next time_to_run is 2022/04/28 04:57:03 2022-04-28 04:42:29,647 INFO repeater task ggatime_hist starting 25.8 seconds late 2022-04-28 04:42:30,516 INFO repeater task ggatime_hist ended after 0.9 seconds 2022-04-28 04:42:30,516 INFO repeater task ggatime_hist next time_to_run is 2022/04/28 04:57:03 2022-04-28 04:42:30,516 INFO repeater task posmv_hcorrstats starting 26.2 seconds late 2022-04-28 04:42:31,720 INFO repeater task posmv_hcorrstats ended after 1.2 seconds 2022-04-28 04:42:31,720 INFO repeater task posmv_hcorrstats next time_to_run is 2022/04/28 04:57:04 2022-04-28 04:42:31,721 INFO repeater task posmv_plotqc starting 27.4 seconds late 2022-04-28 04:42:35,029 INFO repeater task posmv_plotqc ended after 3.3 seconds 2022-04-28 04:42:35,029 INFO repeater task posmv_plotqc next time_to_run is 2022/04/28 04:57:04 2022-04-28 04:47:10,641 INFO repeater task os75nb_lastensq starting 2.6 seconds late 2022-04-28 04:47:12,982 INFO repeater task os75nb_lastensq ended after 2.3 seconds 2022-04-28 04:47:12,982 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:47:03 2022-04-28 04:47:12,982 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:52:08 2022-04-28 04:47:12,983 INFO repeater task os75nb_quick starting 5.0 seconds late 2022-04-28 04:47:17,979 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 04:47:17,980 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:47:03 2022-04-28 04:47:17,980 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:52:08 2022-04-28 04:47:17,980 INFO repeater task os75nb_lastvec starting 10.0 seconds late 2022-04-28 04:47:18,582 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 04:47:18,583 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:47:03 2022-04-28 04:47:18,583 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:52:08 2022-04-28 04:47:18,583 INFO repeater task os75nb_3dayplots starting 9.7 seconds late 2022-04-28 04:47:25,205 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:47:25,205 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 04:47:25,205 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:52:08 2022-04-28 04:52:10,834 INFO repeater task os75nb_lastensq starting 2.8 seconds late 2022-04-28 04:52:13,226 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 04:52:13,227 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:52:03 2022-04-28 04:52:13,227 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 04:57:08 2022-04-28 04:52:13,227 INFO repeater task os75nb_quick starting 5.2 seconds late 2022-04-28 04:52:18,246 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 04:52:18,246 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:52:03 2022-04-28 04:52:18,246 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 04:57:08 2022-04-28 04:52:18,247 INFO repeater task os75nb_lastvec starting 10.2 seconds late 2022-04-28 04:52:18,879 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 04:52:18,879 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:52:03 2022-04-28 04:52:18,879 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 04:57:08 2022-04-28 04:52:18,879 INFO repeater task os75nb_3dayplots starting 10.0 seconds late 2022-04-28 04:52:25,454 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:52:25,455 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 04:52:25,455 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 04:57:08 2022-04-28 04:57:06,071 INFO repeater task os75nb_tsstats starting 2.2 seconds late 2022-04-28 04:57:07,075 INFO repeater task os75nb_tsstats ended after 1.0 seconds 2022-04-28 04:57:07,075 INFO repeater task os75nb_tsstats next time_to_run is 2022/04/28 05:12:03 2022-04-28 04:57:07,076 INFO repeater task os75nb_10pings starting 3.2 seconds late 2022-04-28 04:57:07,301 INFO repeater task os75nb_10pings ended after 0.2 seconds 2022-04-28 04:57:07,302 INFO repeater task os75nb_10pings next time_to_run is 2022/04/28 05:12:03 2022-04-28 04:57:07,302 INFO repeater task os75nb_beamplots starting 3.4 seconds late 2022-04-28 04:57:08,470 INFO repeater task os75nb_beamplots ended after 1.2 seconds 2022-04-28 04:57:08,471 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 05:12:03 2022-04-28 04:57:08,471 INFO repeater task os75nb_beamplots starting 4.6 seconds late 2022-04-28 04:57:09,611 INFO repeater task os75nb_beamplots ended after 1.1 seconds 2022-04-28 04:57:09,611 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 05:12:03 2022-04-28 04:57:09,612 INFO repeater task ggatime_diagnostics starting 5.7 seconds late 2022-04-28 04:57:13,045 INFO repeater task ggatime_diagnostics output: saving figure to /home/adcp/www/figures/ggatime_gpsnav_auto.png and /home/adcp/www/figures/ggatime_gpsnav_autoT.png saving figure to /home/adcp/daily_report/ggatime_gpsnav_auto.png saving figure to /home/adcp/www/figures/ggatime_posmv_auto.png and /home/adcp/www/figures/ggatime_posmv_autoT.png saving figure to /home/adcp/daily_report/ggatime_posmv_auto.png 2022-04-28 04:57:13,046 INFO repeater task ggatime_diagnostics ended after 3.4 seconds 2022-04-28 04:57:13,046 INFO repeater task ggatime_diagnostics next time_to_run is 2022/04/28 05:12:03 2022-04-28 04:57:13,046 INFO repeater task ggatime_hist starting 9.2 seconds late 2022-04-28 04:57:13,885 INFO repeater task ggatime_hist ended after 0.8 seconds 2022-04-28 04:57:13,885 INFO repeater task ggatime_hist next time_to_run is 2022/04/28 05:12:03 2022-04-28 04:57:13,886 INFO repeater task posmv_hcorrstats starting 9.5 seconds late 2022-04-28 04:57:15,144 INFO repeater task posmv_hcorrstats ended after 1.3 seconds 2022-04-28 04:57:15,144 INFO repeater task posmv_hcorrstats next time_to_run is 2022/04/28 05:12:04 2022-04-28 04:57:15,144 INFO repeater task posmv_plotqc starting 10.8 seconds late 2022-04-28 04:57:18,428 INFO repeater task posmv_plotqc ended after 3.3 seconds 2022-04-28 04:57:18,428 INFO repeater task posmv_plotqc next time_to_run is 2022/04/28 05:12:04 2022-04-28 04:57:18,428 INFO repeater task report_generator starting 14.1 seconds late 2022-04-28 04:57:24,385 INFO repeater task report_generator output: cruisename is report_dir is uhdas_dir is 0.0 sec : png archive rsync 2.0 sec : navplot: plot_rnav.py -s300 --noshow --title SH2204_CalCOFI --outfile /home/data/SH2204_CalCOFI/reports/nav_plot_all /home/data/SH2204_CalCOFI/rbin/gpsnav/*.gps.rbin 1.0 sec : db_timerange: plot_db_timeranges.py --outfile /home/data/SH2204_CalCOFI/reports/db_timerange --noshow /home/data/SH2204_CalCOFI 0.0 sec : db_timerange: png_thumbnail.py --width 200 --outdir /home/data/SH2204_CalCOFI/reports /home/data/SH2204_CalCOFI/reports/nav_plot_all_topo 0.0 sec : db_timerange: png_thumbnail.py --width 200 --outdir /home/data/SH2204_CalCOFI/reports /home/data/SH2204_CalCOFI/reports/nav_plot_all_txy 0.0 sec : db_timerange: png_thumbnail.py --width 200 --outdir /home/data/SH2204_CalCOFI/reports /home/data/SH2204_CalCOFI/reports/db_timerange 0.0 sec : png_archive: rsync -au /home/data/SH2204_CalCOFI/proc/os75nb/png_archive/ /home/data/SH2204_CalCOFI/reports/os75nb_pngarchive 0.0 sec : uhdas_overview: uhdas_info.py --overview --logfile /home/data/SH2204_CalCOFI/reports/uhdas_overview.txt /home/data/SH2204_CalCOFI 0.0 sec : adcp_settings: uhdas_info.py --settings --logfile /home/data/SH2204_CalCOFI/reports/ADCP_settings.txt /home/data/SH2204_CalCOFI 0.0 sec : adcp_cals: uhdas_info.py --cals --logfile /home/data/SH2204_CalCOFI/reports/ADCP_cals.txt /home/data/SH2204_CalCOFI 1.0 sec : ens_hcorr: plot_enshcorr.py --infile /home/data/SH2204_CalCOFI/proc/os75nb/cal/rotate/ens_hcorr.asc --outfile /home/data/SH2204_CalCOFI/reports/os75nb_hcorr --yearbase 2022 --titlestring ens_hcorr_pmv 0.0 sec : ens_hcorr: png_thumbnail.py --width 200 --outdir /home/data/SH2204_CalCOFI/reports /home/data/SH2204_CalCOFI/reports/os75nb_hcorr 0.0 sec : pycfg: cp -p /home/data/SH2204_CalCOFI/raw/config/SH2204_CalCOFI_proc.py /home/data/SH2204_CalCOFI/reports/SH2204_CalCOFI_proc.py.txt 0.0 sec : pycfg: cp -p /home/data/SH2204_CalCOFI/raw/config/SH2204_CalCOFI_sensor.py /home/data/SH2204_CalCOFI/reports/SH2204_CalCOFI_sensor.py.txt 6.0 seconds elapsed html page starts here: /home/data/SH2204_CalCOFI/reports/index.html 2022-04-28 04:57:24,385 INFO repeater task report_generator ended after 6.0 seconds 2022-04-28 04:57:24,385 INFO repeater task report_generator next time_to_run is 2022/04/28 05:57:04 2022-04-28 04:57:29,391 INFO repeater task os75nb_lastensq starting 21.4 seconds late 2022-04-28 04:57:31,735 INFO repeater task os75nb_lastensq ended after 2.3 seconds 2022-04-28 04:57:31,736 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:57:03 2022-04-28 04:57:31,736 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 05:02:08 2022-04-28 04:57:31,736 INFO repeater task os75nb_quick starting 23.7 seconds late 2022-04-28 04:57:36,781 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 04:57:36,781 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:57:03 2022-04-28 04:57:36,781 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 05:02:08 2022-04-28 04:57:36,781 INFO repeater task os75nb_lastvec starting 28.8 seconds late 2022-04-28 04:57:37,389 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 04:57:37,390 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 04:57:03 2022-04-28 04:57:37,390 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 05:02:08 2022-04-28 04:57:37,390 INFO repeater task os75nb_3dayplots starting 28.5 seconds late 2022-04-28 04:57:44,098 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 04:57:44,098 INFO repeater task os75nb_3dayplots ended after 6.7 seconds 2022-04-28 04:57:44,098 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 05:02:08 2022-04-28 05:02:09,686 INFO repeater task os75nb_lastensq starting 1.7 seconds late 2022-04-28 05:02:12,054 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 05:02:12,054 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:02:03 2022-04-28 05:02:12,054 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 05:07:08 2022-04-28 05:02:12,054 INFO repeater task os75nb_quick starting 4.1 seconds late 2022-04-28 05:02:17,074 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 05:02:17,074 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:02:03 2022-04-28 05:02:17,074 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 05:07:08 2022-04-28 05:02:17,075 INFO repeater task os75nb_lastvec starting 9.1 seconds late 2022-04-28 05:02:17,676 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 05:02:17,677 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:02:03 2022-04-28 05:02:17,677 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 05:07:08 2022-04-28 05:02:17,677 INFO repeater task os75nb_3dayplots starting 8.8 seconds late 2022-04-28 05:02:24,335 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 05:02:24,335 INFO repeater task os75nb_3dayplots ended after 6.7 seconds 2022-04-28 05:02:24,335 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 05:07:08 2022-04-28 05:07:09,960 INFO repeater task os75nb_lastensq starting 2.0 seconds late 2022-04-28 05:07:12,296 INFO repeater task os75nb_lastensq ended after 2.3 seconds 2022-04-28 05:07:12,297 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:07:03 2022-04-28 05:07:12,297 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 05:12:08 2022-04-28 05:07:12,297 INFO repeater task os75nb_quick starting 4.3 seconds late 2022-04-28 05:07:17,321 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 05:07:17,322 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:07:03 2022-04-28 05:07:17,322 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 05:12:08 2022-04-28 05:07:17,322 INFO repeater task os75nb_lastvec starting 9.3 seconds late 2022-04-28 05:07:17,918 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 05:07:17,918 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:07:03 2022-04-28 05:07:17,918 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 05:12:08 2022-04-28 05:07:17,918 INFO repeater task os75nb_3dayplots starting 9.0 seconds late 2022-04-28 05:07:24,552 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 05:07:24,552 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 05:07:24,552 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 05:12:08 2022-04-28 05:12:05,151 INFO repeater task os75nb_tsstats starting 1.3 seconds late 2022-04-28 05:12:06,151 INFO repeater task os75nb_tsstats ended after 1.0 seconds 2022-04-28 05:12:06,151 INFO repeater task os75nb_tsstats next time_to_run is 2022/04/28 05:27:03 2022-04-28 05:12:06,152 INFO repeater task os75nb_10pings starting 2.3 seconds late 2022-04-28 05:12:06,380 INFO repeater task os75nb_10pings ended after 0.2 seconds 2022-04-28 05:12:06,381 INFO repeater task os75nb_10pings next time_to_run is 2022/04/28 05:27:03 2022-04-28 05:12:06,381 INFO repeater task os75nb_beamplots starting 2.5 seconds late 2022-04-28 05:12:07,554 INFO repeater task os75nb_beamplots ended after 1.2 seconds 2022-04-28 05:12:07,554 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 05:27:03 2022-04-28 05:12:07,555 INFO repeater task os75nb_beamplots starting 3.7 seconds late 2022-04-28 05:12:08,693 INFO repeater task os75nb_beamplots ended after 1.1 seconds 2022-04-28 05:12:08,694 INFO repeater task os75nb_beamplots next time_to_run is 2022/04/28 05:27:03 2022-04-28 05:12:08,694 INFO repeater task ggatime_diagnostics starting 4.8 seconds late 2022-04-28 05:12:12,176 INFO repeater task ggatime_diagnostics output: saving figure to /home/adcp/www/figures/ggatime_gpsnav_auto.png and /home/adcp/www/figures/ggatime_gpsnav_autoT.png saving figure to /home/adcp/daily_report/ggatime_gpsnav_auto.png saving figure to /home/adcp/www/figures/ggatime_posmv_auto.png and /home/adcp/www/figures/ggatime_posmv_autoT.png saving figure to /home/adcp/daily_report/ggatime_posmv_auto.png 2022-04-28 05:12:12,176 INFO repeater task ggatime_diagnostics ended after 3.5 seconds 2022-04-28 05:12:12,176 INFO repeater task ggatime_diagnostics next time_to_run is 2022/04/28 05:27:03 2022-04-28 05:12:12,177 INFO repeater task ggatime_hist starting 8.3 seconds late 2022-04-28 05:12:13,021 INFO repeater task ggatime_hist ended after 0.8 seconds 2022-04-28 05:12:13,021 INFO repeater task ggatime_hist next time_to_run is 2022/04/28 05:27:03 2022-04-28 05:12:13,022 INFO repeater task posmv_hcorrstats starting 8.7 seconds late 2022-04-28 05:12:14,263 INFO repeater task posmv_hcorrstats ended after 1.2 seconds 2022-04-28 05:12:14,263 INFO repeater task posmv_hcorrstats next time_to_run is 2022/04/28 05:27:04 2022-04-28 05:12:14,263 INFO repeater task posmv_plotqc starting 9.9 seconds late 2022-04-28 05:12:17,539 INFO repeater task posmv_plotqc ended after 3.3 seconds 2022-04-28 05:12:17,539 INFO repeater task posmv_plotqc next time_to_run is 2022/04/28 05:27:04 2022-04-28 05:12:22,542 INFO repeater task os75nb_lastensq starting 14.5 seconds late 2022-04-28 05:12:24,879 INFO repeater task os75nb_lastensq ended after 2.3 seconds 2022-04-28 05:12:24,880 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:12:03 2022-04-28 05:12:24,880 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 05:17:08 2022-04-28 05:12:24,880 INFO repeater task os75nb_quick starting 16.9 seconds late 2022-04-28 05:12:29,841 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 05:12:29,842 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:12:03 2022-04-28 05:12:29,842 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 05:17:08 2022-04-28 05:12:29,842 INFO repeater task os75nb_lastvec starting 21.8 seconds late 2022-04-28 05:12:30,438 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 05:12:30,439 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:12:03 2022-04-28 05:12:30,439 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 05:17:08 2022-04-28 05:12:30,439 INFO repeater task os75nb_3dayplots starting 21.6 seconds late 2022-04-28 05:12:37,143 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 05:12:37,143 INFO repeater task os75nb_3dayplots ended after 6.7 seconds 2022-04-28 05:12:37,143 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 05:17:08 2022-04-28 05:17:12,717 INFO repeater task os75nb_lastensq starting 4.7 seconds late 2022-04-28 05:17:15,065 INFO repeater task os75nb_lastensq ended after 2.3 seconds 2022-04-28 05:17:15,066 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:17:03 2022-04-28 05:17:15,066 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 05:22:08 2022-04-28 05:17:15,066 INFO repeater task os75nb_quick starting 7.1 seconds late 2022-04-28 05:17:20,087 INFO repeater task os75nb_quick ended after 5.0 seconds 2022-04-28 05:17:20,088 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:17:03 2022-04-28 05:17:20,088 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 05:22:08 2022-04-28 05:17:20,088 INFO repeater task os75nb_lastvec starting 12.1 seconds late 2022-04-28 05:17:20,689 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 05:17:20,690 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:17:03 2022-04-28 05:17:20,690 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 05:22:08 2022-04-28 05:17:20,690 INFO repeater task os75nb_3dayplots starting 11.8 seconds late 2022-04-28 05:17:27,286 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 05:17:27,287 INFO repeater task os75nb_3dayplots ended after 6.6 seconds 2022-04-28 05:17:27,287 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 05:22:08 2022-04-28 05:22:12,905 INFO repeater task os75nb_lastensq starting 4.9 seconds late 2022-04-28 05:22:15,320 INFO repeater task os75nb_lastensq ended after 2.4 seconds 2022-04-28 05:22:15,321 INFO repeater task os75nb_lastensq: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:22:03 2022-04-28 05:22:15,321 INFO repeater task os75nb_lastensq next time_to_run is 2022/04/28 05:27:08 2022-04-28 05:22:15,321 INFO repeater task os75nb_quick starting 7.3 seconds late 2022-04-28 05:22:20,431 INFO repeater task os75nb_quick ended after 5.1 seconds 2022-04-28 05:22:20,431 INFO repeater task os75nb_quick: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:22:03 2022-04-28 05:22:20,431 INFO repeater task os75nb_quick next time_to_run is 2022/04/28 05:27:08 2022-04-28 05:22:20,432 INFO repeater task os75nb_lastvec starting 12.4 seconds late 2022-04-28 05:22:21,036 INFO repeater task os75nb_lastvec ended after 0.6 seconds 2022-04-28 05:22:21,036 INFO repeater task os75nb_lastvec: Time from /home/data/SH2204_CalCOFI/proc/os75nb/load/wrote_ens_time: 2022/04/28 05:22:03 2022-04-28 05:22:21,037 INFO repeater task os75nb_lastvec next time_to_run is 2022/04/28 05:27:08 2022-04-28 05:22:21,037 INFO repeater task os75nb_3dayplots starting 12.2 seconds late 2022-04-28 05:22:27,747 INFO repeater task os75nb_3dayplots output: /usr/lib/python3/dist-packages/numpy/ma/core.py:6592: RuntimeWarning: overflow encountered in power result = np.where(m, fa, umath.power(fa, fb)).view(basetype) /usr/lib/python3/dist-packages/numpy/ma/core.py:1046: RuntimeWarning: overflow encountered in multiply result = self.f(da, db, *args, **kwargs) 2022-04-28 05:22:27,748 INFO repeater task os75nb_3dayplots ended after 6.7 seconds 2022-04-28 05:22:27,748 INFO repeater task os75nb_3dayplots next time_to_run is 2022/04/28 05:27:08 2022-04-28 05:23:57,272 INFO incr_class translate exiting, hdg /home/data/SH2204_CalCOFI/rbin/quadrans 2022-04-28 05:23:57,272 INFO incr_class translate exiting, gps /home/data/SH2204_CalCOFI/rbin/posmv 2022-04-28 05:23:57,272 INFO incr_class translate exiting, gps /home/data/SH2204_CalCOFI/rbin/gpsnav 2022-04-28 05:23:57,273 INFO incr_class translate exiting, pmv /home/data/SH2204_CalCOFI/rbin/posmv 2022-04-28 05:23:57,937 INFO repeater Running task report_generator at exit 2022-04-28 05:23:57,937 INFO repeater task report_generator starting -1986.4 seconds late