Playout stoppage / halting issues?

Hi all - we recently started a libretime server at the community station where I work (kgnu), since we needed some more automation options ‘in these times’

we’ve had a few cases lately where playout has stopped in the middle of a program, silence on the analog outputs, silence also from the libretime screens and web playout.

these usually have been longer shows submitted by DJs that staff uploads and schedules (2-3 hours, 320 kbps mps).

thanks in advance for any tips!

here’s the log output at the time of the more recent playout issue:

2020/05/16 11:13:11 [server:3] Client localhost disconnected.
2020/05/16 11:15:57 [decoder:2] Decoder of "/var/tmp/airtime/pypo/cache/scheduler/1055.mp3" produced non-uniform data: {audio=2;video=0;midi=0} at 0, {audio=1;video=0;midi=0} at 1260! (End at 1764).
2020/05/16 11:15:57 [s4:3] Finished with "/var/tmp/airtime/pypo/cache/scheduler/1055.mp3".
2020/05/16 11:15:57 [cue_cut_5777:3] End of track before cue-out point.
2020/05/16 11:15:57 [amplify_5781:3] End of the current overriding.
2020/05/16 11:15:57 [dummy(dot)3:3] Source failed (no more tracks) stopping output...
2020/05/16 11:15:57 [dummy(dot)4:3] Source failed (no more tracks) stopping output...
2020/05/16 11:15:57 [schedule_noise_switch:3] Switch to map_metadata_5859 with forgetful transition.
2020/05/16 11:15:57 [lang:3] transition called...

Hmm have you downloaded and analyzed the specific mp3s to see if there is anything noticeablely weird about them. Like maybe they got cut off during the upload and are shorter than they should be according to their metadata ? That is my first guess based upon the log message. That could be an issue with liquid soap but I’d verify the files first to make sure they aren’t truncated or corrupted.

Otherwise it’ll require more investigation.

ahh, yes - thank you.

it does look like the file was corrupted. depending on the editor i use to look at it, i get warnings/visibile errors (fission & audacity), or the file won’t load past that point of the big error (studio one, hindenberg).

we had another issue last week where it looked like the file was playing in Libretime (and we could cue / listen from the libretime player), but no audio output. But, this could have been a separate hardware issue we were having, can’t tell from the log if there was an issue at the scheduled 20:00:00 playout:

2020/05/13 19:53:41 [server:3] Client localhost disconnected.
2020/05/13 20:00:00 [server:3] New client: localhost.
2020/05/13 20:00:00 [lang:3] timeout --signal=KILL 45 pyponotify --source-name=live_dj --source-status=false &
2020/05/13 20:00:00 [server:3] Client localhost disconnected.
2020/05/13 20:00:00 [server:3] New client: localhost.
2020/05/13 20:00:00 [decoder:3] Method "MAD" accepted "/var/tmp/airtime/pypo/cache/scheduler/954.mp3".
2020/05/13 20:00:00 [lang:3] vars.show_name
2020/05/13 20:00:00 [server:3] Client localhost disconnected.
2020/05/13 20:00:00 [s4:3] Prepared "/var/tmp/airtime/pypo/cache/scheduler/954.mp3" (RID 0).
2020/05/13 20:00:00 [schedule_noise_switch:3] Switch to map_metadata_5852 with transition.
2020/05/13 20:00:00 [lang:3] transition called...
2020/05/13 20:00:00 [switch_5850:3] Switch to insert_metadata_5836.
2020/05/13 20:00:00 [amplify_5781:3] Overriding amplification: 0.737055.
2020/05/13 20:00:00 [lang:3] timeout --signal=KILL 45 pyponotify --media-id=2759 &
2020/05/13 20:00:00 [lang:3] Using stream_format 2
2020/05/13 20:00:00 [lang:3] Using stream_format 2
2020/05/13 20:00:00 [lang:3] Using stream_format 2
2020/05/13 20:01:42 [server:3] New client: localhost.

I’m not sure based upon the log, but there are definitely weird issues that come up occasionally with the interaction between liquidsoap and libretime-playout (just switched names finally from airtime-playout in a recent commit). I welcome the help in debugging them.

Are you running the latest version of LibreTime from the git master or one of our releases ? We recently switched to python 3 based everything.

Anyways - here is the issue tracking the first problem you ran into, basically we don’t validate a file is as long as it says it is, which causes the issues you ran into - https://github.com/LibreTime/libretime/issues/537

Thank you, happy to help! I believe we’re running python 3 (libretime v 6678645f0), did a fresh install with ubuntu 18.04.4 in late march. and we’ll be on the lookout for metadata and corruption issues on shows that our DJs send in.