rtp2httpd的首帧输出并非可解码的关键帧

[riverscn]

/opt/homebrew/bin/ffprobe -v error -show_entries stream=codec_name,codec_long_name,profile -of default=nopri
nt_wrappers=1:nokey=1 "http://xxx:5140/%E5%A4%AE%E8%A7%86/CCTV1%E7%BB%BC%E5%90%88"
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 1 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 2 times
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
[h264 @ 0xaa5038380] no frame!
[h264 @ 0xaa5038380] non-existing PPS 0 referenced
    Last message repeated 1 times
[h264 @ 0xaa5038380] no frame!
h264
H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
High
mp2
MP2 (MPEG audio layer 2)
unknown
h264
H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
High
mp2
MP2 (MPEG audio layer 2)
unknown

ffprobe 和 AVPlayer 都报告 PPS/SPS参数缺失 (non-existing PPS 0 referenced)。

• H.264 流必须包含 SPS/PPS 头信息才能解码。
• rtp2httpd 只是简单转发 RTP 包（似乎即使开启了FCC也是如此），没有缓存并补发这些头信息（不一定要这么做，直接丢弃也可）。
• AVPlayer 对此非常敏感，如果在连接的头几秒内没收到这些信息，就会直接报错 -12939 (Format Not Supported) 并停止播放。
• VLC/MPV 等播放器会一直等待直到收到关键帧再开始播放，头几帧也是PPS报错

是否考虑过滤掉无法播放的帧？或者我是遇到了什么bug吗？

[stackia]

rtp2httpd 只是转发 rtp 包，所以如果运营商本身的 rtp/ts 封装出了问题，rtp2httpd 不会去修正。你这里遇得到情况就是运营商自己的问题了，封装的视频流有问题，导致只能在机顶盒或者其他一些比较宽松的解码器上才能播放。

是否考虑过滤掉无法播放的帧

这需要解 ts 封装、h264/hevc 解码，有很高的实现门槛，也需要很大的性能开销，所以不会去支持