[Red5] RTMPProtocolDecoder throwing weird errors, then memory usage shoots through the roof

Michael Hollenbeck bigdaddyexlax at gmail.com
Mon Oct 26 12:47:42 PST 2009 

I gave it a go with the timestamp branch for a day or so and this problem
did not crop up. There did seem to be a more of a lag between connecting to
the stream and seeing any movement, though.

On Fri, Oct 23, 2009 at 10:58 AM, Art Clarke <aclarke at xuggle.com> wrote:

> k; can you try the timestamp branch.  I did a pretty drastic refactoring of
> RTMP decoding and encoding in that branch -- see if the problem is there as
> well.
>
> - Art
>
>
> On Fri, Oct 23, 2009 at 10:56 AM, Michael Hollenbeck <
> bigdaddyexlax at gmail.com> wrote:
>
>> The main trunk. I don't recall seeing it in .8, and it didn't crop up
>> during testing. Out in the wild, it happens with such infrequency  and
>> seeming randomness that it's tough to catch it in the act.
>>
>>
>> On Fri, Oct 23, 2009 at 10:40 AM, Art Clarke <aclarke at xuggle.com> wrote:
>>
>>> trunk or xuggle_timestamp_fixes branch?  And does the problem still show
>>> up in 0.8?
>>>
>>> - Art
>>>
>>>
>>> On Fri, Oct 23, 2009 at 10:38 AM, Michael Hollenbeck <
>>> bigdaddyexlax at gmail.com> wrote:
>>>
>>>> Working off the trunk, r3863.
>>>>
>>>>
>>>> On Fri, Oct 23, 2009 at 10:32 AM, Art Clarke <aclarke at xuggle.com>wrote:
>>>>
>>>>> Michael, what version of Red5 are you using (and if tip of tree, what
>>>>> revision number and what branch)?
>>>>>
>>>>> - Art
>>>>>
>>>>>
>>>>> On Fri, Oct 23, 2009 at 10:26 AM, Michael Hollenbeck <
>>>>> bigdaddyexlax at gmail.com> wrote:
>>>>>
>>>>>> I don't, I'm afraid.
>>>>>>
>>>>>> On Fri, Oct 23, 2009 at 4:01 AM, Ronen <ronen.mailinglist at gmail.com>wrote:
>>>>>>
>>>>>>> I had the same problem.
>>>>>>> My conclusion was that it happened because the way I publish with
>>>>>>> VP6.
>>>>>>> Do you publish with VP6 as well?
>>>>>>>
>>>>>>> On Thu, Oct 22, 2009 at 7:17 PM, Michael Hollenbeck <
>>>>>>> bigdaddyexlax at gmail.com> wrote:
>>>>>>>
>>>>>>>> On my video servers, I collect the output of the linux command
>>>>>>>> 'free' in order to automatically restart the server (after everyone
>>>>>>>> streaming in has disconnected) in case memory usage gets too close to
>>>>>>>> failure.
>>>>>>>>
>>>>>>>> Recently, I have begun to see this in the logs:
>>>>>>>>
>>>>>>>> (used)    (cached) (total)      (% free)
>>>>>>>> 533320   515476   1048796  49          Thu Oct 22 14:55:02 2009
>>>>>>>> 533548   515248   1048796  49          Thu Oct 22 15:00:01 2009
>>>>>>>> 532940   515856   1048796  49          Thu Oct 22 15:05:01 2009
>>>>>>>> 533060   515736   1048796  49          Thu Oct 22 15:10:01 2009
>>>>>>>> 1010320   38476   1048796   3           Thu Oct 22 15:15:01 2009
>>>>>>>>
>>>>>>>> a 46% jump within five minutes is bad enough, but I have seen the
>>>>>>>> number jump from down from 60-70% free as well.
>>>>>>>>
>>>>>>>> Looking in the logs, at around the same time memory spikes, I see a
>>>>>>>> whole bunch of these in the logs:
>>>>>>>>
>>>>>>>> [ERROR] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Last header null not
>>>>>>>> new, headerSize: 3, channelId 32
>>>>>>>> [WARN] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Unknown object type: 0
>>>>>>>> [ERROR] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Last header null not
>>>>>>>> new, headerSize: 2, channelId 45
>>>>>>>> [WARN] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Unknown object type: 0
>>>>>>>> [ERROR] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Last header null not
>>>>>>>> new, headerSize: 2, channelId 49
>>>>>>>> [WARN] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Unknown object type: 0
>>>>>>>> [ERROR] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Last header null not
>>>>>>>> new, headerSize: 3, channelId 20
>>>>>>>> [WARN] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Unknown object type: 0
>>>>>>>> [ERROR] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Last header null not
>>>>>>>> new, headerSize: 1, channelId 28
>>>>>>>> [ERROR] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Last header null not
>>>>>>>> new, headerSize: 1, channelId 40
>>>>>>>> [ERROR] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Last header null not
>>>>>>>> new, headerSize: 1, channelId 13
>>>>>>>> [WARN] [NioProcessor-4]
>>>>>>>> org.red5.server.net.rtmp.codec.RTMPProtocolDecoder - Unknown object type: 0
>>>>>>>>
>>>>>>>> Ending with
>>>>>>>>
>>>>>>>> [WARN] [NioProcessor-4]
>>>>>>>> org.apache.mina.core.filterchain.DefaultIoFilterChain - Unexpected exception
>>>>>>>> from exceptionCaught handler.
>>>>>>>> java.lang.OutOfMemoryError: Java heap space
>>>>>>>>
>>>>>>>> I am currently trying to sort out what happens right before this,
>>>>>>>> but I was hoping someone might know under what circumstances this could
>>>>>>>> happen.
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Red5 mailing list
>>>>>>>> Red5 at osflash.org
>>>>>>>> http://osflash.org/mailman/listinfo/red5_osflash.org
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Red5 mailing list
>>>>>>> Red5 at osflash.org
>>>>>>> http://osflash.org/mailman/listinfo/red5_osflash.org
>>>>>>>
>>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Red5 mailing list
>>>>>> Red5 at osflash.org
>>>>>> http://osflash.org/mailman/listinfo/red5_osflash.org
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> http://www.xuggle.com/
>>>>> xu‧ggle (zŭ' gl) v. To freely encode, decode, and experience audio and
>>>>> video.
>>>>>
>>>>> Use Xuggle to get the power of FFmpeg in Java.
>>>>>
>>>>> _______________________________________________
>>>>> Red5 mailing list
>>>>> Red5 at osflash.org
>>>>> http://osflash.org/mailman/listinfo/red5_osflash.org
>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> Red5 mailing list
>>>> Red5 at osflash.org
>>>> http://osflash.org/mailman/listinfo/red5_osflash.org
>>>>
>>>>
>>>
>>>
>>> --
>>> http://www.xuggle.com/
>>> xu‧ggle (zŭ' gl) v. To freely encode, decode, and experience audio and
>>> video.
>>>
>>> Use Xuggle to get the power of FFmpeg in Java.
>>>
>>> _______________________________________________
>>> Red5 mailing list
>>> Red5 at osflash.org
>>> http://osflash.org/mailman/listinfo/red5_osflash.org
>>>
>>>
>>
>> _______________________________________________
>> Red5 mailing list
>> Red5 at osflash.org
>> http://osflash.org/mailman/listinfo/red5_osflash.org
>>
>>
>
>
> --
> http://www.xuggle.com/
> xu‧ggle (zŭ' gl) v. To freely encode, decode, and experience audio and
> video.
>
> Use Xuggle to get the power of FFmpeg in Java.
>
> _______________________________________________
> Red5 mailing list
> Red5 at osflash.org
> http://osflash.org/mailman/listinfo/red5_osflash.org
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://osflash.org/pipermail/red5_osflash.org/attachments/20091026/afcc1940/attachment-0001.html>

More information about the Red5 mailing list