[Red5devs] Root cause of CPU overload on VOD streaming (was Re: Red5 0.7 Sprint)

Wed Jan 23 09:01:01 PST 2008

This is what I love about Red5.. quick turnaround..

On Jan 23, 2008, at 11:24 AM, Chris Allen wrote:

> Nice Steven! So, are you going to implement this fix?
>
> -Chris
>
> On Jan 23, 2008, at 10:16 AM, Steven Gong wrote:
>
>> Hi all,
>> I found the root cause of big CPU load on VOD streaming. It is  
>> caused by the loading of key frame metadata from metadata cache. A  
>> simple solution to this is to enhance the metadata cache  
>> implementation to cache the loaded metadata into memory for FLV  
>> rather than load it again from the file system each time.
>>
>> On Jan 22, 2008 11:58 PM, Mondain <mondain at gmail.com> wrote:
>> The load tester (src) is checked into the trunk btw..
>>
>>
>> On Jan 21, 2008 10:34 PM, Luke Hubbard <luke at codegent.net > wrote:
>> Hi Steven
>>
>> Yes please do.
>>
>> - Luke
>>
>>
>> On 1/22/08, Steven Gong < steven.gong at gmail.com> wrote:
>> Luke,
>> If you need Paul's load tester for the test, I can send a copy to  
>> you.
>>
>>
>> On Jan 22, 2008 7:34 AM, Dan Rossi <spam at electroteque.org> wrote:
>> Paul's load tester flex app is a good one to use but i dont think  
>> its accurate enough. I have tested the same app against FMS and  
>> Wowza and there was only 5% cpu used maximum.
>>
>> On 21/01/2008, at 7:43 PM, Steven Gong wrote:
>>
>>>
>>>
>>> On Jan 21, 2008 4:27 PM, Luke Hubbard < luke at codegent.net> wrote:
>>> I will try to test with a profiler see what is eating all that CPU.
>>> This is for VOD right, not live? Or both?
>>> This is the VOD streaming and can be reproduced by a simple load  
>>> test VOD playback.
>>>
>>> - Luke
>>>
>>>
>>> On 1/21/08, Dan Rossi < spam at electroteque.org> wrote:
>>> Less than that before its reaching 100% cpu. aparantly i go away  
>>> on a break and everything goes down. It might be looking like we  
>>> might have to jump onto the wowza bandwagon :\
>>>
>>> On 20/01/2008, at 9:55 AM, Dominick Accattato wrote:
>>>
>>>> Dan:
>>>>
>>>> are you saying that the core can only handle 50-80 concurrent  
>>>> connections?
>>>>
>>>> On Jan 19, 2008, at 6:28 AM, Dan Rossi wrote:
>>>>
>>>>> Great, i added the preliminary task in there but didnt get much  
>>>>> responses about it at first :D Should we add back in the option  
>>>>> to either compile javadoc in a full distribution task or not,  
>>>>> that was added in as a suggestion from steve but was removed. It  
>>>>> does reduce the recompile time alot.
>>>>>
>>>>> I believe the major one that i know of is the performance  
>>>>> problems somewhere in the core, its maxing out at 50-80  
>>>>> concurrents.
>>>>>
>>>>> On 19/01/2008, at 3:15 AM, Mondain wrote:
>>>>>
>>>>>> If we plan to inform users of the edge/origin features, we will  
>>>>>> also need to get those parts of the build script ironed-out  
>>>>>> before the release as well.
>>>>>>
>>>>>> Paul
>>>>>>
>>>>>> On Jan 18, 2008 4:52 AM, Lenny Sorey < lrsorey at gmail.com> wrote:
>>>>>> Hey Joachim,
>>>>>>
>>>>>> Welcome back!!
>>>>>>
>>>>>> Glad to see your return.
>>>>>>
>>>>>> Hope things are well with these days.
>>>>>>
>>>>>> Regards,
>>>>>>
>>>>>> Lenny
>>>>>>
>>>>>>
>>>>>> On 1/17/08, Dominick Accattato < daccattato at gmail.com> wrote:
>>>>>> Team:
>>>>>>
>>>>>>
>>>>>> I want to give Joachim a warm welcome back.  We missed ya!   
>>>>>> Everyone has done a great job pushing Red5 forward from the 0.6  
>>>>>> release.  In preparation of the release of 0.7, I'd like to get  
>>>>>> a few more fixes in.  If we can, lets try to get this stuff  
>>>>>> done asap so that we can get 0.7 out the door.  Here is what I  
>>>>>> find to be of importance for this release.
>>>>>>
>>>>>>
>>>>>> http://jira.red5.org/browse/APPSERVER-184
>>>>>> amf3 synchronization issue with SharedObjects (I will provide  
>>>>>> Joachim with a test app)
>>>>>> fix our tests since Paul noticed many of them are failing
>>>>>>
>>>>>>
>>>>>> If anyone can think of any other important fixes, list them so  
>>>>>> that we can look into their priority.  Thanks team!
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Red5devs mailing list
>>>>>> Red5devs at osflash.org
>>>>>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>>>>>
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Red5devs mailing list
>>>>>> Red5devs at osflash.org
>>>>>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> -- 
>>>>>> It is difficult to free fools from the chains they revere. -  
>>>>>> Voltaire _______________________________________________
>>>>>> Red5devs mailing list
>>>>>> Red5devs at osflash.org
>>>>>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>>>>
>>>>> _______________________________________________
>>>>> Red5devs mailing list
>>>>> Red5devs at osflash.org
>>>>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>>>
>>>> _______________________________________________
>>>> Red5devs mailing list
>>>> Red5devs at osflash.org
>>>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>>
>>>
>>> _______________________________________________
>>> Red5devs mailing list
>>> Red5devs at osflash.org
>>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>>
>>>
>>>
>>>
>>> -- 
>>> Luke Hubbard
>>> codegent | coding for the people
>>> http://www.codegent.com
>>>
>>> NMA Top 100 Interactive Agencies - Ones to watch!
>>> http://www.codegent.com/top100/
>>>
>>> want to know more?
>>> http://www.codegent.com/showreel/
>>>
>>> This e-mail may contain information which is privileged,  
>>> confidential and protected from disclosure. If you are not the  
>>> intended recipient of this e-mail, or any part of it, please  
>>> delete this email and any attachments immediately on receipt. You  
>>> should not disclose the contents to any other person or take  
>>> copies. Any views expressed in this message are those of the  
>>> individual sender, except where the sender specifically states  
>>> them to be the views of codegent limited.
>>> _______________________________________________
>>> Red5devs mailing list
>>> Red5devs at osflash.org
>>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>>
>>>
>>>
>>>
>>> -- 
>>> Best Regards
>>> Steven Gong
>>>
>>> InfraRed5 Red5 Consultant: http://www.infrared5.com , steven at infrared5.com
>>>
>>> Red5 Developer: http://osflash.org/red5, http://jira.red5.org/confluence/display/ 
>>> ~steven/Home
>>>
>>> Modesty is an overrated quality in men of no great  
>>> accomplishment.  -- Ricky Jay  
>>> _______________________________________________
>>>
>>> Red5devs mailing list
>>> Red5devs at osflash.org
>>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>
>>
>> _______________________________________________
>> Red5devs mailing list
>> Red5devs at osflash.org
>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>
>>
>>
>>
>> -- 
>> Best Regards
>> Steven Gong
>>
>> InfraRed5 Red5 Consultant: http://www.infrared5.com , steven at infrared5.com
>>
>> Red5 Developer: http://osflash.org/red5, http://jira.red5.org/confluence/display/ 
>> ~steven/Home
>>
>> Modesty is an overrated quality in men of no great accomplishment.   
>> -- Ricky Jay
>>
>> _______________________________________________
>> Red5devs mailing list
>> Red5devs at osflash.org
>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>
>>
>>
>>
>> -- 
>> Luke Hubbard
>> codegent | coding for the people
>> http://www.codegent.com
>>
>> NMA Top 100 Interactive Agencies - Ones to watch!
>> http://www.codegent.com/top100/
>>
>> want to know more?
>> http://www.codegent.com/showreel/
>>
>> This e-mail may contain information which is privileged,  
>> confidential and protected from disclosure. If you are not the  
>> intended recipient of this e-mail, or any part of it, please delete  
>> this email and any attachments immediately on receipt. You should  
>> not disclose the contents to any other person or take copies. Any  
>> views expressed in this message are those of the individual sender,  
>> except where the sender specifically states them to be the views of  
>> codegent limited.
>>
>> _______________________________________________
>> Red5devs mailing list
>> Red5devs at osflash.org
>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>
>>
>>
>>
>> -- 
>> It is difficult to free fools from the chains they revere. - Voltaire
>>
>> _______________________________________________
>> Red5devs mailing list
>> Red5devs at osflash.org
>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>>
>>
>>
>>
>> -- 
>> Best Regards
>> Steven Gong
>>
>> InfraRed5 Red5 Consultant: http://www.infrared5.com , steven at infrared5.com
>>
>> Red5 Developer: http://osflash.org/red5, http://jira.red5.org/confluence/display/ 
>> ~steven/Home
>>
>> Modesty is an overrated quality in men of no great accomplishment.   
>> -- Ricky Jay _______________________________________________
>> Red5devs mailing list
>> Red5devs at osflash.org
>> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>
> _______________________________________________
> Red5devs mailing list
> Red5devs at osflash.org
> http://osflash.org/mailman/listinfo/red5devs_osflash.org

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://osflash.org/pipermail/red5devs_osflash.org/attachments/20080123/dbd3940e/attachment.html 