[Red5devs] Root cause of CPU overload on VOD streaming (was Re: Red5 0.7 Sprint)

Wed Jan 23 17:09:07 PST 2008

On Jan 24, 2008 12:24 AM, Chris Allen <mrchrisallen at gmail.com> wrote:

> Nice Steven! So, are you going to implement this fix?
>
Yes, I will provide the fix before the release.

>
> -Chris
>
> On Jan 23, 2008, at 10:16 AM, Steven Gong wrote:
>
> Hi all,
> I found the root cause of big CPU load on VOD streaming. It is caused by
> the loading of key frame metadata from metadata cache. A simple solution to
> this is to enhance the metadata cache implementation to cache the loaded
> metadata into memory for FLV rather than load it again from the file system
> each time.
>
> On Jan 22, 2008 11:58 PM, Mondain <mondain at gmail.com> wrote:
>
> > The load tester (src) is checked into the trunk btw..
> >
> >
> > On Jan 21, 2008 10:34 PM, Luke Hubbard <luke at codegent.net > wrote:
> >
> > > Hi Steven
> > >
> > > Yes please do.
> > >
> > > - Luke
> > >
> > >
> > > On 1/22/08, Steven Gong < steven.gong at gmail.com> wrote:
> > > >
> > > > Luke,
> > > > If you need Paul's load tester for the test, I can send a copy to
> > > > you.
> > > >
> > > > On Jan 22, 2008 7:34 AM, Dan Rossi <spam at electroteque.org> wrote:
> > > >
> > > > > Paul's load tester flex app is a good one to use but i dont think
> > > > > its accurate enough. I have tested the same app against FMS and Wowza and
> > > > > there was only 5% cpu used maximum.
> > > > > On 21/01/2008, at 7:43 PM, Steven Gong wrote:
> > > > >
> > > > >
> > > > >
> > > > > On Jan 21, 2008 4:27 PM, Luke Hubbard < luke at codegent.net> wrote:
> > > > >
> > > > > > I will try to test with a profiler see what is eating all that
> > > > > > CPU.
> > > > > > This is for VOD right, not live? Or both?
> > > > > >
> > > > > This is the VOD streaming and can be reproduced by a simple load
> > > > > test VOD playback.
> > > > >
> > > > > >
> > > > > > - Luke
> > > > > >
> > > > > >
> > > > > > On 1/21/08, Dan Rossi < spam at electroteque.org> wrote:
> > > > > > >
> > > > > > >  Less than that before its reaching 100% cpu. aparantly i go
> > > > > > > away on a break and everything goes down. It might be looking like we might
> > > > > > > have to jump onto the wowza bandwagon :\
> > > > > > > On 20/01/2008, at 9:55 AM, Dominick Accattato wrote:
> > > > > > >
> > > > > > > Dan:
> > > > > > >
> > > > > > > are you saying that the core can only handle 50-80 concurrent
> > > > > > > connections?
> > > > > > >
> > > > > > > On Jan 19, 2008, at 6:28 AM, Dan Rossi wrote:
> > > > > > >
> > > > > > > Great, i added the preliminary task in there but didnt get
> > > > > > > much responses about it at first :D Should we add back in the option to
> > > > > > > either compile javadoc in a full distribution task or not, that was added in
> > > > > > > as a suggestion from steve but was removed. It does reduce the recompile
> > > > > > > time alot.
> > > > > > > I believe the major one that i know of is the performance
> > > > > > > problems somewhere in the core, its maxing out at 50-80 concurrents.
> > > > > > >
> > > > > > > On 19/01/2008, at 3:15 AM, Mondain wrote:
> > > > > > >
> > > > > > > If we plan to inform users of the edge/origin features, we
> > > > > > > will also need to get those parts of the build script ironed-out before the
> > > > > > > release as well.
> > > > > > >
> > > > > > > Paul
> > > > > > >
> > > > > > > On Jan 18, 2008 4:52 AM, Lenny Sorey < lrsorey at gmail.com>
> > > > > > > wrote:
> > > > > > >
> > > > > > > > Hey Joachim,
> > > > > > > >
> > > > > > > > Welcome back!!
> > > > > > > >
> > > > > > > > Glad to see your return.
> > > > > > > >
> > > > > > > > Hope things are well with these days.
> > > > > > > >
> > > > > > > > Regards,
> > > > > > > >
> > > > > > > > Lenny
> > > > > > > >
> > > > > > > >
> > > > > > > > On 1/17/08, Dominick Accattato < daccattato at gmail.com>
> > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Team:
> > > > > > > > >
> > > > > > > > > I want to give Joachim a warm welcome back.  We missed ya!
> > > > > > > > >  Everyone has done a great job pushing Red5 forward from the
> > > > > > > > > 0.6 release.  In preparation of the release of 0.7, I'd
> > > > > > > > > like to get a few more fixes in.  If we can, lets try to get this stuff done
> > > > > > > > > asap so that we can get 0.7 out the door.  Here is what I
> > > > > > > > > find to be of importance for this release.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >    - http://jira.red5.org/browse/APPSERVER-184
> > > > > > > > >    - amf3 synchronization issue with SharedObjects (I
> > > > > > > > >    will provide Joachim with a test app)
> > > > > > > > >    - fix our tests since Paul noticed many of them are
> > > > > > > > >    failing
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > If anyone can think of any other important fixes, list
> > > > > > > > > them so that we can look into their priority.  Thanks team!
> > > > > > > > >
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > _______________________________________________
> > > > > > > > > Red5devs mailing list
> > > > > > > > > Red5devs at osflash.org
> > > > > > > > > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > > > _______________________________________________
> > > > > > > > Red5devs mailing list
> > > > > > > > Red5devs at osflash.org
> > > > > > > > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > --
> > > > > > > It is difficult to free fools from the chains they revere. -
> > > > > > > Voltaire _______________________________________________
> > > > > > > Red5devs mailing list
> > > > > > > Red5devs at osflash.org
> > > > > > > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> > > > > > >
> > > > > > >
> > > > > > > _______________________________________________
> > > > > > > Red5devs mailing list
> > > > > > > Red5devs at osflash.org
> > > > > > > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> > > > > > >
> > > > > > >
> > > > > > > _______________________________________________
> > > > > > > Red5devs mailing list
> > > > > > > Red5devs at osflash.org
> > > > > > > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > > _______________________________________________
> > > > > > > Red5devs mailing list
> > > > > > > Red5devs at osflash.org
> > > > > > > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > > > --
> > > > > > Luke Hubbard
> > > > > > codegent | coding for the people
> > > > > > http://www.codegent.com
> > > > > >
> > > > > > NMA Top 100 Interactive Agencies - Ones to watch!
> > > > > > http://www.codegent.com/top100/
> > > > > >
> > > > > > want to know more?
> > > > > > http://www.codegent.com/showreel/
> > > > > >
> > > > > > This e-mail may contain information which is privileged,
> > > > > > confidential and protected from disclosure. If you are not the intended
> > > > > > recipient of this e-mail, or any part of it, please delete this email and
> > > > > > any attachments immediately on receipt. You should not disclose the contents
> > > > > > to any other person or take copies. Any views expressed in this message are
> > > > > > those of the individual sender, except where the sender specifically states
> > > > > > them to be the views of codegent limited.
> > > > > > _______________________________________________
> > > > > > Red5devs mailing list
> > > > > > Red5devs at osflash.org
> > > > > > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> > > > > >
> > > > > >
> > > > >
> > > > >
> > > > > --
> > > > > Best Regards
> > > > > Steven Gong
> > > > >
> > > > > InfraRed5 Red5 Consultant: http://www.infrared5.com ,
> > > > > steven at infrared5.com
> > > > >
> > > > > Red5 Developer: http://osflash.org/red5, http://jira.red5.org/confluence/display/~steven/Home
> > > > > <http://jira.red5.org/confluence/display/%7Esteven/Home>
> > > > >
> > > > > Modesty is an overrated quality in men of no great accomplishment.
> > > > >  -- Ricky Jay _______________________________________________
> > > > > Red5devs mailing list
> > > > > Red5devs at osflash.org
> > > > > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> > > > >
> > > > >
> > > > >
> > > > > _______________________________________________
> > > > > Red5devs mailing list
> > > > > Red5devs at osflash.org
> > > > > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> > > > >
> > > > >
> > > >
> > > >
> > > > --
> > > > Best Regards
> > > > Steven Gong
> > > >
> > > > InfraRed5 Red5 Consultant: http://www.infrared5.com ,
> > > > steven at infrared5.com
> > > >
> > > > Red5 Developer: http://osflash.org/red5, http://jira.red5.org/confluence/display/~steven/Home
> > > > <http://jira.red5.org/confluence/display/%7Esteven/Home>
> > > >
> > > > Modesty is an overrated quality in men of no great accomplishment.
> > > >  -- Ricky Jay
> > > >
> > > > _______________________________________________
> > > > Red5devs mailing list
> > > > Red5devs at osflash.org
> > > > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> > > >
> > > >
> > >
> > >
> > > --
> > > Luke Hubbard
> > > codegent | coding for the people
> > > http://www.codegent.com
> > >
> > > NMA Top 100 Interactive Agencies - Ones to watch!
> > > http://www.codegent.com/top100/
> > >
> > > want to know more?
> > > http://www.codegent.com/showreel/
> > >
> > > This e-mail may contain information which is privileged, confidential
> > > and protected from disclosure. If you are not the intended recipient of this
> > > e-mail, or any part of it, please delete this email and any attachments
> > > immediately on receipt. You should not disclose the contents to any other
> > > person or take copies. Any views expressed in this message are those of the
> > > individual sender, except where the sender specifically states them to be
> > > the views of codegent limited.
> > >
> > > _______________________________________________
> > > Red5devs mailing list
> > > Red5devs at osflash.org
> > > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> > >
> > >
> >
> >
> > --
> > It is difficult to free fools from the chains they revere. - Voltaire
> >
> > _______________________________________________
> > Red5devs mailing list
> > Red5devs at osflash.org
> > http://osflash.org/mailman/listinfo/red5devs_osflash.org
> >
> >
>
>
> --
> Best Regards
> Steven Gong
>
> InfraRed5 Red5 Consultant: http://www.infrared5.com , steven at infrared5.com
>
> Red5 Developer: http://osflash.org/red5, http://jira.red5.org/confluence/display/~steven/Home
> <http://jira.red5.org/confluence/display/%7Esteven/Home>
>
> Modesty is an overrated quality in men of no great accomplishment.  --
> Ricky Jay _______________________________________________
> Red5devs mailing list
> Red5devs at osflash.org
> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>
>
>
> _______________________________________________
> Red5devs mailing list
> Red5devs at osflash.org
> http://osflash.org/mailman/listinfo/red5devs_osflash.org
>
>

-- 
Best Regards
Steven Gong

InfraRed5 Red5 Consultant: http://www.infrared5.com, steven at infrared5.com

Red5 Developer: http://osflash.org/red5,
http://jira.red5.org/confluence/display/~steven/Home

Modesty is an overrated quality in men of no great accomplishment.  -- Ricky
Jay
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://osflash.org/pipermail/red5devs_osflash.org/attachments/20080124/d9509673/attachment.html 