[Papervision3D] Face Tracking for Papervision VR

Mon Aug 24 22:46:03 PDT 2009

OpenCV would ultimately be the choice as far as a free to use options,
though there are quite a few face based projects on SourceForge.net -
what we ultimately hope to get is tracking of the face as well as
approximation for the eyes

There's a few examples of this floating about
http://www.betaface.com/Demo.aspx - but not sure if the same thing can
be easily done with OpenCV

With the eyes, you can determine distance and rotation (within reason)

The ultimate would be to license something along the lines of
http://www.seeingmachines.com/product/faceapi/ - but I cannot imagine
this working hand in hand with flash.  

They have plenty of demos showing 6DOF head tracking simply from facial
recognition (and a Johnny Lee inspired demo)

http://www.seeingmachines.com/product/faceapi/faceapi-videos/

Haven't had a lot time to explore this stuff further, but it's
definitely on the cards.

________________________________

From: papervision3d-bounces at osflash.org
[mailto:papervision3d-bounces at osflash.org] On Behalf Of Jake Lewis
Sent: Tuesday, August 18, 2009 4:03 AM
To: papervision3d at osflash.org
Subject: Re: [Papervision3D] Face Tracking for Papervision VR

Hi Clint,

What is the other C based face detection library you have in mind (apart
from OpenCV is assume)?

Jake

2009/3/16 Clint Hannaford <clint at boffswana.com>

Hi there Steven,

I was quite aware of the work you had done, and I had tried using Deface
to do this type of thing along with Marilena, but both were extremely
slow when it came to realtime face tracking.  We were getting 3-5 fps at
best, when combined with papervisions overheads.  We had decided to try
and see if there were ways to optimise them, down the track, once our
workload had eased in the coming weeks, possibly even lookling into
Alchemy and another C based face detection library.  Then Quasimondo
posted his optimisations.

Not trying to take anything away from the work you had done, which is
great.

I guess the exciting thing for us now, is that there's now a solution
that runs at a near acceptable speed for this Johnny Lee style head
tracking VR display, without the need for the WiiMote.

It opens up a lot of possibilities.

Looking forward to any optimisations that you make to the Deface
library...

Regards,
Clint.

-----Original Message-----
From: papervision3d-bounces at osflash.org on behalf of Steve Shipman
Sent: Tue 3/17/2009 2:52 AM
To: papervision3d at osflash.org
Subject: Re: [Papervision3D] Face Tracking for Papervision VR

Sigh.  I did this over a year ago with my own implementation of face
detection.
http://board.flashkit.com/board/showpost.php?p=4013716&postcount=8
(forum
post from back then, but proof of concept was never online).

Not really complaining, just sad that it's now hailed as so awesome when
it
was ignored back then.

I'll have to look through the optimized marilena and see if I can
improve
deface.

2009/3/16 Francisco Murillo <fmurillo at gmail.com>

> is there any video to see this..  for those without a camera
(including
> me)...   thanks
>
>
>
>
> 2009/3/16 Clint Hannaford <clint at boffswana.com>
>
>> Hi olee
>>
>> We toyed with distance using the size of the detection box, but that
>> proved a bit too unstable, so only left right, up and down at
present.
>>
>> Head rotation is also a problem.  It's good up until a point.
>>
>> We're looking into whether Alchemy will be a silver bullet in this
regard,
>> with another face detection library.
>>
>> Ultimately if you can detect the location and distance between the
eyes,
>> you'd be able to do an awful lot of cool stuff with this type of
thing.
>>
>>
>> -----Original Message-----
>> From: papervision3d-bounces at osflash.org on behalf of o renken
>> Sent: Mon 3/16/2009 10:54 PM
>> To: papervision3d at osflash.org
>> Subject: Re: [Papervision3D] Face Tracking for Papervision VR
>>
>> Awesome, unfortunately ive got no webcam here.
>> Iam working on a virtual window in the last days.
>> Iam curious if you
>> a) solved to display the distance between viewers head to the virtual
>> window
>> and
>> b) head-rotation, too.
>>
>> Do you share your code?
>>
>> cheers,
>> olee
>>
>> 2009/3/16 Clint Hannaford <clint at boffswana.com>
>>
>> >
>> > Hi all,
>> >
>> > We've just put up a post up on our blog, showcasing a tech demo
based
>> > around Johnny Lees Wiimote head tracking.
>> >
>> > With this one you don't need the wiimote, just a webcam and flash.
>> >
>> > http://www.boffswana.com/news/?p=498
>> >
>> > I should note that Mr Doob beat us to the punch by posting an
article on
>> > the exact same thing before we could get our demo up.
>> >
>> > http://mrdoob.com/blog/post/643
>> >
>> > Always the way...
>> >
>> > Credit also to Quasimondo for his work optimising the Marilena
class
>> >
>> > Regards
>> >
>> >
>>
------------------------------------------------------------------------
-
>> >
>> > Clint Hannaford
>> >
>> > Senior Flash Developer
>> >
>> > Boffswana
>> > 180 Bank Street
>> > South Melbourne Victoria 3205 Australia
>> >
>> > direct: + 61 3 9251 1768
>> > studio: +61 3 9251 1789
>> > fax: + 61 3 9699 8111
>> >
>> > clint at boffswana.com
>> >
>> > www.boffswana.com
>> >
>> > This email message (including any file attachments transmitted with
it)
>> is
>> > for the sole use of the individual or entity to whom it is
addressed and
>> may
>> > contain confidential and privileged information. Any unauthorised
>> review,
>> > use, alteration, disclosure or distribution is prohibited. If you
have
>> > received this email in error, please notify the sender by return
email
>> and
>> > destroy all copies of the original message. Any confidentiality or
legal
>> > professional privilege is not waived or lost by any mistaken
delivery of
>> the
>> > email. Opinions, conclusions and other information in this message
that
>> do
>> > not relate to the official business of the company shall be
understood
>> as
>> > neither given nor endorsed by it.  And have a great day!
>> >
>> > _______________________________________________
>> > Papervision3D mailing list
>> > Papervision3D at osflash.org
>> > http://osflash.org/mailman/listinfo/papervision3d_osflash.org
>> >
>> >
>>
>>
>> --
>> http://www.renkster.de/
>>
>>
>> _______________________________________________
>> Papervision3D mailing list
>> Papervision3D at osflash.org
>> http://osflash.org/mailman/listinfo/papervision3d_osflash.org
>>
>>
>
>
> --
> ---------------------------------------------------
> Francisco Murillo C.
> (506) 8864-1079
> http://www.frazko.com
>
> _______________________________________________
> Papervision3D mailing list
> Papervision3D at osflash.org
> http://osflash.org/mailman/listinfo/papervision3d_osflash.org
>
>

_______________________________________________
Papervision3D mailing list
Papervision3D at osflash.org
http://osflash.org/mailman/listinfo/papervision3d_osflash.org

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://osflash.org/pipermail/papervision3d_osflash.org/attachments/20090825/9f83e53f/attachment.html>