Free "FaceTracking" Guide

zild1221 · 22 July 10, 03:14

I am not the owner of any of this software, I just have done a lot of searching and tweaking to make this work properly. I figured I would share with you all.

Just a quick test I did.

This uses FaceAPI and another piece of software called FaceTrackNOIR. The FaceTrackNOIR software supports PPJoy and GlovePie so even if the game does not support FreeTrack or TrackIR and it does support analog looking, you can use this.

Screenshot of the software:

Files Needed:

1:FaceAPI
2:FaceTrackNOIR V1
3:FaceTrackNOIR Update
Additional Files:
PPJoy
GlovePIE

I recommend a camera that does 30FPS or better for this. Make sure all of your drivers all installed properly. Also, try to get the most even lighting on your face as possible. The more well lit side of your face WILL track better.

Retard-Proof Steps:

Install FaceAPI
Install FaceTrackNOIR
Drag and drop the files from the update into where you installed FaceTrackNOIR

I will explain how to get this working with rFactor and ArmA2. This has been confirmed to work with many sim titles including GTR2/EVO and iRacing. Any game supporting analog look features will be able to benefit from this as well using PPJoy and GlovePIE.

For rFactor:
In the FaceTrackNoIR software follow these steps:
1. Set the "Tracker Source" to FaceAPI.
2. Set "Game Protocol" to Fake TrackIR
The rest of these settings will completely depend on your lighting and the camera you use. I will try to explain what each does.

"Smoothing" attempts to smooth out any jittery'ness when tracking. Mine is at 3
Leave "EWMA filter" checked.
"Neutral Zone" defines the area close to where your head sits center. The bigger the number, the more deadzone. This is helpful if you move around a lot. Mine is set to 7.

Sensitivities are next.
Yaw is how sensitive turning your camera is. This is the most useful for racing. Mine is at 150.

Pitch is up and down. I keep this lower than the Yaw. Mine is at 100.

X and Y are the axis relative to the game. In racing this controls how you move around the cockpit. I have those set to 150 and 150.

Personally I do not like the roll in games. I just leave that off. You can fiddle with it if you like that.

Red.Factors: This adjust the "reaction time" from what I have found. It makes everything happen snappier. I would not use any more than 50, the lower you go the better, although it could get jittery. I would suggest trying to find a good combo of "Smoothing" and "Red. factor". Mine is at 42.

Once you get all of this stuff set, click "Start" in the upper left. You should see your camera on the bottom appear. It will look for your eyes, nose, and mouth/jaw. If it finds them properly, you should see yellow lines around them. Note: Try your best to put your head as close to where it always is before you click "Start". It WILL track better.

For this to work properly in rFactor, you are going to need to adjust some files.

These files are both located in your "rFactor\UserData\YourName" folder.

I would suggest using NotePad++ for this.

First open up "YourName.plr". Go to LINE 235 "Glance Rate" Replace with:

Code:

Glance Rate="7.00000" // Rate to follow controller for glancing

Go to LINE 236 "Look UP/DOWN Angle" Replace with:

Code:

Look Up/Down Angle="2.00000" // Angle to look up/down (pitch) w/ controller in radians (= degrees / 57)

Go to LINE 239 "Glance Angle" Replace with:

Code:

Glance Angle="5.00000" // Angle to look left/right (yaw) w/ controller in radians (= degrees / 57)

Now in that same folder go to your "Controller.ini" file. THESE ARE REALLY IMPORTANT!!

Go to LINE 28 "HMD Pitch Exponent" Replace with:

Code:

HMD Pitch Exponent="1.25000" // Exponent to apply to pitch tracking.  > 1.0 makes tracking near-center slower, > 0 & < 1.0 makes tracking near-center faster.

Go to LINE 29 "HMD Yaw Exponent" Replace with:

Code:

HMD Yaw Exponent="1.25000" // Exponent to apply to yaw tracking.  > 1.0 makes tracking near-center slower, > 0 & < 1.0 makes tracking near-center faster.

Go to LINE 31 "HMD LEFT/RIGHT Exponent" Replace with:

Code:

HMD Left/Right Range="0.00000" // Range to apply to left/right tracking or camera controls (0.35 = max, -0.35 = reversed max)

Go to LINE 32 "HMD UP/DOWN Exponent" Replace with:

Code:

HMD Up/Down Range="0.00000" // Range to apply to up/down tracking or camera controls (0.35 = max, -0.35 = reversed max)

Now, you may want to tweak some of these settings to your own liking. These are just what I found to work well personally.

To make this work, you have to launch rFactor, then tab out and launch the software and start the capture.

Depending on you Res. and FPS, your processor could be taxed from 5-12%.

The best camera for the money you can get for this is the Playstation Eye. **Not the EYETOY** This does an easy 60FPS and is made for FaceTracking. It runs from $24 used to $40 new. Not that bad.

I don't believe I am forgetting anything.

loon · 22 July 10, 10:08

can also use Freetrack mate from here http://www.free-track.net/english/fr...chargement.php more or less same thing,works with numerous titles also,great forum also on how to make the ir tracking clip or cap
regards

zild1221 · 22 July 10, 16:32

Yep. I was going to use freetrack until I saw this. You do not need to worry about a dumb clip with batteries for LEDS or reflector things. Just turn on your camera and let this see your face.

MickeyMouse · 22 July 10, 18:04

Very interesting if it works well. I'll definitely play with this later.

gord3001 · 23 July 10, 11:25

Anyone tried this with GTR2? or know how to install it for GTR2?

yetisaj · 23 July 10, 11:57

Quote:

Originally Posted by gord3001

Anyone tried this with GTR2? or know how to install it for GTR2?

Follow the instructions Zild posted for rFactor.

gord3001 · 23 July 10, 12:04

Thanks chap, I'm going to buy a webcam today and give this a shot.

dartguy · 23 July 10, 19:35

Post your results, please. Good Luck!

zild1221 · 23 July 10, 23:00

Wanted to let you guys know I got this to work with GTR2, RBR, and RaceOn today. It works exactly the same as rFactor, just changed a few values for sensitivity.

gord3001 · 24 July 10, 07:46

Yup just to confrim it works, I set my HMD settings to 2.00000 and played with the
programe settings and after a couple of hours it was working perfectly......
well maybe a little jittery. but i think that coz i only spent £15 on a webcam.

When i get payed next week im going to get the playstation eye camera as that is
the one that is reccomended.

Thanks again for the info zild1221 you have saved me a fortune, coz at some stage
I was going to get TrackIR for GTR2.

zild1221 · 24 July 10, 18:27

No problem. I am discussing content for future releases with the creator currently so any feedback you guys have, let me know. This is just an early release and there is much to come.

For the time being, if you did not know, = re-centers your head and bkspc toggles it on and off. The next version those will be configurable.

il_lupo_mannaro · 24 July 10, 20:40

Does it work with GPL?

zild1221 · 24 July 10, 21:36

GPL is supported by FreeTrack so if you change the protocol to Freetrack, it should work.

22 July 10, 03:14	#1
zild1221 Join Date: Dec 2009	Free "FaceTracking" Guide I am not the owner of any of this software, I just have done a lot of searching and tweaking to make this work properly. I figured I would share with you all. Just a quick test I did. This uses FaceAPI and another piece of software called FaceTrackNOIR. The FaceTrackNOIR software supports PPJoy and GlovePie so even if the game does not support FreeTrack or TrackIR and it does support analog looking, you can use this. Screenshot of the software: Files Needed: 1:FaceAPI 2:FaceTrackNOIR V1 3:FaceTrackNOIR Update Additional Files: PPJoy GlovePIE I recommend a camera that does 30FPS or better for this. Make sure all of your drivers all installed properly. Also, try to get the most even lighting on your face as possible. The more well lit side of your face WILL track better. Retard-Proof Steps: Install FaceAPI Install FaceTrackNOIR Drag and drop the files from the update into where you installed FaceTrackNOIR I will explain how to get this working with rFactor and ArmA2. This has been confirmed to work with many sim titles including GTR2/EVO and iRacing. Any game supporting analog look features will be able to benefit from this as well using PPJoy and GlovePIE. For rFactor: In the FaceTrackNoIR software follow these steps: 1. Set the "Tracker Source" to FaceAPI. 2. Set "Game Protocol" to Fake TrackIR The rest of these settings will completely depend on your lighting and the camera you use. I will try to explain what each does. "Smoothing" attempts to smooth out any jittery'ness when tracking. Mine is at 3 Leave "EWMA filter" checked. "Neutral Zone" defines the area close to where your head sits center. The bigger the number, the more deadzone. This is helpful if you move around a lot. Mine is set to 7. Sensitivities are next. Yaw is how sensitive turning your camera is. This is the most useful for racing. Mine is at 150. Pitch is up and down. I keep this lower than the Yaw. Mine is at 100. X and Y are the axis relative to the game. In racing this controls how you move around the cockpit. I have those set to 150 and 150. Personally I do not like the roll in games. I just leave that off. You can fiddle with it if you like that. Red.Factors: This adjust the "reaction time" from what I have found. It makes everything happen snappier. I would not use any more than 50, the lower you go the better, although it could get jittery. I would suggest trying to find a good combo of "Smoothing" and "Red. factor". Mine is at 42. Once you get all of this stuff set, click "Start" in the upper left. You should see your camera on the bottom appear. It will look for your eyes, nose, and mouth/jaw. If it finds them properly, you should see yellow lines around them. Note: Try your best to put your head as close to where it always is before you click "Start". It WILL track better. For this to work properly in rFactor, you are going to need to adjust some files. These files are both located in your "rFactor\UserData\YourName" folder. I would suggest using NotePad++ for this. First open up "YourName.plr". Go to LINE 235 "Glance Rate" Replace with: Code: Glance Rate="7.00000" // Rate to follow controller for glancing Go to LINE 236 "Look UP/DOWN Angle" Replace with: Code: Look Up/Down Angle="2.00000" // Angle to look up/down (pitch) w/ controller in radians (= degrees / 57) Go to LINE 239 "Glance Angle" Replace with: Code: Glance Angle="5.00000" // Angle to look left/right (yaw) w/ controller in radians (= degrees / 57) Now in that same folder go to your "Controller.ini" file. THESE ARE REALLY IMPORTANT!! Go to LINE 28 "HMD Pitch Exponent" Replace with: Code: HMD Pitch Exponent="1.25000" // Exponent to apply to pitch tracking. > 1.0 makes tracking near-center slower, > 0 & < 1.0 makes tracking near-center faster. Go to LINE 29 "HMD Yaw Exponent" Replace with: Code: HMD Yaw Exponent="1.25000" // Exponent to apply to yaw tracking. > 1.0 makes tracking near-center slower, > 0 & < 1.0 makes tracking near-center faster. Go to LINE 31 "HMD LEFT/RIGHT Exponent" Replace with: Code: HMD Left/Right Range="0.00000" // Range to apply to left/right tracking or camera controls (0.35 = max, -0.35 = reversed max) Go to LINE 32 "HMD UP/DOWN Exponent" Replace with: Code: HMD Up/Down Range="0.00000" // Range to apply to up/down tracking or camera controls (0.35 = max, -0.35 = reversed max) Now, you may want to tweak some of these settings to your own liking. These are just what I found to work well personally. To make this work, you have to launch rFactor, then tab out and launch the software and start the capture. Depending on you Res. and FPS, your processor could be taxed from 5-12%. The best camera for the money you can get for this is the Playstation Eye. Not the EYETOY This does an easy 60FPS and is made for FaceTracking. It runs from $24 used to $40 new. Not that bad. I don't believe I am forgetting anything.

22 July 10, 10:08	#2
loon Join Date: Dec 2006	can also use Freetrack mate from here http://www.free-track.net/english/fr...chargement.php more or less same thing,works with numerous titles also,great forum also on how to make the ir tracking clip or cap regards

22 July 10, 16:32	#3
zild1221 Join Date: Dec 2009	Yep. I was going to use freetrack until I saw this. You do not need to worry about a dumb clip with batteries for LEDS or reflector things. Just turn on your camera and let this see your face.

22 July 10, 18:04	#4
MickeyMouse Join Date: Jan 2007 Location: Ohio, USA Age: 23	Very interesting if it works well. I'll definitely play with this later.

23 July 10, 11:25	#5
gord3001 Join Date: Mar 2008	Anyone tried this with GTR2? or know how to install it for GTR2?

23 July 10, 12:04	#7
gord3001 Join Date: Mar 2008	Thanks chap, I'm going to buy a webcam today and give this a shot.

23 July 10, 19:35	#8
dartguy Join Date: Jan 2008 Location: Louisville Age: 39	Post your results, please. Good Luck!

23 July 10, 23:00	#9
zild1221 Join Date: Dec 2009	Wanted to let you guys know I got this to work with GTR2, RBR, and RaceOn today. It works exactly the same as rFactor, just changed a few values for sensitivity.

24 July 10, 07:46	#10
gord3001 Join Date: Mar 2008	Yup just to confrim it works, I set my HMD settings to 2.00000 and played with the programe settings and after a couple of hours it was working perfectly...... well maybe a little jittery. but i think that coz i only spent £15 on a webcam. When i get payed next week im going to get the playstation eye camera as that is the one that is reccomended. Thanks again for the info zild1221 you have saved me a fortune, coz at some stage I was going to get TrackIR for GTR2.

24 July 10, 18:27	#11
zild1221 Join Date: Dec 2009	No problem. I am discussing content for future releases with the creator currently so any feedback you guys have, let me know. This is just an early release and there is much to come. For the time being, if you did not know, = re-centers your head and bkspc toggles it on and off. The next version those will be configurable.

24 July 10, 20:40	#12
il_lupo_mannaro Join Date: Aug 2007	Does it work with GPL?

24 July 10, 21:36	#13
zild1221 Join Date: Dec 2009	GPL is supported by FreeTrack so if you change the protocol to Freetrack, it should work.