Progress II

Blocks and blocks of my babies ! XD

So what does my camera see?

What does Processing do? (I set up a server here to send data to port 9002, where flash retrieves the data from..)

Finally, Flash! Those numbers that you see may look meaningless now.. but it contains the marker's X and Y axis positions (something like coordinates), the rotation angle, whether it's added/removed, and the most important thing...their unique IDs! (have yet to add the code for the IDs..will do so now..)

Now, to hunt for a Flash animation developer.. who can code in AS3 as well! I'm sick of this already.. might have to add in codes for multiple camera input.. =(

Anyone willing to do it for free? nyeh heh heh.. =x

My savior!

Ze genius!

Thanks to his tutorials, I'm finally making some progress. . .

Tutorial Part I

Tutorial Part II

Time is running out. .

So now I have a few options.. Either:

1) Reactivision > Tuio > FLOSC > Flash

2) Reactivison > Processing > Flash

will be going for option(2) since it "looks" easier.. That's for the visuals.. as for the sound.. have to combine with MIDI as well.. that will be for a later stage.. but it will be so cool to use fiducial to interact with light and music!

References:

Processing>flash

Reactivision>MIDI

Progress!

So I ditched the "table" idea for now because I don't really have the capital to build one from scratch and the one we have in the office doesn't support fiducial recognition! I've decided to improvise and do up one that utilises the top projection system that we have..

I have been sawing and drilling aluminium rods and L-brackets to make these metal cubes! I will then mount the fiducial markers (super big ones!) on a cardboard and mount on the cubes (like a dice!).

Hopefully this will work.. I am slowly getting the gist of building my own flash app.. but the linking of touchlib and reactivision is still uncompleted! -.-"

Development of a Multi Touch System with Fiducial Recognition

I'll be using this blog to document the process of this whole project's development.. Basically I have to get this running before running back (off) to Singapore in August.. (At least get the hardware and some simple software running first..)

So I've decided for now to use the Diffused Surface Illumination (DSI) technique for my future (non-existent as of yet) MT table. Why DSI? Because it is only 1 of 2 techniques that makes fiducial (or any other objects for that matter) tracking possible. The DSI setup is much simpler too compared to the other one, but it is nearly impossible to get Endlighten acrylic here (and it's fucking expensive too).

I have drawn up a list of materials that I will need for the hardware:

1) Projector - Use existing one in the office?

2) Camera - Use a cheap webcam? Will have to dismantle and remove the IR filter (or use sandpaper to file it away =/)

3) Band pass filter lens for the camera (850nm? depends on the wavelength of the IR LED strips that I can get)

4) IR LED strips (850nm? seem like it works better than the 900+nm ones..)

5) Endlighten acrylic/plexiglass - Ship from the US? Or Singapore? or just use regular acrylic and get some diffusing compliant material (like silicone, which is a bitch to layer on perfectly on the acrylic) sandwiched between the acrylic and another thinner layer.

6) A nice casing to house it all in! I haven't decided on the layout of the entire setup, but depending on the situation (presence of hot spots/ghosting), I might have to get a hot mirror(to eliminate hotspots) and/or a front surface mirror (reduces the distance for the projector and camera and also reduces ghosting)

For the software.. it seems that touchlib is the way to go.. but I need something that can do fiducial tracking AND finger tracking.. reactivision can do the fiducial part, but it sucks in terms of finger tracking (and is harder to do the interfacing). Ah, the DILEMMA! And I'm getting so frustrated trying to code in Flash and ActionScript! I'm a newbie in this field unfortunately =(

FML, I thought the programming nightmare would've ended when my Major Project was done.. ='(

References:

http://peauproductions.blogspot.com/2009/03/received-endlighten-acylic-and.html

http://nuigroup.com/forums/viewthread/1982/