Friday, May 26, 2006

Currently the work is progressing on 4 (technical) fronts:

1. Java (Swing) application: A prototype Training Softare.

2. Java Applet: Internet Deployable as well as Standalone Training Software
Would also be used to 'SEE' streaming videos. also could be made portable with palm/lap top

3. MObile version

4. electronic version (independent device)

Monday, May 22, 2006






AU-dible pi-XEL (AUXEL)






Auxel Project is all about converting a digital picture to sound (and touch) sensation for blind people to sense the image.

It works on very simple principle:

Digital image is taken one pixel at a time and each pixel is converted in to sound and touch input.

This infromation through the medium of ears(sound) is used by blind person to create a mental image just like naturally sighted human beings use eyes to create a mental image.

We read english text in following manner: starting from the top row …. And each row from left to right… and then next row… again left to right…

Same is the format of picking pixels from an image one by one … starting from the top left corner to the top right corner.. And then next row left to right..
and so on until the last row is reached.(more explaination on next sheet, pattern & order)

The final objective is to implant a image sensing chip (tiny digital camera) of a goggle like this:
Bitmap
Then Convert the stream of images captured by camera to sound and touch sensation
This means: A totally portable, wirefree, ordinary (infact stylish) looking goggle
giving a COLORED vision to the blind people via ears and skin!

Training Software to teach AUXEL language to the blind students is a tool that will enable
blind people to recognise the image that is being streamed via the goggle's camera.

Training starts with tiny pictures of size: 3pixel x 3 pixel to teach the pattern
Once the pattern and order of image is understood.. Size of picture is increased
5x5, 7x7, 9x9, 15x15 and so on…

Initially only two HUEs (frequencies) are introduced… once they are able to indentify hues distinctly (which usually happens in few minutes!)more and more HUEs are introduced.

Similarly for Saturation (touch sensation/vibrations), and Luminosity ( volume at which hue's frequency is to be sounded)

AUXEL PROJECT BLOCK DIAGRAM :





Next:
Marker Sounds

Sunday, May 21, 2006

RGB to HSL Conversion

We can not directly use the RGB data we extracted from image file to generate sound or tactile sensation.

So we have to convert the RGB data in to a different form : HUE, CHROMA/SATURATION and LUMINANCE

Hue: This is the most familiar color attribute: the quality we identify with a common color name such as red, green, yellow or blue.

Lightness: The second colormaking attribute is also very familiar: the light or dark of a color as a source of emitted or reflected light.

This is what artist's commonly call the tonal value or simply value of a color

Chroma is the intensity or purity of hue, regardless of how light or dark it is. An intense or highly chromatic color looks very luminous or concentrated, just as if it came through a prism, while a color with low chroma looks dull, gray, faded or diluted.

(Chroma and Saturations are different but quite similar)

Algorithm to convert
RGB —> HSL


Bitmap
var_R = ( R / 255 ) //Where RGB values = 0 ÷ 255
var_G = ( G / 255 )
var_B = ( B / 255 )
var_Min = min( var_R, var_G, var_B ) //Min. value of RGB
var_Max = max( var_R, var_G, var_B ) //Max. value of RGB
del_Max = var_Max - var_Min //Delta RGB value
L = ( var_Max + var_Min ) / 2
if ( del_Max == 0 ) //This is a gray, no chroma...
{
H = 0 //HSL results = 0 ÷ 1
S = 0
}
else //Chromatic data...
{
if ( L < s =" del_Max" s =" del_Max" del_r =" (" del_g =" (" del_b =" (" var_r ="="" h =" del_B" var_g ="="" h =" (" var_b ="="" h =" ("> 1 ) ; H -= 1
}

ok cool! Now we have HSL values converted from RGB!
lets check if we got our algorithm working correctly!

http://www.easyrgb.com/math.php?MATH=M22
<--- this site says that we have 0 to 240 as H's, S's, and L's range…

which MS paint also agrees with. (try it out!)

open up MS PAINT (Paintbrush application)
click on colors (in menu)
choose EDIT COLORS option
then click on DEFINE CUSTOM COLORS
here you can put RGB values
and check out if HSL values are same as our algorithm is giving us!

alternatively you can check it out on this website: http://www.artofwebdesign.net/colour/hsltorgb.php
There are lot of updates and new things happening technically in this project .

I would be glad to share most recent updated details with you !

just write to me on omkar.nisal@gmail.com

cheers

Omeee


PS: kindly write down about yourself too! :)

Sunday, March 26, 2006