robandix NXT Hero

As i own a Lego NXT and a Android HTC Hero i combined them to give my robot eyes , ears and some sense ..


robandix NXT Hero

Used parts:
LEGO NXT 2.0
Android HTC Hero

Used programming languages:
LEGO NXT: NXC
Android HTC Hero:
Java (SDK)
and good old C (NDK) for audio and video analysis


Proof of concept: using Android Phone Sensors, Camera and Audio Input for NXT robot.

Communication between NXT and HTC Hero via Bluetooth.


The main objective was the simple coupling of robot and android smartphone.
As the new generation android smartphones brings a lot of sensors
(and video and audio capabilities of course) with (open source) documented programming capabilities,
i want to interface my HTC Hero to my robots to enhance their senses.
The main difficulties have been and are on the algorithmic side (voice recognition,
machine vision,..). Although the new devices are very powerful they have limited resources
concerning processing power etc. you have to consider.

The next step (in software) will be a more general library for these tasks,
with more flexible interfaces (as at the moment the base interface is limited
to the NXT proprietary communication interface via bluetooth).
The logical interface at the moment is in abstract a kind of mailbox communication.
And beyond this i plan to make some experiments in machine learning.

The next step (in hardware) is to replace the Lego NXT platform with something more powerful like the bioloid robot kit.