Welcome to RobotBox!

RobotBox is a community for robot builders to show off their projects. Add yours today.

Features of RobotBox

  • Showcase projects
  • Make new friends
  • Rate other's robots

Note: Facebook Connect temporarily disabled. Go here to login without it.

NINA

Category: Rolling
Progress: In Progress
Cost: 1000 USD +
Time to Build: Three Years

NINA is a large-scale experiemental robotics platform. Her main function at the moment is to explore applications for robotic social machines--a social machine is a term I coined for robots or computer characters that interact with humans socially like a chatbot, but something that can show expression visually. I'm trying to explore the idea or push the idea of social machines to benefit people with communication difficulties, like those with Asperger Syndrome or "high-functioning" autism. It's understood that robots and computer characters like chatbots can goof up, however, so to optimize social machines I propose that products ought to be connected to servers with hundreds of people constantly collaborating and improving social machines, while optimizing them to work with member of the "high-functioning" autism spectrum.

NINA is a little taller than four-feet and weighs about 50 lbs. Her frame is constructed out of aluminum and is fastened together by nuts and bolts. Her treads are lynxmotion tracks with AndyMark Inc. aluminum hubs.

Motors are 12V 95 max RPM, 100+ ft-lbs of stall torque (small and lightweight, but still powerful enough to move her around without being too fast and dangerous). Her motor driver is a Sabertooth 2X25. For articulation, she is equipped with Hitec Large Scale, standard and microservos, as well as ServoCity Powerservos of different degrees. She had a total of 13 degrees of freem from her servos. (1 at the hips, 6 in the arm, 2 in the neck, 4 for eyebrows/eyelids). She uses a lynxmotion Serial Servo Controller (the SSC-32) for servocontrol.

For vision, she uses two Cyber Snipa Spotter webcams. She is capable of detecting faces only right now, but will someday be able to range-find via stereovision, among many other algorithms, utilizing OpenCV. She is being programed to track and follow faces as well (it works, but needs  a little fine-tuning). I may equip her with a third, smaller camera for face detection to make it easier. She recognizes voice commands and can synthesize speech using Windows Speech recognition engine and Cepstral Robin's computer voice. She can hold a very limited conversation about various topics like music, animals, jokes, and whatnot, while moving about in various gestures to accomodate her speech.

Sensors, besides her optics, include Sharp IR range finders, PING Ultrasonic range finders, and Parallax PIR sensors. She uses a SC84 servo controller board for sensors (you can turn any port on this board into a sensor port and has accomodations for 36 ADCs). Most of the servos are not mounted yet, but more will be mounted with her next refit.

The NINA robot uses Nimh battery packs to power motors, servos and sensors. Someday, however, I may switch to LiFe to decrease the payload futher.

For logic and processing, NINA just runs on my laptop, but I plan to give her a Mini ITX based computer system for on-board computing (I use a BIG laptop).

NINA has performed and demonstrated her abilities twice for two halloweens the past couple years. She is mastering shaking hands, waving hello/good-bye, but needs more fine-tuning with expressions--I need to learn more about servo interpolated movements, as the current interpolation algorithm I wrote is a very crude one.

She is programed in Python. The central Python script connects to everything--the Lynxmotion SSC-32, OpenCV, and the Windows Speech Recognition and voice synthesis, Motor Driver, and Sensors.

NINA's come a long way, and she still has a ways to go. In any regard, I will be excited to find out how far she is going what she will be capable of.


Videos: 
See video
See video
See video

Related Projects

Related robotRelated robotRelated robotRelated robotRelated robotRelated robotRelated robotRelated robot

Comments

JustinRatliff's picture

Can't wait to see how your

Can't wait to see how your project progresses.  I'm doing some similar robotics research to create robots geared towards social interaction, specificaly children with autism.  Its neat to find someone with a similar interest and passion towards that goal. 

WhiteCrow's picture

Thanks, Justin! It's exciting

Thanks, Justin!

It's exciting to meet someone who is also interested in autism-therapy robotics and robotic-human-interaction. NINA is actually going to be on dispaly at a booth for the Kern Autism Network Conference in Bakersfield on the February 4th (at least that's the plan), where she will be promoting the idea of more robotic-autism-related therapy. I'm currently giving her another good refit for the event.

milwaukeemachineman's picture

I like that Ninja kinda looks

I like that Ninja kinda looks like Johnny 5, always did like the triangle treads too.

WhiteCrow's picture

Thanks! I chose to emulate

Thanks!

I chose to emulate the J5/Wall-E look for NINA because it's popular among many people, and hopefully it will allow people to feel comfortable around NINA because they know of Robots like Johnny-5 and Wall-E for being compassionate characters.

Johnny-5 was a really interesting person for me as a kid. I related to him because in many ways Johnny-5 showed traits of Asperger Syndrome! He didn't always understand many important social concepts, he often echoed words and phrases as he heard them, like, "Fredrick, wait here. I'll be right back after these words!" Many with AS have a particular obsession that they are interested in. For Johnny-5, it was "Input!" Also, he had a hard time making friends, and was frightened of rejection and loneliness--in some ways I felt the same way as a kid, even though J5 and I both had a handful of loyal friends. The robot Johnny-5 kind of taught me it was okay to be funny and to laugh at yourself if you goof up, and that it was important to surround yourself with loyal friends who do accept you.

bot-thoughts's picture

Wow, that is a truly

Wow, that is a truly impressive project!  Interesting idea about collaborative human optimization of robot interaction. One interesting idea is that of Google's game for identifying pictures... people play a game while simultaneously helping to categorize pictures for search.  Sort of a distributed human computing concept. Similarly, one of the captcha systems out there also serves to convert scanned words to text with human help.  Maybe one could create a captcha system that includes your robot's expressions and humans can categorize them while simultaneously providing robot feedback (e.g. does intent match expression).

Would love to hear much more about this robot... and eager to hear of your progress with it!

WhiteCrow's picture

Thanks, Bot-thoughts!

Thanks, Bot-thoughts! Interesting thoughts on such a capcha system. Very intriguing.

NINA still has a long way to do, but her application as a social machine shows promise.

I'm actually going to try and get her on display with me as her operator at a local Autism conference in February where I'm going to push the idea of social machines and other forms of robotic autism therapy (like Keepon).

One reason why NINA would not make an "ideal" social machine is: 1) she's a little too big and heavy and might be intimidating. 2) Her servos make a lot of noise. I have asperger syndrome myself and servo gears don't bother me particularly, but another friend of mine who also has Asperger syndrome once told me to turn off one of my robots because she couldn't take it. (certain sensory intake can become ubearable to those of us on the autism spectrum). NINA, however, is the only social machine I have.

If I can push the idea of social machines far enough, however, I propose these robots should either be smaller and quieter than NINA, or for special applications, some social machines could also be animated computer characters. The best part about an actual robot social machine is its tangible and more interactive for some things.

I'm anxious to prepare NINA for her day at the Autism Conference. I don't know if anyone on the spectrum will be there, besides Temple Grandin herself, so just to be on the safe side I'll have a function in her python programming to home all joints to rest position for deactivation of her servos. She'll still be able to see and talk and listen--she'll just be imobilized for the sensory-safety and security of those on the spectrum who might be bothered by servo gears. I'll upload another video once the whole refit is complete.

WhiteCrow's picture

Thanks Chrlsrchrdsn! That's

Thanks Chrlsrchrdsn!

That's precisely what I feel about robots too. They should help us where we need them. Already robots are saving lives in search and rescue missions, and they're helping us learn about the outer planets. Robots like ASIMO are being researched to see how they can help the elderly or disabled.

I don't give robots credit for intelligence either. Computers will get faster and more powerful, but as long as their architecture remains dictated by transistors and relays (like a metropolis of dominoes), robots have no real intelligence. Social Machines will not truly think and feel and be friends with their operators or users, but they can certainly act that way with the right programming. And as long as humans like to pretend robots like social mahines are alive, they can still benefit somewhat.

Here's an example. Dolphin therapy is great, but I read an artical once that there's is a facility where children are so sick that they can't safely leave or travel from the facility they reside. So the caring people who take care of these children highered the construction of a robot dolphin to look, feel, sound, move, and act like a real one. The robot was given to the facility itself. Children benefit from this robot the same way they would from "real" dolphin therapy. It was a beautiful article.

chrlsrchrdsn's picture

Great project!  Start getting

Great project!  Start getting the robots ready to walk among us and help us.  This is definitely the type of ongoing research project that is necessary to find out the best way we, humans and robots, can interact.  (BTW, I am not giving robots credit for intelligence, but both groups will end up reacting in some form.)

WhiteCrow's picture

Thanks! Sorry, I forgot to

Thanks!

Sorry, I forgot to hit reply before responding to your comment. :p

Very grateful for your words.