Wednesday, 29 January 2014

The start of Macsen's journey with EyeGaze

Macsen Williams is a complex and amazing little boy.  We always felt that Macsen understood what was going on, but his multiple problems stopped him from showing it.  He has evolving 4 limb cerebral palsy, epilepsy and Cortical Visual Impairment (CVI).  
 
We have been very lucky to work with lots of specialists who agreed with us about his potential.  As an IT professional and keen technologist I was looking into what tech can help.  When he was around 18 months old I bought Macsen some switches and iPad apps. I was very excited about how they could help; unfortunately I couldn't get Macsen to engage with them at all... Macsen finds it hard to focus on more than once sense at a time.  If he is feeling or touching he will look away.  When he's looking his arms will go stiff. When he's listening he has no interest in anything else...

While at Bobath (a specialist therapy centre which helps young people with cerebral palsy) I mentioned the technology that we tried.  An amazing speech therapist (Niki) was very tactful, but delivered the news that switch interaction would be difficult for Macsen.  She knew that Macsen would struggle with the connection between pressing a button and seeing the result on screen, especially as he would be looking the other way :).  

Niki asked us whether we had heard of EyeGaze technology and she told us to google Tobii.  As soon as I got home I looked it up.  I was very impressed, but I dismissed it as Macsen had recently been registered blind (severe visual impairment).  We were working with a Visual Impairment teacher who had taught us how to gradually build up his visual skills.  We introduced shapes and colours gradually, naming objects and announcing when he should look.  He was showing progress, but our long term expectations were low.

Thankfully Bobath and Niki continued to investigate eye gaze tech and when Macsen was 18 months old they invited us to a trial with Tobii.  Here is a video from the trial (link):


The 5th of February was one of the most emotional days of our lives.  It was the first day that Macsen was able to demonstrate his intelligence.  When we were 10 minutes in Macsen had tried a few activities, but had only glanced at the objects a few times.  The facilitator (Hector Minto, UK Sales Manager) turned to the group and described how the technology worked.  All our attention was focused on Hector and the Tobii was left showing a green field with 10 or so targets on it.  While Hector spoke we heard an arrow hitting a target... Then another... Then suddenly all the targets fell and Macsen bust into laughter!  I cannot explain how we felt... He was playing on his own!  You could compare the feeling to when a child says their first word, or walks for the first time, but I'm sorry, they don't come close.  Developmental milestones build up over a weeks and months, but to go from nothing to personally led play within 20 minutes... It doesn't get bigger than that!

During the trial Macsen worked through lots of activities with highlights including drawing his first picture, popping bubble wrap and matching pairs of playing cards.  At the end of the session we had so many emotions.  We were proud of what Macsen had achieved, excited about Macsen's future, but strangely guilty that we hadn't unlocked this ability sooner.

The next 6 months were a whirlwind.  Our amazing friends, family and community got together to raise finds to buy Macsen his very own system.  Since receiving his system Macsen has had really great sessions where he's had lots of fun.  Here he is playing drums at 2 years old (link):


We also believe it has helped to improve his vision.  We have noticed that when using the system is able to focus for longer periods; he is also able to find specific items on request like animals on a farmyard.  We know that with CVI a child will develop by looking at consistent images/objects and his games have demonstrated this!

Eye gaze technology has created so many opportunities for Macsen's future.  We expect that it will help to develop his vision, give him opportunities to play and we hope that it will eventually give him a voice.
The next part of the journey was not always so easy, but we'll cover that in a future blog post: "How we overcame our EyeGaze challenges"...

Monday, 2 December 2013

Lights in Your Eyes

In the last post we covered how to set your eye control or touch computer to control a toy or bubble machine; this was all about giving restricted child the ability to control small things around them.  What if we took this to the next level?  What if they could turn the lights on and off?  Or dim them?  Or brighten them?  Or even change their colour?  Well that's exactly what we are going to cover in this post.

In Macsen's therapy room we setup special wifi lightbulbs that change colour.  They are especially effective in his room as we have a set of 6 and have painted the cellin and walls completely white.  Here's some pictures of the effect:





The lights can be controlled by the out of the box remote control, iPhone/android app or the Tobii Communicator pageset that I created.





To set this up,yourself you will need:
* A set of Easybulbs and a Wifi controller.  You can buy a set of 4 with a wifi controller and remote for £77: http://www.easybulb.com/4-easybulb-rgbw-6w-led-light-bulb-remote-control/ (in some countries they are known as MILight or Limitless LED)

* An eye gaze or touch screen windows system (we use Tobii PCeye go http://sensoryguru.com/products/pceyego/)
* A copy of Tobii Communicator
* Access to the settings of your wifi router

What do do:
* Setup the lightbulbs to use the remote using the in box instructions and test
* Configure the Wifi controller using this web page: http://www.easybulb.com/support/ and test with your smartphone or tablet

* Log into your wifi router settings, find the wifi controller (named Link_Wi-Fi), change it's IPAddress to static/reserved and note the IP address (detailed steps are included for Sky routers at the end or the post)


* Install .net framework 4.5 (http://www.microsoft.com/en-gb/download/details.aspx?id=30653)
* Unzip the files downloaded from pageset central (http://www.pagesetcentral.com/home?task=view.download&cid=1030)
* Copy the EasyBulbControl.exe and EasyBulbControl.exe.config files for the unzipped folder into the C:\Program Files\EasyBulbControl folder
* Open the EasyBulbControl.exe.config file in notepad and set the following values:

      * Set the IP Address to the one you noted above for Link_Wi-Fi
      * BulbType will either be RGBW or RGB depending on the type of bulb you bought
* Copy Colour Wheel.cdd into your standard pageset folder


* To test the app works, run the following program C:\Program Files\EasyBulbControl\EasyBulbControl.exe.  From this form you should be able to turn the lights on and off as well as changing the colour.


If that worked, open your new pageset and you should now be able to control the bulbs and change your environment with your eyes!




Example steps to fix an IP Address


These steps will be slightly different for each type of router and broadband supplier.  Below are the steps for a sky router:


Open a browser and connect to your router.  For sky it's generally http://192.168.0.1

 

Navigate to the attached devices page.  If prompted for a username and password, set:
    Username: admin
    Password: sky


Find the item Link_Wi-Fi, note the IP Address and MAC Address.


Navigate to the LAN IP Setup page and add and Address Reservation for Link_Wi-Fi with the IP and MAC address you noted.

 

The WIFI controller may need to be turned off and on again after this change.

Blowing Bubble With Your Eyes

When I think back to my childhood I always remember being mesmerised by blowing bubbles.  It seems I've passed this onto my eldest son who also loves them; whenever we go shopping he's always nagging for me to buy a bottle or two!  My youngest son (who has lots of problems including 4 limb Cerebral Palsy and Visual Impairment) doesn't miss out.  He loves to watch his brother blowing bubbles and watching them fly off into the distance.  There is only one thing missing... He isn't in control... He cannot physically blow them... He can't ask his brother or parents to blow them... He just has to sit and wait...  Or does he?  I set out to find a way to give him control to blow bubbles whenever he likes and this blog shows you how we did it!

What you will need:
* An eye gaze (we use Tobii PCeye go http://sensoryguru.com/products/pceyego/) or touch screen system
* Tobii Communicator or similar grid/communication product
* A switch/toy controller (we use the BJ Toy Control Box http://www.inclusive.co.uk/toy-control-box-p6543)




What to do:
* Connect the switch controller to your PC via a USB port
* Connect the bubble machine to the switch controller (we used port 1)
* Install the switch controller tools using the instructions that come with the product
* Test that the bubble machine works by using the switch controller instructions
* Create a new or edit an existing communicator pageset (instructions can be found here http://www.tobii.com/en/assistive-technology/global/products/software/tobii-communicator/support--downloads/)
* Add a new button or select and existing one.  Right click and choose Button actions from the context menu:

* Check the Show all available actions checkbox:

* Selected the Desktop tab, Run program option and click the Add button:

* In the Run program dialogue enter the following values:
      Select file = BJToyBoxCmd.exe
      Parameters = -s 1 4000

**** Note: -s means scilent (do not show a message), 1 relates to the port that the bubble machine is connected to (can be 1, 2, 3 or 4) and 4000 relates to the amount of time the machine will run for.  4000 = 4 seconds ****

Finally run the pageset, click the button and watch the bubbles fly.  My next challenge is getting my wife to allow us to use a bubble machine indoors!

Please take a minute to post a comment and subscribe to my blog.  Thanks for reading!