http://embrace-tech.com/2011/09/09/smart-home-technology-provides-affordable-adl-and-eadl-supports/

For a good summary of EU thinking and technology relative to “Smart Homes” see:

http://www.tiresias.org/cost219ter/inclusive_future/inclusive_future_book.pdf   especially Chapter 3 page 110

For a global perspective see the “International Conference on Smart Homes and Health Telematics”

http://www.icost2011.org 

H’mmm, having said all that, the important point is that there are at least two clear examples that the US is beginning to understand the concept of “Ambient Assistive Living” at least as it applies to those dealing with Traumatic Brain Injury or neurological disabilities.

James A. Haley Veterans’ Hospital Polytrauma Transitional Rehabilitation Program (PTRP)

http://www.rehab.research.va.gov/jour/11/488/jasiewicz488.html

and

Virginia Commonwealth University, VCU

http://www.ncbi.nlm.nih.gov/pubmed/19893189

In my humble opinion the above examples define opposite ends of the technology spectrum. The PTRP project defines the high-end of what’s technologically doable and the VCU implementation a more basic, less integrated solution. Both are valid designs and help define a broad spectrum of possible solutions.

To be sure, the technology is real and the need is real. The question is “Can we use sound engineering design methodology to transform the “bag of parts” that is Smart Home technology into a practical, repeatable and cost-effective “smart-home-based cognitive prosthetic” a.k.a. Ambient Assisted Living solution?

What’s needed is the “cross pollenization” of Smart Home technology,  engineering design discipline  and the TBI medical and clinical expertise. This Blog and the startup company Ambient Engineering … Solutions are my offerings to help bridge that gap.

The combination allowed me to control my laptop and create a simple MSWord document with only head movement and a forearm muscle twitch.

•On Screen Keyboard
–http://www.imgpresents.com/

•Camera Mouse
–http://www.cameramouse.org/

Screen shot of the on screen keyboard and Word document:

presentation -> Impulse Switch

This post has not yet been reviewed by my stalwart and trusted proofreader. Humorous typo’s and various grammatical anomalies could be lurking therein.

So, how do you answer the door bell if you have limited hand/arm functionality? Never mind opening the door, how can you tell who’s ringing the bell or actually have a chat with them before you open the door? A lower mounted fish-eye viewer might work…if you could lean forward to look thru it. But your voice isn’t strong enough to shout through the door and how would you open it anyway?

How about a system that lets you see a large clear image of the person at the door (before you open it) and have a two way conversation with that person…before you open the door? Suppose you could have this video/audio chat from most anywhere in the house, even your bed if you have transferred for the night?

If you look at the previous post, AzTAP: Smart Home Presentation and Demonstration you will see a block diagram of a small Smart Home system and the picture of a small wireless camera. This camera communicates via the in-house WiFi network and the video and audio is accessible to any laptop or desktop and many tablet computers and smart cell phones.

Using an application on your computer you can see the live video feed coming from the camera i.e. the person at the front door…if the camera were mounted outside, facing the front door. Using your computer’s microphone and speakers you can have a voice conversation with same individual using the camera’s built-in microphone and a pair of cheap powered speakers mounted next to the camera.

OK, in the demonstration video below, you are working on your laptop when the door bell rings, notice that our “simulated consumer” switches from her word document to the program managing the video feed from the camera. She selects the “talk” button and initiates a two way conversation with our “simulated FedEx” delivery person.

In a more complete Smart Home design the consumer would have a third window on her laptop or a voice command system that would allow her to remotely open the door as well.

see video -> http://www.youtube.com/watch?v=4pw46gTOYlI

This demo utilizes a laptop as the “user interface” however I’m betting today’s smart phones could be configured to function in this role as well. Once again Smart Home technology offers the potential for more choices, more control…more Independent Living.

Is this a simple solution, installable by your average ECU salesperson…no!  Does it solve the problem…yes! Oh yeah, that’s right “There’s a simple solution to every complex problem and it usually doesn’t work. A truly elegant solution solves the problem but hides the complexity.” In this demo our consumer has two buttons to press…talk and listen.

If you have not viewed the CSUN 2011 posting you should view that first before proceeding as I have not duplicated its content.

Important: If the presentation does not open and “auto run” it is necessary to select “Slideshow” from the Menu bar and then click “From Beginning.” The presentation incorporates multiple text effects and page timing that will not function unless the SlideShow is running. Note, the timing delays were meant to accommodate a somewhat distracted audience.

Opening PPT loop ->    Openning Loop rev F            

Turning lights on/off or controlling a TV/VCR/DVD is interesting but also well with the capability of existing, fixed technology ECUs. However, doing same via a cell phone or GUI (Graphical User Interface) on your laptop…from anywhere in the world…is a bit more challenging.

The system demonstrated in the following two videos is based on the voice recognition, home automation software, HAL2000 sold by www.homeautomatedliving.com.  The home automation system featured in the videos was configured using a typical PC running WinXP and HAL2000, an Ocelot controller http://www.appdig.com/adicon_new/ocelot.htm using typical IR and X-10 components and a residential DSL modem.

The DSL modem and router provided the “network backbone” utilized by the IP camera (wireless camera) and the PC. A combination of a Dynamic Domain Name System, DDNS application, www.dyndns.com and a computer network technique called “port forwarding” allowed the internal computer network to be accessible from outside the home i.e. from anywhere on the Internet. This Internet access is demonstrated in the first video actually recorded in a local McDonalds.

The cell phone interface demonstrated in the second video utilizes a proprietary PCI modem card installed in the PC. This modem also allows voice command access of the system from any extension phone in the house.

System Block Diagram

NOTE: The system as configured uses X-10 technology because it was cheap and totally funded with my own resources. X-10 is 30+ year old technology but can be made to work…within limits. There are far superior technologies (Z-wave and INSTEON for example) that should be considered unless cost is the only factor and the unreliability of X-10 can be tolerated.

In the first video, three screens are displayed. The first is the laptops web cam displaying my smiling face, the second is the live feed from the IP camera mounted in my living room and the third is the HAL2000 remote GUI executing on my laptop. The IP camera shown below is WiFi based with both video and audio feeds. It is utilizing the same DDNS software and port forwarding technology to allow external access via the Internet.

IP Camera

The first video shows me using “point and click” access to the GUI while the live video feed shows the resultant real time effect on the two lights and DVD/VCR/TV combination. Any operation that could be carried out inside the home can also be accomplished via the Internet.

Smart Home Video – Remote GUI Access -> http://www.youtube.com/watch?v=Hu2OBzKhktA

This second video is similar to the first except the GUI interface has been replaced with voice commands given via my cell phone. Not available to the viewer are the voice prompts and responses I’m hearing. Again the live video feed shows the result of each command.

Smart Home Video – Cell Phone Access -> http://www.youtube.com/watch?v=6djjU7FFKCI

While perhaps not obvious, the IP camera monitoring of the in house events is not connected or controlled by the HAL2000 software. The IP camera and software are functioning independently. This is the world of Smart Home or Home Automation Technology! Multiple independent products can be designed into a seamless solution that meets each individual consumer’s needs. Try doing that with a fixed technology ECU!

We here in the “colonies” talk about Smart Homes and Universal Design as if they were separate concepts. Universal design is often about making accommodations for people with disabilities and Smart Homes are for the convenience of the affluent or the play ground for techno-hobbyist. H’mmm, it appears I can’t resist a few social/political comments…whatever.

We in the US have much to learn from the EU and the melding of Universal Design and Smart Homes is a good place to start.

  to paper -> AmbI_meets_UD

While this can be read as a stand alone document, my previous post  “Research Paper: Smart Home Tech provides ADL and EADL supports” and attached link will provide useful context.

I say “slides” because it was not a PowerPoint presentation but instead a sequence of Mind Maps, JPEG images and video. The mind maps, especially the more complex maps provide far more structure and information than traditional PowerPoint slides filled with words, words and more static words that just sit there. Using the iMindMap presentation software, www.thinkbuzan.com  the maps can be expanded branch by branch. With mind maps the audience can see the structure of your thinking. I used PowerPoint for the ECU Demonstration presentation because it was intended to be stand alone documentation as well as a presentation.

The first image was projected while the audience was filling the room. The message was simple, “use technology to transform your living space into an Independent Living…Space.”

The next message renforce the first image, 
Digital Home Technology + Consumer Centric Design => more choices, more control => more Independent Living

Next a discussion on what exactly is Independent Living and how does this technology and design methodology apply.

The next mind map is obviously the most complex and the bulk of the presentation and discussion. Of primary importance in this approach is the concept of  design. We, the evaluation team, are “designing an environment” based on the consumer’s needs, attitudes, expectations of technology and most importantly the consumers “daily routines.” To that end, I have developed an Assessment Tool called “the Bridge” specifically to address this need to understand and document the consumer’s daily routines. It will be presented in a subsequent post.

Of significance, as a “process-oriented assessment tool,” the Bridge is also appropriate for workplace task analysis. This means that the same methodology can be used to seamlessly assess an individual’s entire day i.e. morning preparation for the day, transportation to work, the work day itself and finally evening and nighttime routines.

The last mind map illustrates the complexity and hence the options available to the “design team” when Digital Home or Smart Home technology is applied. I understand that for some this “complexity” can be an issue. Implementing a fixed ECU solution is pretty straight forward…the technology “is what it is.” The consumer will be forced to adapt to the technology. Sadly this is the norm!

Finally a video illustrates a unique solution available with Smart Home or Digital Home Technology. Specifically how does a consumer with limited hand/arm functionality access their collection of 200+ music CDs? How about a computer based voice recognition “juke box?” Such a product is available from www.homeautomatedliving.com and is called the Digital Music Center. Once the CDs have been ripped to the computer’s hard disk, every song is accessible via voice command. Additionally they are organized into by Song, Album, Artist, Year and Genre. For example “Play Beatles 1980” would be a valid command.

The following is a screen shot of the software which can be controlled via “point and click” or voice commands.

The following is a video demonstrating voice command of the software. Previous to this video being recorded, the CD RIP to hard disk operation was demonstrated. While necessary it is not particularly interesting or informative and hence is not shown.

HAL2000 Digital Music center -> http://www.youtube.com/watch?v=cTt3ZmDJ-M8

 NOTE:This technology, the Digital Music center, was developed without any consideration for the disability community. It was developed as an “add-on” to an existing Smart Home software product. 

This is the tip of the Iceberg…
Embrace Technology -> Expand your Independence !

Obviously the answer is…yes! The Digital Home or Smart Home technology market place is rife with the technology and know-how to provide the same and far greater functionality…at a greatly reduced cost. The terminology used varies depending on context i.e. Home Automation technology, Digital Home technology, Smart Home and outside the US, Ambient Assisted Living, Digital Domestic Environments and the ultimate solution an Attentive Home. The focus or epicenter of research into the application of this technology to support aging in place and those with disabilities is ICOST, International Conference on Smart Homes and Health Telematics, http://www.icost2011.org/

Following my internship, where I learned firsthand the cost and technology limitations of the ECUs being sold to the disability community I set out on a journey to discover alternative technological solutions. That journey started with the research paper (attached below) and continues today as the focus of my professional career. As you will see in subsequent posts, I have presented at both local and international conferences on this subject.

The attached paper was my initial investigation into alternative solutions and it lays the groundwork for subsequent posts. Along this journey I also discovered the need for an Assessment Tool that addresses the unique aspects of designing ADL (Activities for Daily Living) and EADL (Electronic Aids for Daily Living) supports. To that end I have created such a tool. It is called “the Bridge” and it is a process-oriented assessment tool for home and workplace accommodations. It will be presented in subsequent posts.

I should add that the attached paper contains some of my own political and social views. Whether or not you agree with my politics is irrelevant. What does matter is that we as a nation are far behind other industrialize nations in providing safe, comfortable and affordable living environments for those choosing to age in place or living with disabilities…and that is a function of national priorities which affects us all.

Research paper -> Beyond the Electronic Aids

In addition to the ECU demonstration a secondary goal was to demonstrate various “adaptive switches” that could be used by individuals with varying levels of functional limitations. I created the following multimedia PowerPoint presentation both as documentation for the technology installed and to serve as a training vehicle for new employees.

The two ECU’s installed were selected because they were already available and not because of any technological or performance advantage. Their use in this installation should not be interpreted as an endorsement of any form. They are simply representative of the ECU technology available at the time. Depending on the consumer’s individual needs these and other options should be explored.

Important: If the presentation does not open and “auto run” it is necessary to select “Slideshow” from the Menu bar and then click “From Beginning.” The embedded hyperlinks to the YouTube videos will not work correctly unless the presentation is running in Slideshow mode.

Multimedia PowerPoint presentation -> FSL_training-final blog post

My next alternative was to separate commands across several keys. That is one key would the generic phrase “Turn on” or “turn off.” A second key would be more specific “bedroom” or “living room” and the third key would identify the appliance “lamp” or “TV.” Unfortunately the home automation software has timeouts that could cause a problem for a consumer who worked slowly.

However what I did discover was that built into the Vanguard II were a number of “computer access overlays.” I have taken an AAC class as part of my graduate work in assistive technology at Northern Arizona University but I was totally unaware of these computer access overlays. Not too surprisingly after connecting the required USB cable I was able to control my VISTA -based laptop using the Vanguard II. This now gave me not only touch screen but additionally heading pointing, single and dual switch scanning computer access capability.

I don’t know what becomes of older AAC devices like the Vanguard II but it would appear they certainly could have a second life functioning as alternative computer access devices. I would certainly be interested in any feedback on the viability of this application and ultimately what does become of older AAC, augmentative and alternative communication, devices.