Feb 13, 2015 - Using the MATLAB Image Acquisition Toolbox from The Mathworks (Natick, MA, ... objects, currency, and traffic signs, the average recognition.
2/13/2015
BIOMEDICAL RESEARCH: Image processing and neural networks assist the blind Vision Systems Design
SUBSCRIBE | ADVERTISE
HOME
FACTORY AUTOMATION
NONINDUSTRIAL VISION
CAMERAS
BOARDS & SOFTWARE
PRODUCTS
Home
NonIndustrial Vision
BIOMEDICAL RESEARCH: Image processing and neural networks assist the blind
BIOMEDICAL RESEARCH: Image processing and neural networks assist the blind Agerelated macular degeneration and retinitis pigmentosa are two of the major causes of loss of eyesight, leaving patients with difficulty reading, sewing, or discerning faces. In severe cases, these patients may lose their vision entirely. To aid those suffering from such conditions, Eng. Enas Elbarbary of VACSERA (Cairo, Egypt; www.vacsera.com), Ass. Prof. Hussam Elbehiery of the Air Defense Forces (Cairo, Egypt), and Prof. Abdelhalim Zekry and Prof. Adel Elhennawy of Ain shams University (Cairo, Egypt; www.shams.edu.eg) have developed a portable system, known as the Blind Assistant, to help the visually impaired recognize their surrounding objects and avoid dangerous situations. This automated system consists of a portable camera interfaced to a mobile computer that uses imageprocessing techniques and neural networks to detect objects and their colors and provide pathplanning aids. Using the MATLAB Image Acquisition Toolbox from The Mathworks (Natick, MA, USA; www.mathworks.com), images from the camera are first captured as objects where their settings can be edited and stored. To allow surrounding objects, characters, traffic signs, and currency to be interpreted, the system uses The Mathworks’ Neural Network Toolbox for pattern recognition, a separate algorithm to determine the color of an object, and template matching for path planning. By employing a sound card in the portable computer, specific http://www.visionsystems.com/articles/2009/12/biomedicalresearchimageprocessingandneuralnetworksassisttheblind.html
1/8
2/13/2015
BIOMEDICAL RESEARCH: Image processing and neural networks assist the blind Vision Systems Design
instructions about an object, its color, and its distance are then relayed to the user.
To locate objects and determine the distance between them, the Blind Assistant system uses template matching to predict distances between objects and the number of steps required to reach them. Click here to enlarge image To locate objects, the Blind Assistant system uses template matching and predicts the approximate number of steps required to reach them. “For object recognition, neural networks must be adjusted or trained based on a comparison of the output image and the target image so that a particular input leads to a specific target output. Because of this, developers deploying neural networks need not develop algorithms to perform specific tasks,” Elbarbary says. http://www.visionsystems.com/articles/2009/12/biomedicalresearchimageprocessingandneuralnetworksassisttheblind.html
2/8
2/13/2015
BIOMEDICAL RESEARCH: Image processing and neural networks assist the blind Vision Systems Design
Using a number of previously acquired images, Elbarbary trained the system’s neural network with objects consisting of characters, objects, currency, and traffic signs. To determine the color of an object, the average RGB values in the image are computed and compared with previously stored colors in a color library. While object recognition was achieved using a predictive feedforward neural network, template matching is used for objects location determination. The approximate distance between the blind and the objects as well as the number of steps required to reach them are predicted (see figure). “By using neural networks for object recognition, features within specific images can be automatically trained and used to match future images as they are captured. Since training time is not dependent on processing time, comparing a newly captured image to the trained model, character recognition, and object recognition are relatively fast,” Elbarbary says. By increasing the number of these trained models, the likelihood of finding the captured object using the neural network is increased. To determine the number of steps needed to reach an object, an approximate method is used to predict them from captures. This is more computeintensive than using a neural network and increasing the number of templates needed to determine different object orientations, scale, and accommodate changes in illumination or increases in the processing time required. The researchers have tested the Blind Assistant system in both an office and exterior street settings using both neural networks and template matching for object recognition and for path planning. To image characters, objects, currency, and traffic signs, the average recognition time (per character) was approximately 0.5 s. Using the artificial neural network for object recognition took approximately 0.9 s. However, when template matching was used for path planning, the average processing time increased to approximately 1.7 s for long distances and 7 s for short distances. More Vision Systems Issue Articles Vision Systems Articles Archives
http://www.visionsystems.com/articles/2009/12/biomedicalresearchimageprocessingandneuralnetworksassisttheblind.html
3/8
2/13/2015
BIOMEDICAL RESEARCH: Image processing and neural networks assist the blind Vision Systems Design
RELATED ARTICLES Follow us for live updates from VISION 2014
Imaging system evaluates root systems of plants to improve crops Active Silicon to showcase frame grabbers and other machine vision solutions at VISION Euresys to showcase PCIe 3.0 CoaXPress frame grabber at VISION 2014
WHITE PAPERS A First Blueprint for Machine Vision: Look, Record, then Perfect Sponsored by: Teledyne DALSA Coding and Marking Challenges Sponsored by: Microscan Camera Selection How can I find the right camera for my image processing system? Sponsored by: Basler AG MORE
EDITORIAL DIGESTS Using 3D imaging in machine vision Wavelength choices put images into focus Sponsored by: Edmund Optics Deploying OCR systems in industrial manufacturing MORE
EDITORS' PICKS VISION 2014 official report released SPIE Photonics West 2015: The latest technologies and products in photonics and optics Are you a machine vision expert? (Slideshow) The 12 months of vision: Annual holiday review of the year in machine vision (Slideshow) Vision Systems Design hottest topics of 2014
http://www.visionsystems.com/articles/2009/12/biomedicalresearchimageprocessingandneuralnetworksassisttheblind.html
4/8
2/13/2015
BIOMEDICAL RESEARCH: Image processing and neural networks assist the blind Vision Systems Design
RECENT ARTICLES Machine vision camera and DVR unit from IO Industries to be showcased at Vision China Smaller, more nimble quadruped robot unveiled by Boston Dynamics Mini spectrometers from Ocean Optics enable plugandplay color measurements Sony appoints FRAMOS as North American distributor for image sensors Matrox Imaging once again offering MIL classroom training in April
RELATED COMPANIES IO Industries Inc Resonon Inc Microscope Vision and Image Analysis
FACTORY AUTOMATION ARTICLES Sony appoints FRAMOS as North American distributor for image sensors February 12, 2015
Matrox Imaging once again offering MIL classroom training in April February 11, 2015
Automated inspection system sorts shrimp on the sea February 11, 2015
Pleora introduces professional services program for custom vision system needs February 10, 2015
Edmund Optics announces partnership with FISBA February 9, 2015 MORE
RELATED PRODUCTS VCSBC Quadro VC7215 2megapixel CMOS Smart Camera VC nano cube Dual
NONINDUSTRIAL VISION ARTICLES Smaller, more nimble quadruped robot unveiled by Boston Dynamics February 12, 2015
Sony appoints FRAMOS as North American distributor for image sensors February 12, 2015
http://www.visionsystems.com/articles/2009/12/biomedicalresearchimageprocessingandneuralnetworksassisttheblind.html
5/8
2/13/2015
BIOMEDICAL RESEARCH: Image processing and neural networks assist the blind Vision Systems Design
Matrox Imaging once again offering MIL classroom training in April February 11, 2015
Automated inspection system sorts shrimp on the sea February 11, 2015
Uber working with Carnegie Mellon on selfdriving cars February 10, 2015 MORE
CAMERA ARTICLES Smaller, more nimble quadruped robot unveiled by Boston Dynamics February 12, 2015
Sony appoints FRAMOS as North American distributor for image sensors February 12, 2015
Matrox Imaging once again offering MIL classroom training in April February 11, 2015
Automated inspection system sorts shrimp on the sea February 11, 2015
Uber working with Carnegie Mellon on selfdriving cars February 10, 2015 MORE
BOARDS & SOFTWARE ARTICLES Matrox Imaging once again offering MIL classroom training in April February 11, 2015
Automated inspection system sorts shrimp on the sea February 11, 2015
Uber working with Carnegie Mellon on selfdriving cars February 10, 2015
Pleora introduces professional services program for custom vision system needs February 10, 2015
Infrared imaging helps assess burn wounds for treatment evaluation February 10, 2015 MORE
WEBCASTS How to apply infrared imaging in vision systems This updated webcast begins with a review of the benefits and operational specifics of infrared imaging for machine vision applications. Systems integration and engineering specialist Dr. Jonathan ... http://www.visionsystems.com/articles/2009/12/biomedicalresearchimageprocessingandneuralnetworksassisttheblind.html
6/8
2/13/2015
BIOMEDICAL RESEARCH: Image processing and neural networks assist the blind Vision Systems Design
10 important considerations for designing a machine vision system Developing a machine vision system is a complex activity involving optical engineering, electrical engineering, programming, and mechanical engineering. Moving from inception through installa... Vision technologies for robotics: Application do’s and don’ts This webcast will offer tips and examples for integration of machine vision systems in robotics applications. Expert Jeff Boeve of JR Automation will explain how to clearly define your pass/fa... December 9, 2014
Solving factory automation challenges with machine vision What do you need to know to implement your machine vision setup for industrial automation? This webcast will answer that question using realworld application examples—such as inspection, assembly,... November 18, 2014
BLOG UAV roundup 2/9: The latest in unmanned aerial vehicle news UAV roundup 1/30: The latest in unmanned aerial vehicle news Seeing through the Blizzard of 2015 Live updates from the 2015 A3 Business Forum FAA grants additional exemptions for commercial UAVs UAV lands on water, captures underwater footage Student builds a camera inside a Lego MORE
TOPIC INDEX View Vision Systems Design articles by topic, AZ
ARCHIVES Click here to view archived Vision Systems Design articles
http://www.visionsystems.com/articles/2009/12/biomedicalresearchimageprocessingandneuralnetworksassisttheblind.html
7/8
2/13/2015
BIOMEDICAL RESEARCH: Image processing and neural networks assist the blind Vision Systems Design
TOPICS
ABOUT US
RESOURCES
SUPPORT
Factory Automation
Free Subscriptions
Buyers' Guide
Subscriptions Site Map
NonIndustrial Vision
Advertising Information
Editorial Digests Event Listings
Twitter
Cameras
Editorial Information
Webcasts
RSS Feeds
Privacy Policy
Video
Boards & Software
STAY CONNECTED LinkedIn Facebook
Magazine Issue Past Issues
http://www.visionsystems.com/articles/2009/12/biomedicalresearchimageprocessingandneuralnetworksassisttheblind.html
8/8
