Showing posts with label Assistive Technology. Show all posts
Showing posts with label Assistive Technology. Show all posts

Saturday, October 03, 2020

Blind Navigation System using QR Code

 My previous blog talks about using RFID for navigation. The only problem is that the reader is not cheap and is hard to come by. This blog talks about an alternative for the RFID.

QR code is good because it can tolerate high margin of errors.  QR code can be scanned using a hand phone. Thus the data and the reader is available cheaply. QR Code need not be read from a close proximity. Just enlarge it and it can be read from a distance. 

I tried a two inch square QR code (1234-56) and it can be read from a meter away. Proportionally, a 5 inch (12.7 CM) should ideally be read from 5 meters away. In actual fact, it can be read at 3 meters distance only . However, that will be good enough otherwise it cannot fit the camera view at close distance.

The use of it is similar to RFID. There is a mapping of all the QR code within the area. They are placed 3 meters apart. 3 meter is used to ensure that the next QR code is within scanning distance. Using the same triangulation method of the RFID, the same navigation method can be done.

Obviously, the QR code should be hanging high enough so that human traffic will not obscure it. Since it is passive, Visual Handicapped may totally lost trace of it and wonders off course. Illumination is also a issue unless the place is perpetually lit.

See my post on RFID here.




Sunday, June 23, 2019

Navigation system for Blind using Passive RFID

It is always troublesome to find our way in a big shopping center. This applies to Visual Handicapped as well as sighted. Currently, the best way is to use beacons system to provide navigation and information around the beacon.

To maintain the beacon system is not that cheap. Beacons are life beacons that needs power source. In a big building, the number of beacons used is staggering. There are ways and means of using other technologies to provide navigational needs for the Visual Handicapped. Below is one which I think is viable.

RFID has been in the market for decades already. Passive RFID is just a piece of paper attached with a tiny chip and an antenna. It is very cheap and can be bough in bulk. Each RFID is unique. Therefore, if you are near enough with a reader, you could know which RFID is near you.

Firstly, you need to lay breadcrumb (RFID) trails on every path in the building. A mapping of each RFID and nearby POI (point of interest) is necessary for navigation. The breadcrumbs should be spaced at a fixed distance apart. Ideally, at every junction, a breadcrumb should be right in the center of it.

User using RFID reader could then able to read the breadcrumbs as he/she walks along the path. By limiting the range to just able to read at least 2 breadcrumbs, The system will be able to know which direction the user is moving since the last one will drop off and new ones will appear. With the mapping, you can then tell the direction of movement.

At junctions, user should be informed that there are branches and alert user on the possible direction and POI. User can then make a decision to move to the specific direction.

The app can be in a form of a map of the building with blinking dots to show current user position and with voice assistance for Visual Handicapped to use. It will have a list of POI to assist users. It will be good to have a search function that finds the nearest point matching the search string like "exit". A highlighted path to the search string, like map navigation, will be helpful.

Since passive RFID is cheap and need no power, it is just a install and forget type. Any missing RFID can be replaced with the same ID. It is, therefore, simple and cheap to maintain such a system.

Now the expensive part is the RFID reader. It needs to be Wi-Fi enabled so that it can be integrated with hand phone app. The app has to be custom designed to use it as navigation system. All these costs eats into user's budget. However, it reduces the cost of building owners so that they will be more willing to invest in the infrastructure. With many building owners willing to install the system, the cost of the application can then be reduced thus lessens the financial burden of users.

Since this navigation can be used for sighted, it becomes universal navigational system thus further reduces the costs. It is a win-win situation.

This system need not to be indoors only. Outdoor place like parks can install such system using weather proof containers for the RFID. It can even be used for temporary venues like a carnival. The uses are multiple.





Saturday, September 15, 2018

Raspberry Pi for Visual Impaired

Had a chat with a visual Impaired person during a flight. We talk about enterprises mass producing thus lowering the cost of products for VI (visual Impaired). I had mentioned that the pricing will probably be lower if the product is usable to both general public and VI than just for VI alone.

On passing, I mention that Raspberry PI is a compact and cheap computer with many sensors available and there is a screen reader that allow VI to be able to use it.

Can Raspberry PI be used by VI? The answer is positive. There are already VI using Raspberry PI with Raspbian and Orca. The latter is a screen reader. Unlike Apple, Raspbian (the most popular Linux distro) does not require application to comply to AT-SPI specification. Orca only works with apps that implements the specification. Just a few apps like Firefox, Mozilla, OpenOffice (those apps that probably most ordinary users will use) is able to work with Orca. Some programming tools like eclipse and Java can work with Orca too.

What apps ordinary VI will use? They most probably use browser to access Internet. It is a good source for learning.

They will probably also use LibreOffice Writer to do text proccessing. Some may use Calc to do spreadsheets. Experts may even use Base for database.

Email is quite common communication feature. Thunderbird, a Mozilla produce can be used as mail client. Major mail client can be web based.

With just the above few apps, it will cover most user's daily usage. More sophiscated users will probably use hand phones or laptop PC to suit their needs.

I propose to use Raspberry PI due to cost considerations. It costs about $50 to get a basic board. Just provide a few accessories like casing, power supply, and keyboard, you will get a complete system. With organisations providing free WiFi access, it will allow many who cannot afford to access this technology and be able to tap the vast range of data to upgrade themselves.

If you think that it is all that Raspberry PI can do, you should see what others use it to provide facilities for VI.

Raspberry PI have facility to plug in a large range of sensors and actuators. For example, user can use the camera module to take a picture of a book and use a OCR app to convert it to text thus allow user to read books.

Another use is to use the $3 Raspberry PI Zero, plug in a Bluetooth LE dongle and install a GitHub app to simulate an iBeacon. It is much cheaper than a hardware iBeacon. This simulated iBeacon can be used to make an indoor navigation system for VI.

Using a ultrasonic range sensor module, Raspberry PI can be turned into a navigation system by measuring the distance from an object.

The infrared transciever module can also be used to detect large objects for navigation use.

What about using the camera module to do object recognition? Branko Blagojevic had an offline object detection and tracking app on Raspberry PI using Yolo algorithm.

Raspberry PI is small but it is still a full Linux OS. It's processing power may be lower, but many things can be done with it.

AI is the trend. Raspberry can install Google TensorFlow to do deep learning. Microsoft is also providing AI for Raspberry PI.

With AI, robotics is next natural thing to do.

Are those technologies just empty talk? They are actually information taken from individual blogs and sites. Those people already done it.

To be neautral, the following are some issues that forms a hindrance to VI.

Raspberry PI does not come preinstalled with an OS. VI will not be able to install the OS without assistance.

Configuring the system to enable Orca is also not easy without voice.

Blind associations or companies may have to provide the device with OS and screen reader preinstalled.

There is a group that tried to assist VI in the use of Raspberry PI. The web address is https://www.raspberryvi.org. Download is disabled since 2016.

In conclusion, Raspberry PI can and be used by VI for various accessibility functionalities to improve the lives of VI.

The link to Raspberry PI is https://www.raspberrypi.org.


Wednesday, September 12, 2018

Indoor Navigation System

While in the World Blind Union regional accembly Mongolia, a delegate from Malaysia shared on the use of beacons for navigation during a small talk.

In 2015 October, I attended 中国第十一届信息无障碍论坛. There was a talk about Guangzhou public bus using BLE beacon technology to help user identify the bus.

This BLE beacon technology is quite new. Apple introduced iBeacon in 2013. One of the use is for Indoor Navigation. It's distinguished feature is it's ability to measure the precise distance between the beacon and it's receiver, notably user's iPhone.

What are the pros and cons of using it as an indoor Navigation system?

PROS

1. The system was specifically designed for this purpose.

2. It does not require complex system to set up although it does require a database system to provide a navigation map.

3. Scalability is flexible.

4. It can tell precisely the distance and the approximate direction by moving the reader around.

5. Both iPhone and Android are now capable of accessing BLE beacons.

CONS

1. The beacon is an active device that requires power supply in the form of battery or wired power line. Constant maintenance is required if battery is used.

2. Each device have a specific ID. In times of breakdown, maintenance will have a hard time detecting it unless the specific location is reported.

3. Cost is a great concern. In a typical building, a complete navigation system will require high numbers of beacons.

4. Proximity of beacon. The beacons cannot be placed too closely together. At any time only one can be accessed as it only tells the distance not direction. This could be overcomed by multiple scanning but it will slow down the speed of reading.

5. Implementation is also an issue. Unless the public is willing to invest in the beacon infrastructure, it will be limited. It will not be cost effective to provide for a small groups of clients. Small Enterprise will find it more costly to implement by themselves.

6. Unless hand phones can be cheap enough, user may not even have access to the technology.

Other devices like wifi/bluetooth hotspot or active RFID requires special reader devices that may have to integrate with hand phones. Proximity measurement virtually does not exist. Recently, I device a method of using RFID for navigation. If RFID is laid along a path with a known distance gap, A reader can read at least 2 or 3. While on the move, the reader can read more RFID and can tell which one is no longer in the list. By comparing with the last read RFID, You can actually tell which direction the reader is moving. This is provided a map of all the RFID are done. It like picking up sweets on the floor that is laid in a trail. This method does not require active RFID thus it is much cheaper to deploy and maintain.

Ultra sound emitters that sends out coded data requires higher power and may disturb guide dogs. I am not sure hand phones can receive ultra sound. Also in noisy environment. It will be difficult to implement.

Coded UV light communication will be directional but cannot determine proximity unless programmers can write codes to measure it. It also requires special hardware.

A new development is to use Augmented Reality. Apple have ARkit and Google have ARcore Unfortunately Google terminated the Tango project and replaced it with ARcore which does not do well detecting proximity unless OEM uses two camera technology and Google ARcore adds the "Measure" technology to make use of it. Other uses of this technology like heptic feedback is used to let VH "touch" objects but that is not the topic of discussion.

One of the main requirement of navigation is routing. It allows users to get to their destination from specific location. Routing requires waypoints. Thus it is important to get location info from waypoints. Besides beacons, there is actually a lack of such hardware. AR series uses camera to read the surrounding. If a known start point is determined, it does not require many waypoints. Unfortunately the technology is still new and lacks critical modules to determine precise proximity as currently it lack depth of field resolution capability.

Unless manufacturers and enterprises are willing to develope hardware that could determine direction and proximity and integrate with hand phone, it is still a long way for VH to fully navigate by themselves without assistance.

AR series technology is promising as it does not require hardware beacon devices to provide waypoints. If both Apple and Google are willing to use two camera devices to develop depth of field measurement, it will be good news to VH society. It is still feasible as we don't require precise measurement of objects. VH just need to use their cane to do more close proximity of distance.

One hardware I would like to introduce is the Raspberry PI computer. It is quite small (cigarette box size without battery and keyboard) with a complete Linux OS but it packs a punch. It has big range of sensors that can be used. Raspberry Pi Zero is a US$5 device that have USB Port. Just plug in a BLE USB dongle to provide bluetooth capability. All that is required is to make it a transmitter with unique ID. GitHub already have a Python script to simulate iBeacon funtionality. The standard Raspberry pi can be used as a navigation device. It costs just US$35. It does not have facility to compute proximity as provided by Apple or Google yet. The Zero series can be used with iPhone or Android already.





Tuesday, October 13, 2015

What technology that helps the blind

Ten years ago, I evaluated a number of technologies that is of use to visually handicapped (VH). It was quite a fruitless search. Ten years later I attended the China Information Accessibility Forum in Beijing and it showed quite a number of improvement. The following is a description of some of the technologies available as gathered from the forum.

I am not a fan of Apple iPhone but I do admire the free VoiceOver accessibility feature available. With it, VH can use the phone almost as easily as others.  There were apps written to help blinds. Ariande can help blind navigate places alone. LookTell Money reader can read money denominations (only US$). Color ID Free can read colors (can only read simple color). VizWiz provides human assistance to help VH. Android has assistive technology also but is a far fetch from VoiceOver.

Another technology by Apple is also of interest. It is the iBeacon technology. This technology allows a BT beacon to beam its proximity and some static information to the user. Obviously, user must use iPhone to do it. (Android have apps that can do it too.) It has a number of applications for VH. If every bus could be equipped with such beacon, it would help VH to detect which bus is the required one.

If the beacon can be fixed on every bus stop then VH will know which one to disembark on the last announced stop. If a building is equipped with Beacon, It will greatly help VH or sighted to know their exact location with a given virtual map of the building. Even those sighted can get lost in a very large shopping mall. Android has yet to catch up on this. Samsung is reportedly following suit but I am yet to see it.

Voice dictation system. Microsoft demonstrated its Cortana system that integrates voice recognition with linkage to app activation - a sort of personal assistance. Although it failed several times to perform during the presentation, it nevertheless a good technology to adapt for the blind. I have not seen Apple Siri at work but it is basically implemented much earlier than Microsoft. Android does not have one but there are quite a number of apps that does the same. How good is it is yet to be ascertained.

Obstacle Avoidance and Detection system. This technology was not that new but has not been very successful. Saw a video on this system. It could be helpful but as far as I know, detecting suspended small/pointed objects is still an issue.

Object location tag. Saw from booths in the forum that allows items to be tagged with a tag that has a buzzer built in. You could call up to 8 devices per calling device. It is nothing new just that the idea is rather interesting. If they could make it into adhesive tag then its use might be wider. I would like to see something like a RFID. It uses passive tags. The reader must be able to pinpoint the tag among other tags.

Face recognition and detection. According to the demonstrator, it helps the blind to be able to talk to others face-to-face by detecting where is the person. It allows pre-recorded face so that it can even announce the person's name. It did recognize me as a 50 plus old anonymous guy.

Small MP3 like equipment that can play music and read documents (without screen) is something of interest. A number of companies were making it. I would be more interested if it can automatically change language according to the mixed language document.

PC screen reader. It has been ages since this technology is available. Nothing much changed. Laptops and PC sales are going down due to increasing mobile handphone use. It is sunset technology.

Some researcher was trying to integrate all the technologies in one app. It might be useful but probably takes decades to do so.

One biggest challenge is to make the equipment affordable. Many of the VH have low or no income. Having such equipments are next to impossible. Don't forget many of the equipment requires internet access. There is a monthly bill to pay. Many equipments also require general public to take part like iBeacon for buildings/bus. The infrastructure cost is huge. Other VH are also illiterate. Coaxing, educating them enough to use such equipments is a long and tedious task.