For a little over a year, Facebook has been working on a tool that will describe pictures to people who are blind or visually impaired. It consists of artificial intelligence, and automatically generates captions for the photos we or our friends post. There is no need to install software or take extra steps – the tool is available to anyone using a smartphone, tablet or computer. To get a better sense of how it works, read this Sandy’s View post. I also demonstrate how the technology works in this story from CBS 2 Chicago.
According to this article from CNET, Facebook’s technology promises to get even better! For one thing, photo captions are becoming more enhanced. Now, when I am reading through my newsfeed, some of the picture descriptions also include what people are doing. When this technology was introduced over a year ago, I would only hear something like “image may contain: two people, outdoor, beach, sunglasses.” Now, I might hear something like “image may contain: two people, people smiling, people sitting, outdoor, beach, sunglasses.” In other words, there are more details in the descriptions, and this allows me to better visualize the image. Using the same example, I can picture two people having a good time at the beach!
All people – whether blind or sighted – will also be able to search for specific pictures using these descriptions. So, if I want to find the picture of my friends at the beach, I can type some of the words from the caption in Facebook’s search box. As of the writing of this post, I have not tried out this new feature, but will review it in the near future. I can see this added enhancement helping anyone. Instead of scrolling through our newsfeed or friend’s wall, we can simply search for a particular picture and save ourselves some time that way. This technology currently doesn’t include detailed descriptions, like the color of the clothes someone is wearing, but I am sure it won’t be long before we start seeing them. This would make the new picture search feature much more useful.
Social media has become an important part of everyone’s lives, and thanks to accessibility efforts like those implemented by Facebook, people with vision loss can also be included. For almost a year, I have been using Facebook’s photo description feature, and it has given me a better picture (no pun intended!) of what my friends and family are sharing. Although this technology is still in its early stages, it has certainly come a long way and made a difference for people with vision loss. Better yet, it also includes features, like the picture search, that will one day be useful even to those with sight. I sure am excited to see what it has in store for us in the future!