The application is basically a functional Google Chrome Extension that generates a caption for an image which describes what is contained in the image. The image captioning is done by a deep learning network which runs on a cloud server(Heroku). The caption generated is converted into speech by JavaScript’s Web Speech AP (SpeechSynthesisUtterance API).
- Open Google Chrome and go to Extensions (under More Tools)
- Select Load unpacked extension.
- Select the folder image-caption Extension.
The extension is now installed.
- Right-click on an image for which you want to view the description.
- Select Get Image Description from the menu.
- The description will be displayed on an overlay. The text is also converted to audio.
- Press escape to exit the overlay.
It can't be used for protected images. Example- It can’t be used on the images in facebook as they are protected ones.
Description for some pictures may not be accurate.