With the help of this new feature, users can search for keywords in the Closed Captions that are available with videos. In essence, this means that Hulu viewers can now search for particular scenes in a movie or television show that comes with closed captions.

Captions Search results include a preview of the section of the video containing the keyword, which can be seen by hovering over the segment featuring the search term. One can also see that clip in full size by clicking on the search result’s text.

Hulu Captions Search is currently avalaible in Hulu Labs or through the “Captions” tab on any video that has been provided with closed captions.

Another interesting feature of Captions Search is the heat map. This feature provides a graphical representation of the viewer interest generated during various stages of the show. A large range of viewer behaviours have been assessed to generate this graph, and it appears at the top of the video. This heat map can also be used to navigate directly to a particular captioned section of the show.

The features are still in the beta phase, but are likely to go live pretty soon.

Preview of Captions Search on Hulu

Captions will be automatically generated through the voice recognition algorithm that is used on Google Voice. The technology is known as Automatic Speech Recognition (ASR) technology and can be pretty accurate for some cases.

In many cases, though, the automatic captions result in some rather funny output, even for videos by Google’s own employees. This could lead to some very confused users if they relied solely on automated captions!

Funny Automated Captions On YouTube

In order to use automated captions, a user has must click on the upward arrow button on the bottom-right corner of the video control bar and click on ‘Transcribe Audio’ from the captions (CC) menu.

It is also be possible to translate the captions into several languages.

While this will greatly improve YouTube’s accessibility and benefit people who have difficulties hearing, the translation facility will also help people who do not understand the original language used in the video.

Another feature that is being simultaneously introduced is auto-timing for subtitles. If all the words used in the video are provided in a text file, Google will automatically associate the timing of each caption alongside the video timeline.

In other words, the text of the video will be transcribed. This transcript can obviously be indexed and crawled, thus helping users with search engine optimisation of video content.

The new captioning features will therefore eventually allow users to search for a video based on keywords used in the video script.

The automatic caption feature is already available on most educational and Google-owned channels. Automatic timing is now available on all newly uploaded videos on YouTube.

Bing will now be used to power the new Quick Add feature on Hotmail. This essentially means that users can now search Bing from within Hotmail and add information from the search results directly into their email body.

Details about movie listings, images, videos, maps, restaurant reviews and many more info bytes can be searched and added directly into outgoing email messages, as can be seen in the example below:

The procedure to do this is actually quite simple.

The user first has to open up a new message page, by clicking on ‘New’. Then selects a category from the ‘Quick Add’ column, which can be found on the right hand side of the page. After that, users can select what sort of results they are looking for (image, video) and then search in the Bing search box. Bing returns the top 10 results within the same page. More results can be viewed in a new window. Lastly, clicking ‘Insert’ on the relevant result will add it in the message body where the cursor was placed.

One shortcoming of this facility is that it lists only a few search results. Those looking for more detailed search results, have to go over to Bing, and then it is not so easy to add the required result into the Hotmail message.

At present the Quick Add feature is available only in select locations like Australia, Canada, China, India and of course in the U.S. and U.K.

A similar tool was available earlier on iGoogle. The new service, called GAudi, is presently in beta and can be accessed within Google Labs.

http://labs.google.com/gaudi

Google Audio Indexing works in conjunction with YouTube. The tool will catalog all the words that are spoken in a particular audio or video clip. This data will then be entered into a database, which users can then search for the audio or video content they require, in much the same manner as they use search engines for text based material. GAudi will provide a whole list of results, based on the keyword entered.

To start with, GAudi will only index and catalogue politically-based audio and videos.
If a user is not interested in watching the whole video, after having located it through GAudi, it will be possible for to directly reach the particular portion that is of interest, by clicking on the play buttons alongside the particular search result that is of interest.

So far Google has not provided any information regarding their future plans for GAudi. That has not stopped some users from conjuring up innovative methods to use the tool,as can be seen below:

In the past, individual video results occupied the place of an antire search listing, and were  accompanied by a title, a short, one-line snippet pulled from the YouTube page for that video, the duration and average user ratings for the video, as can be seen alongside. This is still the predominant listing format for most universal search results.

However, some searches seem to now yield a single result with two videos placed side-by-side, as seen in the screenshot below. Both the videos are still pulled from YouTube, and both are accompanied by a short title, but are without any description snippet or ratings information and instead just contain information about the duration of the video.

While both videos in the screenshot above do seem equally relevant to the query, that does not seem to be the sole influencing factor for such a layout of the results, as the two videos in the first example shown above-right are also equally relevant in fact, but are still listed one below the other.

It is not clear at present how Google determines whether videos should be presented in this layout or another. It may be something to do with the currenct nature of the query or it may be that both videos score the exact same relevance points according to the Google algorithm and can therefore be clubbed together, even though they are varied in content and come from different useer accounts.