Person of Interest - the workings of Video Analytics

Up to now, we have discussed quite a few interesting applications and points on visual analytics. But we have received some feedback asking to explain how it works. So here goes!

The basis of visual analytics, a practice of using computers to identify things or people of interest without an operator or a person having to view the video, are mathematical algorithms that monitor, analyze and manage big volumes of video. This means that video inputs are digitally analyzed and transformed into data that help people take decisions. It can be real time to help alert to specific incidents that could happen, such as an illegal suspect fleeing the country, and so on, or they can be post-event, looking incidents that have already occurred, for example a bombing or a fire in a store.

VA can happen in the centre, for example a central monitoring station, at the "edge", built into cameras which is ideal to locate live happenings, or as a combination of both. The optimal place to locate post-event analytics is on a central server as it is possible to search a large amount of recorded video for events, however this requires network capacity and processing power. But the main point on VA is that it works on motion detection and pattern recognition.

Motion Detection is basically examining each pixel in a given frame to detect the slightest movement. Pattern Recognition, on the other hand, recognizes specific patterns within a frame. These patterns or objects can be programmed and i.e, should a change happen or an object go missing the software immediately recognizes and sounds an alert.

The most common used types of video analytics used is violation of perimeters and recognition of license plates. Not only can this be used in surveillance, but in retail segment market analysis, to measure the number of people that pass in a given time (footfall), gender counting, shelf space effectiveness, and so on.

A fun and different way to see a little bit of VA in action, is watching a series called Person of Interest. It's just a TV show... but is it really?

Sources:
http://www.mistralsolutions.com/hs-downloads/tech-briefs/aug09-article-1.html
http://www.addic7ed.com/serie/Person_of_Interest/2/22/God_Mode
http://alexandra135.deviantart.com/art/Person-of-Interest-349555095

If you too forget people's names, there may be a light at the end of the tunnel...

As the battle between privacy protection and tech advancement continues, apparently Google has lost a battle. Intensified arguments and concerns towards access to personal information about people and other objects viewed by the Google Glass device forced the company to ban facial recognition and voice-print apps for the device. 

This means a halt on the stalkers and creeps, but also in the advancement of the ability to identify someone and bring up allergies, for example, in the case of a doctor, or prevention of people like me facing the embarrassment of not remembering a person's name. However, we all know that new things take time to sink in, so hopefully, our name-forgetting days are counted. And if this day should come sooner than later, and you still feel unsafe, rest assured that there will always be "rebel" technologies to protect you, such as the "Glasses to stop Google Glass from recognizing your face". Now isn't that something - Japan researchers already created the antimatter of the Google Glass even before it exists...

More info: 

http://bgr.com/2013/06/20/google-glass-facial-recognition-blocking/

http://www.entrepreneur.com/article/226906

Facebook Tag Suggestions: A Value-Add or a Tresspass??

The debate continues. When Facebook first came up with a facility to allow tagging friends, it was a labor-some task to click every photo, then click on the "Tag Friends" option and then click on every face you see [or you want to tag], to type the name of that person.

Well, it takes less than a minute for one tag, but if this is a group photo of an entire class, or a wedding photo with all cousins, boy !!
It would take hours just to tag people in all the photos.

And why do we want to do that in the first place? Because, we always want to announce to the world that we were not alone when we did something crazy or something stupid or something great. We were with "Someone".
Being a part of "the group" is one of the needs, which is high up in Maslow's pyramid of needs.

And if the social networking corporations of today, would not have tapped into this desire of people and turned into a business value-add, it would have been a big surprise for me.

Anyways, even while people were shying away from tagging friends for the amount of work it involved, Faccebook came up with a smart way to tag friends. An excellent use of Visual Analytics - where all new faces are compared with the previous tags you have added, or the previous tags your friends have added, and even before you publish the album or photo, you are given a ready platter with all those smiley faces and a tag "suggestion" for each of this face.

The facial recognition software which most of the social network sites use is not very complex algorithm using too many biometrics, as we saw in the previous post by Sophie. They work on simple Smile recognition, a feature which is commonly available in many handy-cams, digi-cams and photo-editing software. The Analytics part comes into picture when the available database of tagged photos is processed to map with the new image under consideration. Output of running this analytics is a name of person - either your own name or name of one of your friend - commonly termed as a "suggestion".

All of this process gets completed within a few seconds, irrespective of whether you are posting a single photo or hundreds of photos. This speed of video analytics that facebook offers, is the best feature of it, as per my opinion.

This suggestion may sometimes be erroneous though, specially in case of newly added friends without any history of photo tags, but that's a very low percentage. All-in-all, if you like tagging your friends, this is a great feature available at your disposal.

On the fall-side, Every new feature has its own ill-effects and the major ill-effect of facebook tag suggestions is the tress-passing it does in someone's private space. I mean if I don't like being tagged, why should my face appear in my friends album, with a suggestion of my name?

Thankfully, after a ruckus in US about this privacy encroachment, Facebook withdrew the feature in US, and introduced it back, only after adding options [for the entire world], where-in you can deny being tagged by others; or have an authority to review and choose whether your name tag appears on a photo; or whether your name should appear as a tag suggestion.

Well, that takes care of personal privacy-trespassing issues. All-in-all there is no denying that visual analytics is the way ahead - not only for handling the security issues, but also for effectively using the social networks, considering the fast-paced lifestyle that we have.

On a more personal note, when I have enough time, I still prefer choosing whom to tag on a per-photo basis, as when I am browsing through those photos one by one and tagging people one after other, I can relive the memories associated with each picture and each person in that picture. But hey, that's just me :-)

Will face recognition payment nip digital wallet in the bud ?

Believe or not, digital wallet might already be a has-been. A battle has already started between Mobile Wallet and FaceCash to become the standard for tomorrow's payment technology.

Indeed, a Finnish start-up Uniqul has launched what it calls the first ever payment platform based on face recognition.

The system allows you to pay by giving the camera a nod and pressing ‘OK’ on a point-of-sale tablet. Uniqul claims its technology is protected by “military grade algorithms”.

  “In the background our algorithms are processing your biometrical data to find your account in our database as you are approaching the cashier. The whole transaction will be done in less than 5 seconds – the time it usually takes you to pull out your wallet”, explains a press release from the company.

In order to use Uniqul unique payment system, the customer needs to register online before and have its picture taken by one of the company's Qpoint machine. Then, the customer can use all major credit cards or even a PayPal or Square account to charge its Uniqul account.

The real fun begins, lets witness the applications the world's finest software developers will create using this new technology.