For some, Siri & Cortana seem like technological inventions. Well, they do have a point. You don’t have to use hands anymore to send a text, make a call, or even set a reminder! But what if we tell you, there’s a new voice assistant out there, that sounds like both Arnold Schwarzenegger AND Morgan Freeman, that can not only control your phone, but can also control every single device of your house.
Impressed? Read on-
Introducing Jarvis, Zuckerberg’s personal Iron Man styled assistant that uses several artificial intelligence techniques, including natural language processing, speech recognition, face recognition, and reinforcement learning, written in Python, PHP and Objective C.
Here’s what Mark had to say about it:
“Before I could build any AI, I first needed to write code to connect these systems, which all speak different languages and protocols,” the Facebook founder explained. “I had to reverse engineer APIs for some of these to even get to the point where I could issue a command from my computer to turn the lights on or get a song to play.”
Now that all the technical stuff is done, here’s a sneak peak into what Jarvis can do:
You thought the Internet Of Things was new? Jarvis is here to raise your eyebrows even further. Mark says he began teaching Jarvis to respond to text before enabling voice recognition. This began with simple keywords such as “bedroom”, “lights”, and “on” and evolved to be more specific to each room. He then moved onto vision and facial recognition and later, mobile.
He further goes on to add, “I programmed Jarvis on my computer, but in order to be useful I wanted to be able to communicate with it from anywhere I happened to be. That meant the communication had to happen through my phone, not a device placed in my home,” he said.
In the elementary stages, he then began by building a Messenger bot to communicate with Jarvis. We all know how Facebook is revolutionizing customer experience via these bots. The reason he began with this is because it was so much easier than building a separate app. He now texts the Jarvis bot and it can translate audio clips into commands. In the middle of the day, if someone arrives at his home, Jarvis also texts him an image to tell him who’s there, or it can text him when he needs to go do something!
To top it all off, he even built facial recognition in Jarvis! Zuckerberg said the most difficult part for him to work on was face recognition “because most people look relatively similar compared to telling apart two random objects.” He used Facebook’s research, and the work it has done on facial recognition from photos, to help improve Jarvis.
Now comes the best part. He paired this software with cameras which he installed on his front door showing multiple angles. What followed next was a simple server that he built that continuously watches the cameras and runs a two-step process: first, face detection is run to see if any person has come into view, and second, if it finds a face, then it runs face recognition to identify who the person is.
It may be a bold prediction, but we feel Jarvis has taken AI to a new level where it makes life much more easier than before. Imagine a voice assistant that helps you switch the power on before you get to work, gets your food ready, gets the bathtub ready for a bath, and even throws your night clothes for you to catch out of a uber cool cannon. All that, just using your voice! With this kind of progress by Mark in just a year, it won’t be very long until we see what Jarvis aspires to be (we sure hope so), that uber-cool, invention from the future that we saw in Iron Man.
You won’t have to wait for too long!
What are your thoughts on Jarvis? Comment down below and tell us why you feel this could change the future!