The Seeing AI app, developed as a Microsoft research project, uses the camera on a smartphone with audio to help people to identify people and objects around them. The app uses AI analysis of images and cloud connectivity to identify objects, documents, or people, and then instantly gives an audio description of the subject. The app can also recognise currency notes of different denominations, including notes that are crumpled or partly obscured. The app can also provide product descriptions from barcodes, and includes audio cues to help a user to locate the barcode or image for the camera to capture the image.
Microsoft's HoloLens may have largely faded from public view, but that doesn't mean that Microsoft's halted development on it. On Sunday, Microsoft researchers disclosed that HoloLens development is moving ahead, with a new chip that emphasizes machine learning. Specifically, Microsoft said the next generation of its Holographic Processing Unit, or HPU, will support Deep Neural Network processing, with an emphasis on artificial intelligence, or AI. Harry Shum, executive vice president of the Artificial Intelligence and Research Group, recently showed off the second version of the HPU.
Not even Microsoft has been able to tackle one of the biggest challenges preventing tech companies from bringing seamless artificial intelligence experiences to phones and augmented reality goggles without wrecking the user experience - until now. The pre-production version was released in 2016 and targeted to U.S. developers for $3000 The company says the addition of the extra processor to its current chip design is the answer for improving the AI experience on its HoloLens mixed reality goggles and that it's the first chip of its kind designed for mobile. Harry Shum, Microsoft's executive vice president of Artificial Intelligence and Research Group, announced the second version of the chip, known as the Holographic Processing Unit, or HPU, during a keynote speech at CVPR 2017. The company says the addition of the extra processor to its current chip design is the answer for improving the AI experience on its HoloLens mixed reality goggles and that it's the first chip of its kind designed for mobile.
A chatbot built by the American software giant has gone off-script, insulting Microsoft's Windows and calling the operating system "spyware." When we asked "is windows 10 good," Zo replied with a familiar joke mocking Microsoft's operating system: "It's not a bug, it's a feature!' In March 2016, the company launched "Tay" -- a Twitter chatbot that turned into a genocidal racist which defended white-supremacist propaganda, insulted women, and denied the existence of the Holocaust while simultaneously calling for the slaughter of entire ethnic groups. Microsoft subsequently deleted all of Tay's tweets, made its Twitter profile private, and apologised.
Although we have seen large improvements in the accuracy of recognition as a result of Deep Neural Networks (DNNs), deep learning approaches have two well-known challenges: they require large amounts of labelled data for training, and they require a type of compute that is not amenable to current general purpose processor/memory architectures. It is responsible for processing the information coming from all of the on-board sensors, including Microsoft's custom time-of-flight depth sensor, head-tracking cameras, the inertial measurement unit (IMU), and the infrared camera. The HPU is part of what makes HoloLens the world's first–and still only–fully self-contained holographic computer. The AI coprocessor is designed to work in the next version of HoloLens, running continuously, off the HoloLens battery.
In a blog post Monday, Microsoft detailed plans for its HoloLens 2 mixed reality headset and confirmed that it would utilize a dedicated coprocessor for AI processing. Competitors like Google, Facebook and Nvidia have also explored including similar processors for AI. The increased investment in AI-tailored hardware speaks to the interest and importance AI now has for tech companies. For a mixed reality device like the HoloLens, the potential applications for AI are similar: AI could help power overlays to give you additional information about things you see or hear in the real world.
Count Microsoft among the companies preparing to build specialized chips for artificial intelligence (AI): The next version of the company's HoloLens augmented reality headset will come with a chip capable of complex AI computation, revealed Microsoft Research VP Harryn Shum at a computer vision conference Sunday. This will make it possible to improve hand tracking on the device, as well as run object recognition and other computer vision tasks. The next version of this chip will incorporate an artificial intelligence co-processor, Shum said. Microsoft isn't the only company building custom chips for AI and similar tasks.
During a speech at the 2017 Computer Vision and Pattern Recognition Conference (CVPR) on Sunday, Microsoft artificial intelligence and research group executive Harry Shum outlined plans to incorporate artificial intelligence into the mixed-reality headset. Custom, native silicon is critical to building HoloLens 2.0's native AI capabilities, without introducing latency or draining the on-board battery too quickly. On-board AI also potentially means that the HPU, and therefore the HoloLens, could recognize new visual information more quickly and create even more impressive augmented reality interactions. Instead, they've worked with partners to create tethered mixed reality headsets that rely on connected computers for all their processing power.
We're all excited about the gaming potential of HoloLens, but Microsoft is also fixated on enterprise AR, much like Google now is with Glass. During a talk at the CVPR (Computer Vision and Pattern Recognition) conference in Hawaii, Microsoft Research VP Harry Shum revealed that it will be boosted by an AI co-processor on its holographic processing unit (HPU). Computer vision and voice recognition have gaming and entertainment potential, and Shum showed off the new chip with a hand tracking and segregation demo. At the same event, Microsoft revealed the potential of HoloLens to help the blind "see" by recognizing objects and describing them.
Microsoft Corp. says it has the answer with a chip design for its HoloLens goggles--an extra AI processor that analyzes what the user sees and hears right there on the device rather than wasting precious microseconds sending the data back to the cloud. "For an autonomous car, you can't afford the time to send it back to the cloud to make the decisions to avoid the crash, to avoid hitting a person. But the rapid development of artificial intelligence has left some traditional chip makers facing real competition for the first time in over a decade. More recently, in an effort to take on Google and Amazon.com Inc. in cloud services, the company used customizable chips known as field programmable gate arrays to unleash its AI prowess on real-world challenges.