DV Hardware - bringing you the hottest news about processors, graphics cards, Intel, AMD, NVIDIA, hardware and technology!
   Home | News submit | News Archives | Reviews | Articles | Howto's | Advertise
DarkVision Hardware - Daily tech news
July 20, 2019 
Main Menu
News archives

Who's Online
There are currently 158 people online.


Latest Reviews
Ewin Racing Flash gaming chair
Arctic BioniX F120 and F140 fans
Jaybird Freedom 2 wireless sport headphones
Ewin Racing Champion gaming chair
Zowie P-TF Rough mousepad
Zowie FK mouse
BitFenix Ronin case
Ozone Rage ST headset

Follow us

Google using special AI processor to improve its services

Posted on Thursday, May 19 2016 @ 14:36:42 CEST by

Over at its I/O 2016 conference, Google revealed the Tensor Processing Unit (TPU), a custom-design chip made specifically for machine learning. The special thing about these AI chips is that they were designed for raw operations per second rather than anything else, Google CEO Sundar Pichai claims they offer a performance per Watt that's an order of magnitude higher than commercially available FPGAs and GPUs.

In a blog, a Google engineer elaborates that TPU is roughly equivalent to fast-forwarding technology about seven years into the future:
The result is called a Tensor Processing Unit (TPU), a custom ASIC we built specifically for machine learning — and tailored for TensorFlow. We’ve been running TPUs inside our data centers for more than a year, and have found them to deliver an order of magnitude better-optimized performance per watt for machine learning. This is roughly equivalent to fast-forwarding technology about seven years into the future (three generations of Moore’s Law).

TPU is tailored to machine learning applications, allowing the chip to be more tolerant of reduced computational precision, which means it requires fewer transistors per operation. Because of this, we can squeeze more operations per second into the silicon, use more sophisticated and powerful machine learning models and apply these models more quickly, so users get more intelligent results more rapidly.
Not a lot of information is available, but analysts speculate the TPU is focused on inference and may not do well in terms of training:
Google claimed the TPUs are three process generations ahead of the competition, said Kevin Krewell, senior analyst with Tirias Research. “The TPUs are “likely optimized for a specific math precision possibly 16-bit floating point or even lower precision integer math,” Krewell said.

“It seems the TPU is focused on the inference part of CNN and not the training side,” Krewell said. “Inference only requires less complex math and it appears Google has optimized that part of the equation.

“On the training side, the requirements include very larger data sets which the TPU may not be optimized for. In this regard, Nvidia's Pascal/P100 may still be an appealing product for Google,” he added.
Work on the project started years ago and the interesting part is that Google has already been using it, this chip was part of the secret sauce that helped Google's AI to beat a human in Go. Besides AI competitions, the chip also has real-world applications, Google claims it's using its TPU to improve its search result relevancy and to enhance the accuracy and quality of its mapping and navigation tools.
The fun part? You've already seen what TPUs can do. Google has been quietly using them for over a year, and they've handled everything from improving map quality to securing AlphaGo's victory over the human Go champion. The AI could both move faster and predict further ahead thanks to the chip, Google says. You won't get to buy the chip yourself, alas, but you might just notice its impact as AI becomes an ever more important part of Google's services.
An example of a TPU card can be viewed below, it fits into the HDD bay of data center racks.

Google AI chip



DV Hardware - Privacy statement
All logos and trademarks are property of their respective owner.
The comments are property of their posters, all the rest © 2002-2019 DM Media Group bvba