• Follow us

Technology

Cerebras Debuts Big Chip to Speed Up AI Processes | Chips

By Jack M. Germain Aug 20, 2019 2:36 AM PT

Startup chip developer Cerebras on Monday announced a breakthrough in high-speed processor design that will hasten the development of artificial intelligence technologies.

Cerebras unveiled the largest computer processing chip ever built. The new chip, dubbed "Wafer-Scale Engine" (WSE) -- pronounced "wise" -- is the heartbeat of the company's deep learning machine built to power AI systems.

WSE reverses a chip industry trend of packing more computing power into smaller form-factor chips. Its massive size measures eight and a half inches on each side. By comparison, most chips fit on the tip of your finger and are no bigger than a centimeter per side.

The new chip's surface contains 400,000 little computers, known as "cores," with 1.2 trillion transistors. The largest graphics processing unit (GPU) is 815 mm2 and has 21.1 billion transistors.

Cerebras Wafer-Scale Engine

The Cerebras Wafer-Scale Engine, the largest chip ever built, is shown here alongside the largest graphics processing unit.

The chip already is in use by some customers, and the company is taking orders, a Cerebras spokesperson said in comments provided to TechNewsWorld by company rep Kim Ziesemer.

"Chip size is profoundly important in AI, as big chips process information more quickly, producing answers in less time," the spokesperson noted. The new chip technology took Cerebras three years to develop.

Bigger Is Better to Train AI

Reducing neural networks' time to insight, or training time, allows researchers to test more ideas, use more data and solve new problems. Google, Facebook, OpenAI, Tencent, Baidu and many others have argued that the fundamental limitation of today's AI is that it takes too long to train models, the Cerebras spokesperson explained, noting that "reducing training time thus removes a major bottleneck to industry-wide progress."

Accelerating training using WSE technology enables researchers to train thousands of models in the time it previously took to train a single model. Moreover, WSE enables new and different models.

Those benefits result from the very large universe of trainable algorithms. The subset that works on GPUs is very small. WSE enables the exploration of new and different algorithms.

Training existing models at a fraction of the time and training new models to do previously impossible tasks will change the inference stage of artificial intelligence profoundly, the Cerebras spokesperson said.

Understanding Terminology

To put the anticipated advanced outcomes into perspective, it is essential to understand three concepts about neural networks:

Training is learning; Inference is applying learning to tasks; and Inference is using learning to classify.

For example, you first must teach an algorithm what animals look like. This is training. Then you can show it a picture, and it can recognize a hyena. That is inference.

Enabling vastly faster training and new and improved models forever changes inference. Researchers will be able to pack more inference into smaller compute and enable more power-efficient compute to do exceptional inference.

This process is particularly important since most inference is done on machines that use batteries or that are in some other way power-constrained. So better training and new models enable more effective inference to be delivered from phones, GoPros, watches, cameras, cars, security cameras/CCTV, farm equipment, manufacturing equipment, personal digital assistants, hearing aids, water purifiers, and thousands of other devices, according to Cerebras.

The Cerebras Wafer Scale Engine is no doubt a huge feat for the advancement of artificial intelligence technology, noted Chris Jann, CEO of Medicus IT].

"This is a strong indicator that we are committed to the advancement of artificial intelligence -- and, as such, AI's presence will continue to increase in our lives," he told TechNewsWorld. "I would expect this industry to continue to grow at an exponential rate as every new AI development continues to increase its demand."

WSE Size Matters

Cerebras' chip is 57 times the size of the leading chip from Nvidia, the "V100," which dominates today's AI. The new chip has more memory circuits than any other chip: 18 gigabytes, which is 3,000 times as much as the Nvidia part, according to Cerebras.

Chip companies long have sought a breakthrough in building a single chip the size of a silicon wafer. Cerebras appears to be the first to succeed with a commercially viable product.

Cerebras received about US$200 million from prominent venture capitalists to seed that accomplishment.

The new chip will spur the reinvention of artificial intelligence, suggested Cerebras CEO Andrew Feldman. It provides the parallel-processing speed that Google and others will need to build neural networks of unprecedented size.

It is hard to say just what kind of impact a company like Cerebras or its chips will have over the long term, said Charles King, principal analyst at Pund-IT.

"That's partly because their technology is essentially new -- meaning that they have to find willing partners and developers, let alone customers to sign on for the ride," he told TechNewsWorld.

AI's Rapid Expansion

Still, the cloud AI chipset market has been expanding rapidly, and the industry is seeing the emergence of a wide range of use cases powered by various AI models, according to Lian Jye Su, principal analyst at ABI Research.

"To address the diversity in use cases, many developers and end-users need to identify their own balance of the cost of infrastructure, power budge, chipset flexibility and scalability, as well as developer ecosystem," he told TechNewsWorld.

In many cases, developers and end users adopt a hybrid approach in determining the right portfolio of cloud AI chipsets. Cerebras WSE is well-positioned to serve that segment, Su noted.

What WSE Offers

The new Cerebras technology addresses the two main challenges in deep learning workloads: computational power and data transmission. Its large silicon size provides more chip memory and processing cores, while its proprietary data communication fabric accelerates data transmission, explained Su.

With WSE, Cerebras Systems can focus on ecosystem building via its Cerebras Software Stack and be a key player in the cloud AI chipset industry, noted Su.

The AI process involves the following:

Cerebras-built software tools for design; and building in redundant circuits to route around defects in silicon manufacturing in order to still deliver 400,000 working optimized cores, like a miniature Internet that keeps going when individual server computers go down; moving data in new ways for better training of a neural network that requires thousands of operations to happen in parallel at each moment in time.

The problem the larger WSE chip solves is computers with multiple chips slowing down when sending data between the chips over the slower wires linking them on a circuit board.

The wafers were produced in partnership with Taiwan Semiconductor Manufacturing, the world's largest chip manufacturer, but Cerebras has exclusive rights to the intellectual property that makes the process possible.

Available Now But ...

Cerebras will not sell the chip on its own. Instead, the company will package it as part of a computer appliance Cerebras designed.

A complex system of water-cooling -- an irrigation network -- is necessary to counteract the extreme heat the new chip generates running at 15 kilowatts of power.

The Cerebras computer will be 150 times as powerful as a server with multiple Nvidia chips, at a fraction of the power consumption and a fraction of the physical space required in a server rack, Feldman said. That will make neural training tasks that cost tens of thousands of dollars to run in cloud computing facilities an order of magnitude less costly.

Jack M. Germain has been an ECT News Network reporter since 2003. His main areas of focus are enterprise IT, Linux and open source technologies. He has written numerous reviews of Linux distros and other open source software. Email Jack.

Read More



Leave A Comment

More News

PCWorld

Steam's wonderful Library Update beta is finally live: New! 2019-09-17 15:35:00As promised, Valve pushed the new Steam Library Update into open beta this morning. Quick access to your recently played games! More detailed “D

Nvidia bundles Call of Duty: Modern Warfare with New! 2019-09-17 12:05:00Nvidia wants to show off its cutting-edge real-time ray tracing technology with Modern Warfare. On Tuesday, the company announced that it will bundle

iPhone 11 and iPhone 11 Pro reviews call 2019-09-17 10:18:00The first crop of iPhone revivews are in and everyone loves them.

Ranking the Microsoft Surface launch rumors: What's probable, 2019-09-17 06:33:00Most of Microsoft’s Surface product lineup is scheduled for a potential refresh at Microsoft’s October 2 event in New York City, and educa

Polk Legend L100 review: Higher performance than you'd 2019-09-17 06:00:00Polk's Legend L100 speakers deliver well-rounded sound with generally precise renderings.

Best wireless keyboards: Hand-tested reviews of Bluetooth and 2019-09-16 20:09:00The best wireless keyboards do more than free you from a cable. They let you toss the crummy keyboard you got for free with your PC—does anyone

Logitech MX Master 3 review: A marvelous mouse 2019-09-16 19:54:00Keyboards and mice have a pretty buttoned-down reputation, but ironically some of their most demanding users are right-brain types. That’s whom

Logitech MX Keys review: A wireless keyboard that 2019-09-16 19:49:00Keyboards and mice have a pretty buttoned-down reputation, but ironically some of their most demanding users are right-brain types. That’s whom

Microsoft's patch to patch Windows Search now must 2019-09-16 13:39:00Microsoft’s patch to fix its Windows Search patch will have to be “patched” again, at least before it goes live. Microsoft said it&r

Sapphire Nitro+ Radeon RX 5700 XT review: Superfast 2019-09-16 09:00:00It’s been a long time coming, but the custom Radeon RX 5700 XT series graphics cards are finally starting to flow. Today we’re taking a lo

MSI's GE65 Raider Review: A little thick, but 2019-09-16 07:00:00MSI’s GE65 Raider is proof positive of how far gaming laptop performance has come. Just two years ago, a top-end gaming laptop would run on

Yamaha YAS-209 soundbar with Alexa review: DTS Virtual:X 2019-09-16 06:00:00While we like the standard surround-sound modes on this budget-priced soundbar, we aren’t fans of its harsh-sounding DTS Virtual:X implementatio

FOX News

Tiny ‘biohybrid’ robots directed by muscles and nerves New! 2019-09-17 16:18:13Researchers have developed soft robotic devices that are driven by neuromuscular tissue that gets triggered when stimulated by light.

Army details mission of AI task force New! 2019-09-17 14:54:30Warrior Maven Interview with Col. Douglas Matty, Army Artificial Intelligence Task Force Deputy Director.

UFO videos are footage of real 'unidentified' objects, New! 2019-09-17 13:08:09For the first time, the U.S. Navy has acknowledged the three UFO videos that were released by former Blink-182 singer Tom DeLonge and published by the

Army eyes pearls in innovative project to bolster 2019-09-17 10:56:19Could pearls help save a soldier’s life?

Apple iPhone 11 review roundup: Should you buy 2019-09-17 09:12:23Apple iPhone 11 reviews hit the web early Tuesday morning, with most of the reviews focused on the upgrades to the iPhone's internals, incl

Army AI Task Force builds new prototypes for 2019-09-16 12:35:43Streamlining multiple targeting sensors to destroy long-range targets, arming forward-positioned robots to penetrate enemy defenses and receiving orga

Virtual assistant spies, saving texts, burner phones, and 2019-09-15 07:00:32Virtual assistant woes, Facebook's facial recognition database, burner phones and much more.

Dozens of anti-ICE protesters arrested at NYC Microsoft 2019-09-14 20:22:30New York City police said Saturday that 76 immigration policy protesters had been arrested at a demonstration outside Microsoft's flagship store

7 smartphone maintenance tips to get the best 2019-09-14 07:00:57Newly unboxed, a smartphone runs like a dream. The device is fresh and spotless, and it has that “new phone” scent. But as time goes by, y

To fight opioid crisis, Kentucky middle schoolers build 2019-09-13 15:56:53A middle school in Kentucky has built an online database to compliment a needle-collecting device they developed.

California's facial recognition ban for police body cameras 2019-09-12 20:15:41California could soon become the largest state to ban the use of facial recognition technology in law enforcement body cameras, a significant mileston

‘Flying fish’ robot propels itself out of water 2019-09-12 19:56:24A bio-inspired robot can use water from the environment to launch itself into the air, researchers revealed.

TechCrunch

Biology as technology will reinvent trillion-dollar industries New! 2019-09-17 18:00:25We face two major threats today: one to the health of our planet and the other to our own. Fortunately, biology and technology are creating fixes for

Tutoring business-in-a-box service Clark has been acquired by New! 2019-09-17 17:22:29Clark, the tutor management business-in-a-box service, has been acquired by the New York-based education startup Noodle for an undisclosed amount, Tec

Lyft faces lawsuit that alleges kidnapping at gunpoint New! 2019-09-17 16:58:16Lyft is facing another lawsuit pertaining to its handling of alleged sexual assaults at the hands of drivers on its platform. In a suit filed today in

GoDaddy upgrades its website builder with customized marketing New! 2019-09-17 16:10:36GoDaddy’s website-building product GoCentral is getting an upgrade today — and along with new features, there’s a new name: Websites

Facebook’s new policy Supreme Court could override Zuckerberg New! 2019-09-17 16:00:09A real check to Facebook CEO Mark Zuckerberg’s control is finally coming in the form of an 11 to 40-member Oversight Board that will review appe

Twitch acquires gaming database site IGDB to improve New! 2019-09-17 15:10:32Amazon-owned Twitch has made a small but strategic acquisition designed to improve its search capabilities and better direct viewers to exactly the ri

Colorcon, which develops colorants, coatings, and films for New! 2019-09-17 14:54:42Colorcon, a 58-year-old company that develops, supplies, and supports specialty products for the pharmaceutical industry — think food colorants,

Macron announces €5 billion late-stage investment pledge New! 2019-09-17 14:52:24French president Emmanuel Macron announced in a speech ahead of France Digitale Day that the French government has convinced institutional investors t

Daily Crunch: The iPhone 11 goes to Disneyland New! 2019-09-17 14:12:40The Daily Crunch is TechCrunch’s roundup of our biggest and most important stories. If you’d like to get this delivered to your inbox ever

Clever hide-and-seek AIs learn to use tools and New! 2019-09-17 13:36:01The latest research from OpenAI put its machine learning agents in a simple game of hide-and-seek, where they pursued an arms race of ingenuity, using

Google starts highlighting key moments from videos in New! 2019-09-17 13:31:43Google today announced an update to how it handles videos in search results. Instead of just listing relevant videos on the search results page, Googl

Pax Labs’ Bharat Vasan is out as CEO New! 2019-09-17 13:30:18Bharat Vasan is no longer the Chief Executive Officer at Pax Labs, the consumer tech company that makes cannabis vaporizers. A source familiar with th

Electrek

The EPA will have a hard time ending New! 2019-09-17 17:31:02 In the latest step against the Environmental “Protection” Agency’s (EPA) losing battle against clean air and clean cars, the agency

Tesla’s New Roadster to come in 2021, Elon New! 2019-09-17 14:02:44 We’ve known for a while now that Tesla’s new Roadster is not a “priority,” but CEO Elon Musk has now made it clear that it wo

EGEB: US coal shipments at lowest level in New! 2019-09-17 14:00:40 In today’s Electrek Green Energy Brief (EGEB): US coal shipments reach the lowest level since 1983. #CoveringClimateNow — more than 250 m

Pick up 12 dimmable LED light bulbs for New! 2019-09-17 13:24:41 Home Depot offers a 12-pack of Lighting Science Dimmable 40W LED Light Bulbs for $11 shipped. Regularly over $16, today’s deal is the best

Elon Musk: Tesla Model S ‘Plaid’ with new New! 2019-09-17 13:05:15 Tesla CEO Elon Musk added some details about the upcoming Tesla Model S “Plaid” wth “7 seats” coming in October/November 2020

Porsche releases an ad for the Taycan: focuses New! 2019-09-17 11:52:38 The Porsche Taycan is out now, and the German automaker is serious about selling it. They released an ad for the electric car — focusing on &ld

Tesla Gigafactory 3 passes inspection needed before starting 2019-09-17 09:23:50 Tesla Gigafactory 3 has passed an important government inspection needed before it can start production, which is supposed to be imminent. more&helli

First Ride: Bianchi Aria E-Road – Believe it 2019-09-17 09:16:40 I recently got the chance to test out the Bianchi Aria E-Road at Eurobike 2019. This lightweight road bike has a hidden surprise – it’s a

Tesla ‘Plaid’ Model S crushes Porsche Taycan’s Nürburgring 2019-09-17 06:18:37 Tesla’s testing of new Model S vehicles, including a 3-motor ‘Plaid’ Model S, continues at the Nürburgring racetrack and now a

GM promises electric pickup truck production in union 2019-09-16 18:40:07 GM’s union employees are currently on strike over a labor negotiation dispute and the automaker is using the promise of electric pickup truck p

Tesla is expanding service at ‘max speed,’ says 2019-09-16 15:31:11 CEO Elon Musk says that Tesla is now expanding its service presence and capacity at “max speed” as the global fleet is rapidly growing. m

Mazda will unveil their ‘brand new’ EV model 2019-09-16 14:32:45 Today, Mazda confirmed that they’ll be unveiling a new EV at the Tokyo Motor Show next month, according to Automotive News. Mazda has been prep

Ars Technica UK

Trump to eliminate California’s car emission standards waiver New! 2019-09-17 17:26:44New standards aren't ready, so the target is the main barrier to their adoption.

Borderlands 3 is a lot more Borderlands, in New! 2019-09-17 16:56:31Impressions: Small interface improvements matched by sloppiness around the edges.

Fresh analysis of LIGO data supports “no hair” New! 2019-09-17 16:31:43Ringdown overtones yield accurate estimates of mass and spin of a new black hole.

Millions of Americans’ medical images and data are New! 2019-09-17 15:21:11Anyone can take a peek.

Feds seek to seize all profits from Snowden’s New! 2019-09-17 15:04:15Snowden didn't submit it to gov't for pre-approval; DOJ says he's in breach of contract.

Dealmaster: You can still convert 3 years of New! 2019-09-17 14:45:04Plus Prime-only deals on a bunch of Amazon devices, Xbox One gamepads, and more.

Rockstar Games Launcher: We install it on Windows New! 2019-09-17 14:32:26How badly do you want another PC games launcher?

Lawsuit: AT&T signed customers up for DirecTV Now New! 2019-09-17 14:20:30AT&T faces investor lawsuit as TV business continues freefall.

Google Fi gets a cheaper “unlimited” plan, bundled New! 2019-09-17 13:38:02With the cloud storage, you'll save about $12 over the old Fi unlimited plan.

Video: DOD pulls plug on Boeing/Raytheon missile interceptor New! 2019-09-17 13:28:24DOD takes its search for a multi-target interceptor into recompete.

This is what it’s like driving a Bugatti New! 2019-09-17 13:09:29We caught up with Bugatti's Le Mans-winning test driver at the Frankfurt auto show.

Richard Stallman leaves MIT after controversial remarks on New! 2019-09-17 12:57:28Free software pioneer has history of controversial comments about underage sex.


Disclaimer and Notice:WorldProNews.com is not responsible of these news or any information published on this website.