A password will be e-mailed to you.

10,000 times faster than a GPU- Cerebras’ wafer-size chip

The Cerebras Systems and the federal Department of Energy’s National Energy Technology Laboratory are out with a big announcement today. They claim that the company’s CS-1 system is more than 10,000 times faster than a graphics processing unit (GPU).


On a practical level, this means AI neural networks that previously took months to train can now train in minutes on the Cerebras system. Cerebras makes the world’s biggest microprocessor, the WSE. Chipmakers ordinarily cut a wafer from a 12-inch-width ingot of silicon to measure in a chip production line. When handled, the wafer is cut into many separate chips that can be utilized in electronic hardware.


Yet, Cerebras, which began via SeaMicro originator Andrew Feldman, takes that wafer and makes a solitary, huge chip out of it. Each bit of the chip, named a center, is interconnected in an advanced method to different centers. The interconnections are intended to keep all the centers working at high speeds so the semiconductors can cooperate as one.

Cerebras’ CS-1 framework utilizes the WSE wafer-size chip, which has 1.2 trillion semiconductors, the essential on-off electronic switches that are the structure squares of silicon chips. Intel’s initial 4004 processor in 1971 had 2,300 semiconductors, and the Nvidia A100 80GB chip, reported yesterday, has 54 billion semiconductors.



Feldman noted that the CS-1 can finish calculations faster than real time, meaning it can start the simulation of a power plant’s reaction core when the reaction starts and finish the simulation before the reaction ends.

“These dynamic modeling problems have an interesting characteristic,” Feldman said. “They scale poorly across CPU and GPU cores. In the language of the computational scientist, they do not exhibit ‘strong scaling.’ This means that beyond a certain point, adding more processors to a supercomputer does not yield additional performance gains.”




No more articles
Send this to a friend