‘Darwin NPU 2’ developed to process information faster | Zhejiang University
2019-09-02 Global Communications
The second generation of the Darwin Neural Processing Unit (Darwin NPU 2) as well as its corresponding toolchain and micro-operating system was released in Hangzhou recently. This research was led by Zhejiang University, with Hangzhou Dianzi University and Huawei Central Research Institute participating in the development and algorisms of the chip. The Darwin NPU 2 can be primarily applied to smart Internet of Things (IoT). It can support up to 150,000 neurons and has achieved the largest-scale neurons on a nationwide basis.
The Darwin NPU 2 is fabricated by standard 55nm CMOS technology. Every “neuromorphic” chip is made up of 576 kernels, each of which can support 256 neurons. It contains over 10 million synapses which can construct a powerful brain-inspired computing system.
“A brain-inspired chip can work like the neurons inside a human brain and it is remarkably unique in image recognition, visual and audio comprehension and naturalistic language processing,” said
MA De, an associate professor at the
College of Computer Science and Technology on the research team.
“In comparison with traditional chips, brain-inspired chips are more adept at processing ambiguous data, say, perception tasks. Another prominent advantage is their low energy consumption. In the process of information transmission, only those neurons that receive and process spikes will be activated while other neurons will stay dormant. In this case, energy consumption can be extremely low,” said Dr.
ZHU Xiaolei at the School of Microelectronics.
To cater to the demands for voice business, Huawei Central Research Institute designed an efficient spiking neural network algorithm in accordance with the defining feature of the Darwin NPU 2 architecture, thereby increasing computing speeds and improving recognition accuracy tremendously.
Scientists have developed a host of applications, including gesture recognition, image recognition, voice recognition and decoding of electroencephalogram (EEG) signals, on the Darwin NPU 2 and reduced energy consumption by at least two orders of magnitude.
In comparison with the first generation of the Darwin NPU which was developed in 2015, the Darwin NPU 2 has escalated the number of neurons by two orders of magnitude from 2048 neurons and augmented the flexibility and plasticity of the chip configuration, thus expanding the potential for applications appreciably. The improvement in the brain-inspired chip will bring in its wake the revolution of computer technology and artificial intelligence. At present, the brain-inspired chip adopts a relatively simplified neuron model, but neurons in a real brain are far more sophisticated and many biological mechanisms have yet to be explored by neuroscientists and biologists. It is expected that in the not-too-distant future, a fascinating improvement on the Darwin NPU 2 will come over the horizon.
Chinese scientists develop brain-like computer with world's largest neurons
2020-09-01 20:31:00 GMT+8 | cnTechPost
Zhejiang University and Zhijiang Lab recently developed China's first brain-like computer - the Darwin Mouse, which is also the world's largest brain-like computer in terms of neurons.
It contains 792 Darwin second-generation brain-like chips developed by Zhejiang University, supporting 120 million impulse neurons and nearly 100 billion synapses, which is the same size as the number of neurons in the mouse brain.
Its typical operating power consumption is only 350-500 watts.
The research team has also developed DarwinOS, an operating system for brain-like computers, which enables effective management and scheduling of brain-like computer hardware resources to support the operation and application of brain-like computers.
At today's press conference, Director of Zhijiang Lab and Deputy Secretary of the Party Committee of Zhejiang University said that the two research teams will develop a larger-scale neuronal brain-like computer based on China's proprietary brain-like chips.
The team will also research the basic brain-like software system to support its operation and development, and gradually realize open source and open source, to promote the development of new brain-like computing technology in China, he said.
Current computer development mostly chooses the John von Neumann architecture known for numerical computation, that is, the way to add, subtract, multiply, and divide numbers to carry out information architecture.
As Moore's theorem is gradually failing, the limitations of the von Neumann architecture are becoming more and more apparent, and problems such as storage walls, power walls, and intelligence enhancement are making current computer development face major challenges.
Scientists around the world have set their sights on mimicking the biological brain, the original dream, to develop new computing technologies that mimic the structure and computational mechanisms of the human brain in order to achieve high levels of computing efficiency and intelligence.
The biological brain is able to naturally produce different intelligent behaviors during interaction with the environment, including speech comprehension, visual recognition, decision-making tasks, and operational control, and consumes very little energy.
In nature, many insects with far fewer than a million neurons are able to do real-time target tracking, path planning, navigation, and obstacle avoidance.
Pan Gang, the leader of the research team and a professor at Zhejiang University's School of Computer Science and Technology, said that the hardware and software are used to simulate the structure and operation mechanism of the brain's neural network to construct a new artificial intelligence system, a new computing model that overturns the traditional computing architecture, namely brain-like computing. It is characterized by integrated storage and computing, event-driven, and highly parallel.
In 2015 and 2019, Zhejiang University developed Darwin 1 generation and Darwin 2 generation brain-like computing chips respectively, using the chip to simulate the structure and functional mechanism of the brain's neural network, which has advantages in the fuzzy processing of images, videos, and natural language.
The result is a powerful rack-mounted brain-like computer that integrates 792 of China's proprietary Darwin 2G computing chips into three 1.6-meter-tall standard server chassis.
The working mechanism of brain neurons is that the inflow and outflow of potassium and sodium ions lead to changes in the cell membrane voltage, thus transmitting information, "It can be simply understood that a neuron receives input pulses that lead to an increase in the membrane voltage of the cell body, and when the membrane voltage reaches a specific threshold, it sends an output pulse to the axon and passes through the synapse to the Subsequent neurons thus change their membrane voltages to enable the transfer of information."
The important point here is an asynchronous operation, which means that it starts when the signal comes and doesn't run without it. Brain-like chips work similarly to biological neuron behavior, transmitting signals through pulses, which allows for a high degree of parallelism and efficiency.
There are 150,000 neurons on each chip, and each of the four chips makes aboard, and several boards are then connected together to become a module. This is how the brain-like computer is built like a building block.
This DarwinOS is oriented towards a hybrid computing architecture of von Neumann architecture and neuromagnetic architecture, which enables unified scheduling and management of heterogeneous computing resources and provides an operation and service platform for large-scale pulsed neural network computing tasks.
At present, the Darwin brain-like operating system has a microsecond switching time for functional tasks and can support the management of billion-level brain-like hardware resources.
As a result, the value of brain-like computer research can really be realized - both in the life of intelligent task processing, but also can be applied to neuroscience research, providing neuroscientists with faster and larger-scale simulation tools, providing new experimental means to explore the workings of the brain.
Currently, researchers at Zhejiang University and Zhijiang Lab have implemented a variety of intelligent tasks based on the Darwin Mouse brain-like computer.
The researchers used the brain-like computer as an intelligent hub to realize the cooperative work of multiple robots in a flood rescue scenario, which involves the simultaneous processing of multiple intelligent tasks such as speech recognition, target detection, path planning, etc., as well as the collaboration among robots.
They also used a brain-like computer to simulate a number of different brain regions, built a neural network model of the lateral geniculate nucleus of the thalamus, and simulated the periodic responses of neurons in this brain region when visual stimuli were flashed at different frequencies.
They drew reference from the hippocampal neural loop structure and neural mechanisms to build a learning-memory fusion model, to achieve music, poetry, riddles, and other temporal memory functions; to achieve a steady-state visual evoked EEG signal real-time decoding, can "ideas" typing input.
At present, brain-like computing research is still in the early stages, Darwin Mouse brain-like computer, both in terms of scale or intelligence and the real human brain are still a big gap.
But its significance lies in being able to provide an important practical example of this technological pathway, providing researchers with a tool and platform to validate brain-like algorithms to solve real-world tasks with greater robustness, real-time, and intelligence.