A Heterogeneously Integrated Spiking Neuron Array for Multimode-Fused Perception and Object Classification

Zhu Jiaxue; Zhang Xumeng; Wang RuiWang MingChen PeiCheng LingliWu ZuhengWang YongzhouLiu QiLiu Ming

首页> 外文期刊>Advanced Materials >A Heterogeneously Integrated Spiking Neuron Array for Multimode-Fused Perception and Object Classification

【24h】

A Heterogeneously Integrated Spiking Neuron Array for Multimode-Fused Perception and Object Classification

机译：A Heterogeneously Integrated Spiking Neuron Array for Multimode-Fused Perception and Object Classification

获取原文

获取原文并翻译 | 示例

掌桥外文数据库（机构版） >>

开具论文收录证明 >>

文献代查 >>

页面导航

摘要
著录项
相关主题

摘要

Multimode-fused sensing in the somatosensory system helps people obtain comprehensive object properties and make accurate judgments. However, building such multisensory systems with conventional metal-oxide-semiconductor technology presents serious device integration and circuit complexity challenges. Here, a multimode-fused spiking neuron (MFSN) with a compact structure to achieve human-like multisensory perception is reported. The MFSN heterogeneously integrates a pressure sensor to process pressure and a NbOx-based memristor to sense temperature. Using this MFSN, multisensory analog information can be fused into one spike train, showing excellent data compression and conversion capabilities. Moreover, both pressure and temperature information are distinguished from fused spikes by decoupling the output frequencies and amplitudes, supporting multimodal tactile perception. Then, a 3 x 3 MFSN array is fabricated, and the fused frequency patterns are fed into a spiking neural network for enhanced tactile pattern recognition. Finally, a larger MFSN array is simulated for classifying objects with different shapes, temperatures, and weights, validating the feasibility of the MFSNs for practical applications. The proof-of-concept MFSNs enable the building of multimodal sensory systems and contribute to the development of highly intelligent robotics.

著录项

来源
《Advanced Materials》 |2022年第24期|2200481.1-2200481.9|共9页
作者
Zhu Jiaxue; Zhang Xumeng; Wang RuiWang MingChen PeiCheng LingliWu ZuhengWang YongzhouLiu QiLiu Ming;
展开▼
作者单位

Chinese Acad Sci, Inst Microelect, Key Lab Microelect Device & Integrated Technol, Beijing 100029, Peoples R China;

Chinese Acad Sci, Inst Microelect, Key Lab Microelect Device & Integrated Technol, Beijing 100029, Peoples R China|Fudan Univ, Frontier Inst Chip & Syst, Shanghai 200433, Peoples R China|Shanghai Qi Zhi Inst, Shanghai 200232, Peoples R China|Fudan Univ, Z;

Chinese Acad Sci, Inst Microelect, Key Lab Microelect Device & Integrated Technol, Beijing 100029, Peoples R China|Univ Chinese Acad Sci, Beijing 100049, Peoples R ChinaFudan Univ, Frontier Inst Chip & Syst, Shanghai 200433, Peoples R China|Shanghai Qi Zhi Inst, Shanghai 200232, Peoples R China|Fudan Univ, Zhangjiang Fudan Int Innovat Ctr, Shanghai 200433, Peoples R China;

展开▼
收录信息
原文格式 PDF
正文语种英语
中图分类
关键词
memristors; multimode-fused perception; object classification; sensors; spiking neurons;

A Heterogeneously Integrated Spiking Neuron Array for Multimode-Fused Perception and Object Classification

摘要

著录项

相关主题

期刊订阅