#Computing in memory Paper Collection(Paper with links)
首个存内计算论文合集,精心策划以覆盖ISSCC 34系列的核心议题,提供了一个全面的技术框架,从存内计算的初步理解到其在现代计算架构中的前沿应用。合集深入探讨了以下关键领域:首先阐述了存内计算的基础知识,:进一步分析了传统与新型存储器技术在存内计算中的角色,包括它们的工作原理及其对性能和效率的影响。探讨了存内计算在处理向量乘矩阵这一关键计算任务时的优势,尤其是在提升计算速度和降低能耗方面。比较数字存内计算的精确性和模拟存内计算的能效性,最后合集展示了存内计算在现实世界中的应用,包括其在人工智能、物联网等技术领域的潜力。
该论文合集是为技术爱好者、研究人员和行业专业人士准备的,旨在提供一个关于存内计算技术发展的深入视角,从理论基础到实际部署,为读者揭示了存内计算的全貌。
ISSCC 2024 decisions are now available on OpenReview!
注1:欢迎各位大佬提交issue,分享CIM 论文和开源项目!
有任何问题,欢迎在Discussion 发表讨论,第一时间分享最新最前沿的存内计算、存储介质,存内应用,深度学习等学起来!
ISSCC是,其收录的论文涵盖涵盖如数字电路设计、模拟电路设计、混合信号设计、CMOS图像传感器、电容数字转换器等多个领域。自202x年以来,存内计算技术高速发展,成为加速神经网络端侧推理的有力途径,ISSCC中将其独立于存储器技术单独为一个章节,在今年的ISSCC会议中即section 34。此系列包含2024 ISSCC 34系列的每节论文以及解析,供开发者学习以及讨论。
Paper: 10.1109/ISSCC49657.2024.10454567
解析: https://blog.csdn.net/m0_58966968/article/details/139472261?utm_source=bbs_include
Paper: 10.1109/ISSCC49657.2024.10454447
解析:https://blog.csdn.net/m0_58966968/article/details/139983166?spm=1001.2014.3001.5502
Paper: 10.1109/ISSCC19947.2020.9062931
解析:https://blog.csdn.net/m0_58966968/article/details/138122847?spm=1001.2014.3001.5502
Paper: 10.1109/ISSCC49657.2024.10454556
解析:https://bbs.csdn.net/topics/618245914
Paper: 10.1109/ISSCC49657.2024.10454489
解析:https://bbs.csdn.net/topics/619197013
Paper: 10.1109/ISSCC49657.2024.10454313
解析:https://blog.csdn.net/m0_58966968/article/details/141897623
Paper: 10.1109/ISSCC49657.2024.10454323 解析:https://bbs.csdn.net/topics/619406224
Paper: 10.1109/ISSCC49657.2024.10454468 解析:https://bbs.csdn.net/topics/619405789
Paper: 10.1109/ISSCC49657.2024.10454372 解析:https://bbs.csdn.net/topics/619406810
存内计算(Computing in Memory)是指将计算单元直接嵌入到存储器中,降低存储器的访问延迟和访存功耗、提高吞吐量和计算性能的技术。通常现代计算机处理器的冯·诺依曼体系中,存储单元和计算单元是独立的两部分,二者之间通过总线进行数据交互。存内计算技术在本质上消除不必要的数据搬移的延迟和功耗,从而消除了传统的冯·诺依曼架构的瓶颈、打破存储墙。本系列筛选了部分存内计算领域的优质综述论文和中文博士论文,希望能帮助初学者更好地理解存内计算领域的相关知识。
Paper: https://www.usenix.org/conference/atc19/presentation/lee
Links: https://www.sciencedirect.com/science/article/abs/pii/S0165562520301085
Links: https://link.springer.com/article/10.1007/s13389-020-00308-5
Links: [10.1109/MCAS.2021.3092533]
Links: [10.1109/TCSI.2021.3064189]
Links: [10.1038/s41565-020-0655-z]
Links: 10.27005/d.cnki.gdzku.2020.004656
Links: 10.27517/d.cnki.gzkju.2023.002238
Links: 10.27307/d.cnki.gsjtu.2022.000032
存内计算技术使数据在存储单元中直接完成计算操作,避免了数据在内存和处理器之间的频繁传输,提高了计算效率和能效比。在该技术中,存储器是影响计算性能、计算方式、电路设计的关键因素,存内计算芯片会因使用的存储器不同而具备不同的特性。本系列筛选了SRAM、MRAM、Nor Flash、DRAM等存内计算领域的热门存储器,汇总了相关介绍文献。
Paper: https://www.nature.com/articles/s41729-021-00100-5
2. A 137.5 TOPS/W SRAM Compute-in-Memory Macro with 9-b Memory Cell-Embedded ADCs and Signal Margin Enhancement Techniques for AI Edge Applications
Paper:https://arxiv.org/abs/2307.05944
3.A Charge Domain P-8T SRAM Compute-In-Memory with Low-Cost DAC/ADC Operation for 4-bit Input Processing
Paper: https://arxiv.org/abs/2211.16008
Paper :https://arxiv.org/abs/2204.09918
2.A noise-tolerant, resource-saving probabilistic binary neural network implemented by the SOT-MRAM compute-in-memory system
Paper: https://arxiv.org/abs/2403.19374
1.Collaborative Training for Compensation of Inference Errors in NOR Flash Computing in memory Chips
Paper: 10.1109/CSCWD61410.2024.10580459
Paper:10.1109/ISCAS51556.2021.9401600
3.Multibit Content Addressable Memory Design and Optimization Based on 3-D nand-Compatible IGZO Flash
Paper: https://xplorestaging.ieee.org/document/10521670
4.Design-Technology Co-Optimizations (DTCO) for General-Purpose Computing In-Memory Based on 55nm NOR Flash Technology
Paper: 10.1109/IEDM19574.2021.9720625
1.Computing-In-Memory Using 1T1C Embedded DRAM Cell with Micro Sense Amplifier for Enhancing Throughput
Paper:10.1109/ICCE-Asia57006.2022.9954870
2.IGZO CIM: Enabling In-Memory Computations Using Multilevel Capacitorless Indium–Gallium–Zinc–Oxide-Based Embedded DRAM Technology
Paper: 10.1109/JXCDC.2022.3188366
3.A Novel Transpose 2T-DRAM based Computing-in-Memory Architecture for On-chip DNN Training and Inference
Paper: 10.1109/AICAS57966.2023.10168641
所有存内计算操作中, 最普遍的是利用基尔霍夫定律 (Kirchoff’s Law) 进行向量乘矩阵操作. 原因在于: (1)它能够高效地将计算和存储紧密结合; (2) 它的计算效率高 (即, 在一个读操作延迟内能 完成一次向量乘矩阵); (3) 目前流行的数据密集型应用中, 如机器学习应用和图计算应用, 向量乘矩阵的计算占了总计算量的 90% 以上 。
1.Dot-Product Engine for Neuromorphic Computing: Programming 1T1M Crossbar to Accelerate Matrix-Vector Multiplication
Paper: https://dl.acm.org/doi/abs/10.1145/2897937.2898010
Paper: https://ieeexplore.ieee.org/abstract/document/9586071
Paper: https://ieeexplore.ieee.org/abstract/document/9382915
Paper: https://ieeexplore.ieee.org/abstract/document/9580448
Paper: https://ieeexplore.ieee.org/abstract/document/9082159
6.Victor: A Variation-resilient Approach Using CellClustered Charge-domain computing for Highdensity High-throughput MLC CiM
Paper: https://ieeexplore.ieee.org/abstract/document/10247934
7.DIMCA: An Area-Efficient Digital In-Memory Computing Macro Featuring Approximate Arithmetic Hardware in 28 nm
Paper: https://ieeexplore.ieee.org/abstract/document/10266328
Paper: https://dl.acm.org/doi/abs/10.1145/3007787.3001139
Paper: https://ieeexplore.ieee.org/abstract/document/10668403
10.A 7-nm Compute-in-Memory SRAM Macro Supporting Multi-Bit Input, Weight and Output and Achieving 351 TOPS/W and 372.4 GOPS
Paper: https://ieeexplore.ieee.org/abstract/document/9250531
数字存内计算与模拟存内计算各有优劣,都是存算一体发展进程中的重点发展路径,数字存内计算由于其高速、高精度、抗噪性强、工艺技术成熟、能效比高等特点,更适用于大算力、云计算、边缘计算等应用场景;模拟存内计算由于其非易失性、高密度、低成本、功耗低等特点,更适用于小算力、端侧、需长时待机等的应用场景。在如今可穿戴设备、智能家具、玩具机器人等应用走进千家万户的背景下,模拟存内计算的高能效、小面积、低成本等市场优势逐渐凸显,比如前面所提到的知存科技WTM2101已率先进入市场规模化应用,在商业化进程中处于领先地位,且更高算力WTM-8系列即将量产,在端侧AI市场具有极大的应用潜力。
1.An 89TOPS/W and 16.3TOPS/mm2 All-Digital SRAM-Based Full-Precision Compute-In Memory Macro in 22nm for Machine-Learning Edge Applications
Paper: https://ieeexplore.ieee.org/abstract/document/9365766
2.A 5-nm 254-TOPS/W 221-TOPS/mm2 Fully-Digital Computingin-Memory Macro Supporting Wide-Range Dynamic-VoltageFrequency Scaling and Simultaneous MAC and Write Operations
Paper: https://ieeexplore.ieee.org/abstract/document/9731754
3.A 28nm 64-kb 31.6-TFLOPS/W Digital-Domain Floating-PointComputing-Unit and Double-Bit 6T-SRAM Computing-inMemory Macro for Floating-Point CNNs
Paper: https://ieeexplore.ieee.org/abstract/document/10067260
Paper: https://ieeexplore.ieee.org/abstract/document/10137208
2.A 22nm Delta-Sigma Computing-In-Memory (ΔΣCIM) SRAM Macro with Near-Zero-Mean Outputs and LSB-First ADCs Achieving 21.38TOPS/W for 8b-MAC Edge AI Processing
Paper: https://ieeexplore.ieee.org/abstract/document/10067289
Paper: https://ieeexplore.ieee.org/abstract/document/10262235
1.A 22nm 64kb Lightning-Like Hybrid Computing-in-Memory Macro with a Compressed Adder Tree and Analog-Storage Quantizers for Transformer and CNNs
Paper: https://ieeexplore.ieee.org/abstract/document/10454278
2.A 28nm 72.12TFLOPS/W Hybrid-Domain Outer-Product Based Floating-Point SRAM Computing-in-Memory Macro with Logarithm Bit-Width Residual ADC
Paper: https://ieeexplore.ieee.org/abstract/document/10454313
Paper: https://ieeexplore.ieee.org/abstract/document/9643526
4.HD-CIM: Hybrid-Device Computing-In-Memory Structure Based on MRAM and SRAM to Reduce Weight Loading Energy of Neural Networks
Paper: https://ieeexplore.ieee.org/abstract/document/9865238
存内计算技术正迅速成为人工智能和其他数据密集型应用的关键驱动力。它通过将计算任务直接嵌入到存储单元中,显著减少了数据在处理器和存储器之间传输的需要,从而降低了延迟和能耗。存内计算在深度学习,图计算,智能传感器以及物联网设备中都有较多应用。
Paper: https://ieeexplore.ieee.org/document/9150090
Paper: https://www.sciencedirect.com/science/article/pii/S0167739X21000286
Paper: https://www.sciencedirect.com/science/article/abs/pii/S0165562520301085
Paper: https://ieeexplore.ieee.org/abstract/document/9512855
Paper: https://ieeexplore.ieee.org/abstract/document/8865099
Paper: https://dl.acm.org/doi/abs/10.1145/3386263.3407649
7.YinMem: A distributed parallel indexed in-memory computation system for large scale data analytics
Paper: https://ieeexplore.ieee.org/abstract/document/7840607
Paper: https://ieeexplore.ieee.org/abstract/document/8283555
Paper: https://ieeexplore.ieee.org/abstract/document/8681546
10.A 351TOPS/W and 372.4GOPS Compute-in-Memory SRAM Macro in 7nm FinFET CMOS for Machine-Learning Applications
Paper: https://ieeexplore.ieee.org/abstract/document/9062985
存内计算技术因其存储与计算一体化的特有优势,吸引了学术界和工业界的广泛关注。近年来,存内计算的研究进展主要集中在模拟与数字电路的融合、新型存储器件的开发以及提高计算精度和速度等方面。特别是在AI任务中,存内计算展现了卓越的能效与性能,推动了大规模神经网络加速器的设计和应用,以下是存内计算研究进展相关的高质量论文。
Paper: https://www.nature.com/articles/s41928-023-01053-4 (https://doi.org/10.1038/s41928-023-01053-4)
Paper: https://www.sciencedirect.com/science/article/pii/S2709472322000028 (https://doi.org/10.1016/j.chip.2022.100004)
Paper: https://iopscience.iop.org/article/10.1088/1674-4926/43/3/031401/meta (https://doi.org/10.1088/1674-4926/43/3/031401)
Paper: https://www.nature.com/articles/s41565-020-0655-z (https://doi.org/10.1038/s41565-020-0655-z)
Paper: https://ieeexplore.ieee.org/abstract/document/8811809 (https://doi.org/10.1109/MSSC.2019.2922889)
Paper: https://www.nature.com/articles/s41467-020-15254-4 (https://doi.org/10.1038/s41467-020-15254-4)
7.An area-efficient in-memory implementation method of arbitrary Boolean function based on SRAM array
Paper: https://ieeexplore.ieee.org/abstract/document/10202194 (https://doi.org/10.1109/TC.2023.3301156)
Paper: https://www.nature.com/articles/s41928-018-0092-2 (https://doi.org/10.1038/s41928-018-0092-2)
Paper: https://www.nature.com/articles/s41928-018-0054-8 (https://doi.org/10.1038/s41928-018-0054-8)
Paper: https://www.sciencedirect.com/science/article/pii/S1383762121001909 (https://doi.org/10.1016/j.sysarc.2021.102276)
存内计算技术通过将计算直接在存储单元中进行,大幅减少数据传输延迟和能耗,显著提升了机器学习模型的推理和训练效率。它特别适用于加速神经网络的矩阵运算,增强实时处理能力和能效,以下是有关存内计算在机器学习领域作用相关的高质量论文。
Paper: https://dl.acm.org/doi/abs/10.1145/3307650.3322237 (https://doi.org/10.1145/3307650.3322237)
Paper: https://ieeexplore.ieee.org/abstract/document/9218505 (https://doi.org/10.1109/DAC18072.2020.9218505)
3.A 351TOPS/W and 372.4GOPS Compute-in-Memory SRAM Macro in 7nm FinFET CMOS for Machine-Learning Applications
Paper: https://ieeexplore.ieee.org/document/9062985 (https://doi.org/10.1109/ISSCC19947.2020.9062985)
4.A 1.041-Mb/mm2 27.38-TOPS/W Signed-INT8 Dynamic-LogicBased ADC-less SRAM Compute-In-Memory Macro in 28nm with Reconfigurable Bitwise Operation for AI and Embedded Applications
Paper: https://ieeexplore.ieee.org/abstract/document/9731545 (https://doi.org/10.1109/ISSCC42614.2022.9731545)
Paper: https://www.science.org/doi/abs/10.1126/science.ade3483 (https://doi.org/10.1126/science.ade3483)
Paper: https://ieeexplore.ieee.org/abstract/document/8918995 (https://doi.org/10.1109/BIOCAS.2019.8918995)
7.A High-Density and Reconfigurable SRAM-Based Digital Compute-In-Memory Macro for Low-Power AI Chips
Paper: https://ieeexplore.ieee.org/document/10124240 (https://doi.org/10.1109/TCSII.2023.3276169)
Paper: https://ieeexplore.ieee.org/document/10124240 (https://doi.org/10.1109/TCSI.2021.3064189)
9.A High Energy Efficient Reconfigurable Hybrid Neural Network Processor for Deep Learning Applications
Paper: https://ieeexplore.ieee.org/abstract/document/8207783 (https://doi.org/10.1109/JSSC.2017.2778281)
Paper: https://ieeexplore.ieee.org/abstract/document/8662392 (https://doi.org/10.1109/ISSCC.2019.8662392)
存内计算加速器通过将计算与存储功能相结合,减少了数据传输的瓶颈,显著提升了机器学习任务中的能效和处理速度,尤其适用于加速神经网络中的矩阵运算,以下是存内计算加速器相关的高质量论文。
Paper: https://ieeexplore.ieee.org/abstract/document/10417860 (https://doi.org/10.1109/TCSI.2024.3355944)
Paper: https://ieeexplore.ieee.org/abstract/document/10247977 (https://doi.org/10.1109/DAC56929.2023.10247977)
3.A 29.12 TOPS/W and 1.13 TOPS/mm2 NAS-Optimized Mixed-Precision DNN Accelerator with Vector Split- andCombination Systolic in 28nm CMOS
Paper: https://ieeexplore.ieee.org/document/10529039 (https://doi.org/10.1109/CICC60959.2024.10529039)
Paper: https://ieeexplore.ieee.org/abstract/document/10248014 (https://doi.org/10.1109/DAC56929.2023.10248014)
5.A Nonvolatile AI-Edge Processor with 4MB SLC-MLC Hybrid-Mode ReRAM Compute-in-Memory Macro and 51.4-251TOPS/W
Paper: A Nonvolatile AI-Edge Processor with 4MB SLC-MLC Hybrid-Mode ReRAM Compute-in-Memory Macro and 51.4-251TOPS/W (https://doi.org/10.1109/ISSCC42615.2023.10067610)
6.A 2.75-to-75.9TOPS/W Computing-in-Memory NN Processor Supporting Set-Associate Block-Wise Zero Skipping and Ping-Pong CIM with Simultaneous Computation and Weight Updating
Paper: https://ieeexplore.ieee.org/abstract/document/9365958 (https://doi.org/10.1109/ISSCC42613.2021.9365958)
7.TensorCIM: Digital Computing-in-Memory Tensor Processor With Multichip-Module-Based Architecture for Beyond-NN Acceleration
Paper: https://ieeexplore.ieee.org/abstract/document/10555118 (https://doi.org/10.1109/JSSC.2024.3406569)
8.A 1ynm 1.25V 8Gb, 16Gb/s/pin GDDR6-based Accelerator-inMemory supporting 1TFLOPS MAC Operation and Various Activation Functions for Deep-Learning Applications
Paper: https://ieeexplore.ieee.org/document/9731711 (https://doi.org/10.1109/ISSCC42614.2022.9731711)
9.Unified Agile Accuracy Assessment in Computing-in-Memory Neural Accelerators by Layerwise Dynamical Isometry
Paper: https://ieeexplore.ieee.org/abstract/document/10247782 (https://doi.org/10.1109/DAC56929.2023.10247782)
Paper: https://dl.acm.org/doi/abs/10.1145/3489517.3530446 (https://doi.org/10.1145/3489517.3530446)