Posts
All the articles I've posted.
Towards spike-based machine intelligence with neuromorphic computing
Updated: at 15:06Published: at 18:43Nature上关于SNN的综述
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Updated: at 15:06Published: at 13:27Flash Attention，利用硬件结构加速Attention计算速度、减少内存占用的算法。核心是Tiling，Online Softmax和Kernel Fusion。
WWW: What, When, Where to Compute-in-Memory
Updated: at 15:06Published: at 18:34一些关于存内计算的验证与思考。
Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference
Updated: at 15:06Published: at 18:33谷歌的，第一篇完整跑通interger-only量化推理流程的工作。
SpikeSim: An end-to-end Compute-in-Memory Hardware Evaluation Tool for Benchmarking Spiking Neural Networks
Updated: at 15:06Published: at 18:33SNN部署的硬件设计or evaluation benchmark。
PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU
Updated: at 15:06Published: at 18:32From IPADS, 利用模型预测LLM中需要激活的MoE or Neuron，减少资源消耗。
Evaluating Spatial Accelerator Architectures with Tiled Matrix-Matrix Multiplication
Updated: at 15:06Published: at 18:31GEMM data mapping的介绍，主要是各种脉动阵列相关的加速器。
HAWQ: Hessian Aware Quantization of Neural Networks with Mixed-Precision
Updated: at 15:06Published: at 18:30模型量化经典方法，基于黑森矩阵，一种二阶信息的量化方法。
Optimizing Bit-Serial Matrix Multiplication for Reconfigurable Computing
Updated: at 15:06Published: at 18:29BISMO优化。
TVM: An Automated End-to-End Optimizing Compiler for Deep Learning
Updated: at 15:06Published: at 18:29TVM。