Continuous Batching
Posted on
2024-08-04
Symbols count in article
78
words
Reading time
1 mins.
Value's Blog
Home
LLM
推理加速
#
Continuous Batching
Continuous Batching,连续批处理,也称动态批处理或基于迭代的批处理.
#
静态批处理
#
连续批处理
#
参考文章
推理加速
Previous Post
Python
Pytorch
Next Post
Deep Learning
激活函数
1.
Continuous Batching
1.1.
静态批处理
1.2.
连续批处理
1.3.
参考文章
Flash Attention
Paged Attention
Continuous Batching
Tensor Parallelism
Faster Transformer
Value
编程日记 & 随笔
64
posts
53
categories
40
tags
Home
About
Posts
Archives
Categories
Tags
friends
links