large language model [topic]

It should be continuous batching, elevating group batch operations to the ceiling and changing my previous view of CUDA Kernel performance supremacy. There are also many tricks to be done with scheduling.