whisper.cpp / ggml-cuda /fattn-tile-f32.cuh
JohannesGaessler's picture
CUDA: faster large batch FA without tensor cores (llama/7314)
a6d9f2d
raw
history blame
115 Bytes
#include "common.cuh"
void ggml_cuda_flash_attn_ext_tile_f32(ggml_backend_cuda_context & ctx, ggml_tensor * dst);