OccamRazor commited on
Commit
8dade62
·
1 Parent(s): ca79691

Vulkan Bugfixes and Improvements (llama/7084)

Browse files

* Modify mat mat mul shader for mul_mat_id, modify mat vec mul shaders for single call batch operation

* Further work towards MoE, disabled for now

* Disable MoE code (not ready yet), fix a number of bugs in shaders and Vulkan code

* Add softmax with f16 mask and pos buffer support

* Disable mul_mat_id shaders for now

* Fix flake8

* Fix validation errors caused by empty buffers on larger batch sizes

Files changed (1) hide show
  1. ggml-vulkan.cpp +0 -0
ggml-vulkan.cpp CHANGED
The diff for this file is too large to render. See raw diff