tristan/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

metal : refactor kernel loading code (#4794)

Browse source 
* metal : detect more GPU families

* metal : refactor kernel loading

* metal : set kernel family requirements

* metal : fix kernel init + fix compile options

* metal : take into account simdgroup reduction support

* metal : print only skipped kernels

* metal : fix check for simdgroup reduction support

* metal : check for Metal 3

* metal : free allocations

* metal : normalize encoder:setComputePipelineStatus calls

ggml-ci

* metal : fix Metal3 family check

ggml-ci

* metal : check for simdgroup matrix mul. feature

ggml-ci
This commit is contained in:
Georgi Gerganov 2024-01-13 18:03:45 +02:00 • committed by GitHub
parent 7dc78764e2
commit b38b5e93ae
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 530 additions and 518 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1048
ggml-metal.m
View file

File diff suppressed because it is too large Load diff