llama.cpp

tristan/llama.cpp

Fork 0

Commit graph

Author	SHA1	Message	Date
Olivier Chafik	cbaadc9294	grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609 ) * grammars: reserve rejects & next candidates * grammars: reuse new_stacks * grammars: fix missing sig change in llama.h * grammars: fix test (api changed) * grammars: update gbnf-validator.cpp * grammars: simpler syntax (no swap)	2024-04-11 19:47:34 +01:00
Clint Herron	9b84ae1806	examples : add GBNF validator program (#5948 ) * Revising GBNF validator program to be much simpler. * Changing from streams to using cstdio * Adding final newline character.	2024-04-04 10:44:28 +03:00

Author

SHA1

Message

Date

Olivier Chafik

cbaadc9294

grammars: 1.5x faster inference w/ complex grammars (vector reserves / reuses) (#6609 )

* grammars: reserve rejects & next candidates

* grammars: reuse new_stacks

* grammars: fix missing sig change in llama.h

* grammars: fix test (api changed)

* grammars: update gbnf-validator.cpp

* grammars: simpler syntax (no swap)

2024-04-11 19:47:34 +01:00

Clint Herron

9b84ae1806

examples : add GBNF validator program (#5948 )

* Revising GBNF validator program to be much simpler.

* Changing from streams to using cstdio

* Adding final newline character.

2024-04-04 10:44:28 +03:00

2 commits