llama.cpp
technologyOpen-source C/C++ LLM inference library (and GGML kernel toolkit) for running quantized language models locally.
Recent stories
Not yet covered.
Open-source C/C++ LLM inference library (and GGML kernel toolkit) for running quantized language models locally.
Not yet covered.