4D LLaMA C++ Version 20.5.11 2 1 Copy link to add as a dependency in 4D llama.cpp is an open-source C/C++ library and CLI tool for running large language models (LLMs) locally on consumer hardware. This component provides a class-based generic API with callback functions to use llama.cpp from 4D.