Fine-Tuning Tool-Calling LLMs: A Complete Guide Using XYZ-Aquila-SFT and Qwen3
In this tutorial, we implement an end-to-end supervised fine-tuning pipeline for the XYZ-Aquila-SFT dataset, Hugging Face Transformers, PyTorch, and PEFT. We stream and examine the dataset, parse multi-turn tool-use trajectories, extract structured instrument calls, analyze corpus traits, and protect embedded reasoning and remark patterns. We then convert instrument schemas between message-embedded and structured codecs, render…
