AIThis post was created with the assistance of artificial intelligence (AI).

🔍 Read the full analysis: Mastering 350M AI Model Fine-tuning For Consistent And Structured Outputs on ThorstenMeyerAI.com

Before you orderOffer from Amazon

Get the latest gadgets delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

TL;DR

Liquid AI has published a free, open-source method to fine-tune its 350-million-parameter LFM2.5 model using Group Relative Policy Optimization (GRPO). The process improves structured-output compliance, raising scores on the IFStruct benchmark from 22.6% to 29.7% with minimal resources, making it accessible for small-scale developers.

Liquid AI has released a fully public, low-cost fine-tuning recipe that significantly improves the structured-output compliance of its 350-million-parameter LFM2.5 model as detailed in the original analysis. Using Group Relative Policy Optimization (GRPO), the method raises the model’s performance on the IFStruct benchmark from 22.6% to 29.7%, achieved with roughly 500 training samples and 100 training steps, making it feasible on free-tier GPUs such as those offered by Colab or Kaggle. This development offers a practical approach for small developers to enhance small language models without requiring extensive resources or large-scale training infrastructure.

The core of the new approach involves applying GRPO fine-tuning to the LFM2.5-350M model, using the open-source TRL library on a GPU. The entire process, including evaluation, is designed to be accessible, with the training run completed on minimal hardware—specifically, a MacBook Pro with an Apple M5 Max and 36 GB of memory, paired with llama.cpp for local inference. The improvement was measured on the IFStruct benchmark, which tests a model’s ability to generate schema-compliant structured outputs like JSON and YAML. Prior to fine-tuning, the base model passed only 22.6% of 2,000 samples, but after roughly 100 GRPO steps, the score increased to 29.7%.

The training data came from NVIDIA’s Nemotron-RL-instruction_following-structured_outputs dataset, which pairs prompts with target JSON schemas. To improve format adherence, 40% of prompts were augmented with instructions to return output inside fenced code blocks, helping the model learn to follow format instructions more reliably. The most common errors involved missing required fields, wrong item counts, and type mismatches. Performance varied significantly across different output types, with the highest correctness on event ticket bookings (45.8%) and the lowest on recipes (4.3%).

At a glance
reportWhen: announced March 2024
The developmentLiquid AI’s new fine-tuning recipe enhances the schema adherence of its small LLM, demonstrating measurable improvements on a public benchmark with low-cost, accessible tools.
At a glance
reportWhen: recently published; results reproducibl…
The developmentLiquid AI released a public fine-tuning guide and notebook showing that 100 GRPO training steps on ~500 samples measurably improve structured-output compliance in a 350M-parameter model.

Impact of Cost-Effective Fine-Tuning on Small Models

This development is significant because it demonstrates that small, publicly available models can be improved to produce more reliable, schema-compliant outputs with minimal resources. The roughly seven percentage point gain on the IFStruct benchmark shows that targeted fine-tuning can close the gap toward larger models’ performance, at a fraction of the cost. This approach lowers the barrier for developers who lack access to large training infrastructure, enabling broader experimentation and deployment of structured-output tasks in real-world applications. The open-source nature of the recipe and the detailed setup instructions promote reproducibility and community engagement, potentially accelerating progress in small-model fine-tuning.

Products Worth Considering

Anker SOLIX C1000 Gen 2 Portable Power Station with 200W Solar Panel

Anker SOLIX C1000 Gen 2 Portable Power Station with 200W Solar Panel

As an affiliate, we earn on qualifying purchases.

Background and Relevance of Structured Output Benchmarks

Structured output tasks—such as generating JSON or YAML conforming to schemas—are critical in real-world applications like data extraction, form filling, and API interactions. Despite their importance, most benchmarks do not isolate schema compliance, often embedding it within broader reasoning metrics. The IFStruct benchmark, maintained by Liquid AI, provides a dedicated measure of a model’s ability to generate parseable, schema-adherent outputs. Prior to this work, small models typically struggled with high error rates, especially missing required fields or incorrect formatting. Large models, like GPT-4, perform better but are costly and less accessible. The new fine-tuning recipe aims to bridge this gap by showing that small models can be improved efficiently through targeted training, making schema adherence more achievable for a wider community.

“Our approach demonstrates that even minimal fine-tuning with GRPO can significantly enhance schema compliance in small models, using resources available on free-tier hardware.”

— Thorsten Meyer, Liquid AI

Uncertainties in Generalization and Stability of Improvements

It remains unclear how well these gains generalize beyond the specific IFStruct benchmark or how stable they are across different serving stacks, quantizations, or other small models. The reported improvements are based on a minimal fine-tuning run, and further testing is needed to confirm whether similar results can be achieved at larger scales or on different datasets. Additionally, the exact impact of data augmentation strategies and the reproducibility of results across varied hardware setups are still being evaluated.

Next Steps for Broader Adoption and Validation

The authors plan to encourage community testing of the recipe, including scaling the number of samples and training steps, applying the method to other structured-output tasks, and experimenting with different quantizations. Further research may explore the stability of improvements across diverse deployment environments and the potential for combining this approach with larger models for hybrid solutions. The open-source pipeline allows anyone to reproduce and extend the work, fostering collaborative validation and enhancement.

Key Questions

Can this fine-tuning method be applied to larger models?

While the current work focuses on a 350M model, the principles behind GRPO fine-tuning could potentially be adapted for larger models, though additional resources and adjustments might be necessary.

How accessible is the process for individual developers?

The entire pipeline is designed to run on free-tier hardware like Colab or Kaggle, making it accessible for individual developers and small teams.

Does the improvement apply to all structured-output tasks?

The results are demonstrated on the IFStruct benchmark, which covers JSON and YAML outputs. Applicability to other tasks requires further testing.

How does this compare with training larger models?

The authors do not claim that the small model matches larger models in all respects but show that targeted fine-tuning can close some performance gaps at a fraction of the cost.

What are the limitations of this approach?

Uncertainty remains about the method’s stability across different datasets, hardware setups, and larger models. More extensive testing is needed to confirm its broader effectiveness.

Primary source: Hugging Face · via ThorstenMeyerAI.com

You May Also Like

How To Find And Use Decision Models On Hugging Face

Hugging Face’s explainer shows models selecting among supplied options, but provides no independent evidence of accuracy, speed or cost.

Tim King, AmigaDOS Developer, Has Died

Tim King, known for his work on AmigaDOS, has died. His contributions shaped early personal computing, leaving a lasting legacy.

Seagate Technology Surges In Global Coverage

Seagate Technology experiences a surge in international coverage, with 31 mentions in recent media monitoring, highlighting increased global interest.

It’s The Memory Latency, Stupid

A PivotLake benchmark reports that a single-core GROUP BY query spent 50.1% of CPU slots stalled on memory, highlighting limits of CPU-use metrics.