Tag

#fine-tuning

Posts tagged with fine-tuning

4 posts

Async GRPO training on serverless GPUs swaps NCCL collectives for object storage, a lightweight proxy, and elastic spot rollout workers.

Engineering • Sep 14, 2026 •12 min read

Async GRPO Training on Serverless GPUs Cuts RL Cost

Async GRPO training with LoRA swaps NCCL for a bucket and proxy, turning RL fine-tuning from reserved-cluster spend into elastic spot-GPU economics.

#grpo #lora +4

An AI text detector built on a locally fine-tuned language model scores writing samples to separate machine-generated text from human writing.

Guides • Aug 20, 2026 •11 min read

Build an AI Text Detector, Then Test If It Can Ship

Build an AI text detector with small local models, stress-test it on short and human-edited text, and use the error rates to decide if it ships.

#ai-text-detection #local-models +3

Deep learning GPU training where gradient accumulation splits an effective batch into micro-batches that change wall-clock time on rented hardware.

Engineering • Aug 19, 2026 •12 min read

The Real Cost of Gradient Accumulation on T4 and L4

Gradient accumulation can make identical batches train at different speeds. Learn why micro-batch shape drives T4 vs L4 wall-clock time and throughput.

#gradient-accumulation #gpu-benchmarks +4

A decision framework for choosing between fine-tuning, RAG, and prompt engineering when working with small open-weight language models.

Guides • Jul 12, 2026 •13 min read

Fine-Tuning vs RAG vs Prompt Engineering Decision Framework

Fine-tuning vs RAG vs prompt engineering: run this eval-gated framework before training a custom model and inheriting its hidden maintenance tax.

#fine-tuning #rag +4