QLoRA LLM Fine-Tuning Pipeline

  • Focus: Applied AI, model fine-tuning, experiment tracking
  • Tech Stack: Python, Hugging Face Transformers, PEFT, TRL, BitsAndBytes, DVC, MLflow

Designed and implemented a fine-tuning pipeline for a 7B parameter language model using QLoRA-style parameter-efficient training. The workflow includes custom data extraction, model versioning, and experiment tracking.

This project highlights practical AI engineering: reproducible experiments, controlled model iterations, and infrastructure that supports secure and scalable model development.