Transformers - TechnoScripts

transformers

Working with transformer models in Python, including the Hugging Face Transformers library.

LLM and GenAI Interview Questions: 40-Question Checkpoint

GenAI screens do not chase whichever model launched last week; they recycle a fixed set of durable ideas in slightly different words. The LLM interview questions in this checkpoint cover that set, forty in all, grouped the way real screens group them, each with a short spoken-style answer, runnable code for the numbers people fumble, and a link to the deep-dive post that teaches it in full. Then you score yourself, get a revisit list built from exactly what you ... Read More

LLM Serving: Ollama Locally, vLLM in Production

Renting tokens from an API is easy; the bill and the data both leave the building. LLM serving is the craft of running an open Large Language Model yourself, fast enough for real users, and this post walks both ends of it with tested Python: Ollama on your laptop for development, vLLM in production, plus the KV-cache math that decides how many users one Graphics Processing Unit (GPU) can actually hold. “The cheapest, fastest, and most reliable components are those ... Read More

GenAI: QLoRA Fine-Tuning with Unsloth on a Free Colab GPU

QLoRA is the trick that lets you fine-tune a 7B-class open model on a free Colab Graphics Processing Unit (GPU) without renting a single hour of cloud compute. It stands for Quantized Low-Rank Adaptation, and it stacks two ideas: load the big base model in 4-bit precision so it barely uses memory, then train only a thin set of adapter matrices on top. The other tutorial in this series (fine-tuning LLMs guide) covers the theory of LoRA and QLoRA. This ... Read More