JSON Generation with LlamaSharp
Techniques for getting consistent structured data from Local Language Models
llamasharp
Blog posts tagged by llamasharp
Getting Started with LlamaSharp
Running Local Small Language Models in .NET
Why Use Small Language Models in .NET?
A practical intro to SLMs for developers who want powerful AI features without cloud complexity
Efficient Language Model Memory Management with LlamaSharp
A practical guide to KV cache behavior, memory optimization, and performance tuning on consumer hardware
Mastering LlamaSharp's Sampling Pipeline
Fine-tuning Text Generation in Your .NET Applications
Advanced RedPajama Features
Taking control of model output with advanced type modeling
Strongly Typed GBNF Generation
Creating GBNF and JSON Samples from C# Classes
Exploring Llama.Grammar
A look at Llama.Grammar, its features, and how it compares to RedPajama for generating GBNF from C#.