Dynamic Guided Generation

Heads up... You’re accessing parts of this content for free, with some sections shown as scrambled text.

Heads up... You’re accessing parts of this content for free, with some sections shown as scrambled text.

Unlock our entire catalogue of books and courses, with a Kodeco Personal Plan.

Unlock now

Dynamic Guided Generation

The Generable macro works very well when you know the structure of your data at compile time. In the circumstances where you don’t know the structure until running the app, you can use DynamicGenerationSchema to create a schema at runtime. This produces a result similar to what you’ve done. However, the ability to define properties after compilation provides more flexibility while still allowing you to avoid parsing LLM responses from strings into data structures.

Askbafuts gje Zfyigudulwp Lafopoxiz Heyi Ahow
Ejshuhuvh cqo Fzwusibidsg Fupehedig Nagu Opiy

See forum comments
Download course materials from Github
Previous: Streaming Guided Generation Data Next: Building Tools for Foundation Models