Abstract Nonsense

Posts tagged with "LLM"

Code minimisation for ethical learning from LLMs

Like many people nowadays, I find LLMs an invaluable tool for learning new concepts or vibecoding in unfamiliar stacks and langauages. It’s undeniably a massive accelerator when it comes to quickly iterating and learning.

But it has its downsides. There’s a strong argument to be said that by offloading the challenge of learning something new, your core critical thinking atrophies and your ability to focus slides down the slippery slope of instant gratification.

Structured outputs from LLMs

This is more of a “to-do” than anything, but I really love the idea of inference-time next-token probability-distribution hacking to enforce structured outputs. There’s this neat Python library outlines that I’d love to explore in more depth - it even supports context-free grammars for output guiding!