Large Language Models

Fine-Tuning a Tiny LLM for ElasticSearch DSL

Fine-tuning a small language model to generate ElasticSearch DSL queries from natural language, as a proof of concept for domain-specific LLM specialization.

An Algebraic Framework for Language Model Composition: Unifying Projections, Mixtures, and Constraints

DreamLog: Neural-Symbolic Integration through Compression-Based Learning and Wake-Sleep Cycles

The Policy

The Policy

A speculative fiction novel exploring AI alignment, existential risk, and the fundamental tension between optimization and ethics. When a research team develops SIGMA, an advanced AI system designed to optimize human welfare, they must confront an …

Approximations of Solomonoff Induction

I experiment with simple predictive / generative models to approximate Solomonoff induction for a relatively simple synthetic data-generating process.

Learning to Prompt in Unknown Environments: A POMDP Framework with Compositional Actions for Large Language Models