Large Language Models

Fine-Tuning Tiny LLMs for ElasticSearch DSL

I am creating a tiny LLM for ElasticSearch DSL as a proof of concept.

An Algebraic Framework for Language Model Composition: Unifying Projections, Mixtures, and Constraints

DreamLog: Neural-Symbolic Integration through Compression-Based Learning and Wake-Sleep Cycles

Learning to Prompt in Unknown Environments: A POMDP Framework with Compositional Actions for Large Language Models

The Policy

Approximations of Solomonoff Induction

I experiment with simple predictive / generative models to approximate Solomonoff induction for a relatively simple synthetic data-generating process.