Cursor Triple Backticks Stop Sequence
An LLM stop sequence is a sequence of tokens that tells the LLM to stop generating text. I previously wrote about stop sequences and prefilling responses with Claude.
Thought Eddies
Developing a Mental Model for using Models
I had an interesting realization today while doing a demo building a web app with Cursor. I was debugging an issue with an MCP server, trying to connect it to Cursor's MCP integration. The code I was using was buggy, and I'd never tried this before (attempting it live was probably a fool's errand...
Astro Code Toggle Component
I built an Astro component called CodeToggle.astro for my experimental site. The idea was to create a simple wrapper around a React (or other interactive component) in an MDX file so that the source of that rendered component could be nicely displayed as a highlighted code block on the click of a...
Document Citations
Using Claude Citations to annotate the sources for document Q&A
The following is an implementation of document Q&A with citations using Anthropic's press release for Claude Citations, a feature meant to reduce LLM hallucinations and provide clarity for which part of the source text the model is using to produce answers to questions. The content below the next...
Running Deepseek Janus Pro 7B on a Macbook
Deepseek is getting a lot of attention with the releases of V3 and recently R1. Yesterday, they also released "Pro 7B" version of Janus, a "Unified Multimodal" model that can generate images from text and text from images. Most models I've experimented with can only do one of the two.
`llm` upgrade pip
The llm package uses a plugin architecture to support numerous different language model API providers and frameworks. Per the documentation, these plugins are installed using a version of pip, the popular Python package manager Use the llm install command (a thin wrapper around pip install) to...
Claude Citations
Today, Anthropic released Citations for Claude.
Zoomable Document
Zooming in and out of a document to view levels of detail, like a map for content
``
Taking Browser Screenshots with Deno
Today, I needed to turn SVGs into PNGs. I decided to use Deno to do it. Some cursory searching showed Puppeteer should be up to the task. I also found deno-puppeteer which seemed like it would provide a reasonable way to make this work.
LLM Conversation Branching
Visualizing and navigating branched conversations with LLMs and embeddings
I wrote about Conversation Branching on my main blog and I've been prototyping an LLM chat app called Delta that has first-class conversation branching. LLM conversations typically follow a linear path, making it unintuitive to explore alternative directions or recover from miscommunications. This...