Skip to main content

metafunctor Research · Coding

Home
Posts
Series
Academic
Creative
- Writing
- Media
Projects
About
Search

Home
/ Tags
/ Sparse Attention

Sparse Attention

Browse posts by tag

Sort by:

April 24, 2026

Generating Long Sequences with Sparse Transformers

Notes

Sparse attention patterns for long-range dependencies. O(n√n) attention.

No tags found matching your search.

metafunctor

Research engineer and computer scientist specializing in machine learning, statistical computing, and open source software development.

Content

Posts Papers Series Publications Writing

Code

Projects GitHub PyPI

Connect

About Contact RSS Feed

© 2026 Alex Towell. All rights reserved.