Rethinking attention with wave physics

Wave Field — wave physics and attention, conceptual illustration

O(N log N) attention on consumer GPUs — no quadratic bottleneck.

what is wave field

Standard attention scales as O(N²). Wave Field routes information with FFT wave convolution on a field — O(N log N), long context on ordinary GPUs. Details in the posts below and on GitHub.

links
GitHub
code & benchmarks
LinkedIn
updates & posts
Contact
get in touch
latest

How Wave Propagation Replaces Attention

Wave attention vs quadratic cost — overview; full write-up on GitHub.

180 Parameters That Control Everything

Routing vs quantization — short note; details on GitHub.

Training on Consumer GPUs

Long-context training on smaller GPUs — benchmarks on GitHub.

Variable Heads Self-Organize

Head specialization — short note; experiments on GitHub.

WaveEngine: minimal C

Small C inference stack — portable; build notes on GitHub.

contact

[email protected]