Granite-SWASH
model Your tags
Your notes
A quiet "granite-next" architecture preview: SWASH = Sliding-Window-Attention + Sinks Hybrid, shipped as a 2B dense and a 3B-a600M MoE under Apache-2.0 with no blog post. The cards position these as previews of the upcoming Granite series architecture — worth tracking as the first public signal of where Granite 5 is heading.
Model Details
License Apache 2.0
Variants
| Name | Parameters | Notes |
|---|---|---|
| granite-swash-2b | 2B | — |
| granite-swash-3b-a600m | 3B | — |