- cross-posted to:
- localllama
- [email protected]
- [email protected]
- cross-posted to:
- localllama
- [email protected]
- [email protected]
My kernels go 2x faster than MKL for matrices that fit in L2 cache, which makes them a work in progress, since the speedup works best for prompts having fewer than 1,000 tokens.
You must log in or register to comment.