Jonatan Borkowski's picture

20 34

Jonatan Borkowski PRO

j14i

·

jborkowski

AI & ML interests

None yet

Recent Activity

liked a model 1 day ago

ayanami-kitasan/code-pruner

reacted to codelion's post with 🔥 1 day ago

Reverse Engineering a $500M Mystery: From HashHop to Memory-Augmented Language Models I wrote a deep dive into how Magic AI's 100M token context window might work, starting from their HashHop benchmark and building up to MALM - a Memory-Augmented Language Model. Key insight: treating each key as a single token enables perfect retrieval at unlimited context lengths. The article covers: - How HashHop works and why its perfect accuracy is suspicious - Building a tokenized solver that achieves 100% accuracy - Scaling to MALM for real code search tasks - Why this approach could handle 100M+ tokens Read the full article: https://huggingface.co/blog/codelion/reverse-engineering-magic-hashhop Try the model: https://huggingface.co/codelion/malm-165m Code: https://github.com/codelion/hash-hop

upvoted an article 3 days ago

Introducing AnyLanguageModel: One API for Local and Remote LLMs on Apple Platforms

View all activity

Organizations

j14i 's datasets

None public yet