Questions

These are questions that come to mind while I'm reading or taking walks at night. I'd love to hear your thoughts or recommendations for helpful resources. Feel free to reach out on X/Twitter or Mail Me if you have any answers!

1. Is it possible to identify and consolidate overlapping parameter clusters in LLMs to create more efficient models by systematically mapping redundant knowledge representations?

2. At what precise scales do specific capabilities like reasoning, coding, or creative writing suddenly emerge?