Andrej Karpathy shared the story of how he built llm.c and encouraged the audience to build more reference architectures that can fit in an LLMs context length. Andrej also further broke down his keynote via this excellent tweet thread: https://x.com/karpathy/status/1841536804073439268
More about the event:
The CUDA Mode server met for the first-time for an IRL hackathon: https://events.accel.com/cudamode
6 Keynotes from the First CUDA Mode IRL Hackathon: https://www.accel.com/noteworthy/6-keynotes-from-the-first-cuda-mode-irl-hackathon
Tri Dao: Together.ai:
https://www.youtube.com/watch?v=_B6ZbRbxiMY
Supriya Rao: PyTorch Insights:
https://www.youtube.com/watch?v=HVKE3Ye4xsM
Andrej Karpathy: Eureka Labs and llm.c:
https://www.youtube.com/watch?v=aR6CzM0x-g0
Lily (Xiaoxuan) Liu: vLLM:
https://www.youtube.com/watch?v=IqhJ5Eq8bgs
Tim Dettmers: The Power of Open Source:
https://www.youtube.com/watch?v=xV-cloHcTDE
Wen-mei Hwu: How to Pick a Hard Problem:
https://www.youtube.com/watch?v=-dJQnCPJ8VA
Accel:
Accel is a global venture capital firm that is the first partner to exceptional teams everywhere, from inception through all phases of private company growth. Atlassian, Bumble, CrowdStrike, Fiverr, Flipkart, Freshworks, Qualtrics, Scale, Segment, Slack, Spotify, Squarespace, Tenable, and UiPath are among the companies Accel has backed over the past 40+ years. We help ambitious entrepreneurs build iconic global businesses.
Connect With Us:
Website: https://www.accel.com/
Linkedin: https://www.linkedin.com/company/accel-vc
Twitter: https://twitter.com/accel
#CUDAMode #GPUMode #hackathon #opensource #opensourceai #llmc