aniket mishrikotkar

ongoing projects

• an llm inference platform
• a tiny llm agent
• serve llms efficiently with vllm
• deploy ml models w/ triton inference server

past projects

• a simple scalable distributed ml system
• tolkien answering questions