Skip to content
View akurathiswaraj's full-sized avatar

Block or report akurathiswaraj

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
akurathiswaraj/README.md

Hi, I'm Swaraj πŸ‘‹

πŸš€ ML Systems Engineer | CUDA | TensorRT | LLM Inference Optimization

Building high-performance AI inference systems, distributed LLM serving infrastructure, and GPU-optimized real-time pipelines.


⚑ About Me

  • πŸ”₯ Focused on low-latency AI inference and GPU optimization
  • πŸš€ Experienced with TensorRT-LLM, CUDA, vLLM, ONNX Runtime
  • 🧠 Interested in distributed AI systems and runtime performance engineering
  • πŸ“ˆ Passionate about quantization, CUDA Graphs, and scalable AI infrastructure
  • πŸŽ“ MS in Robotics & Autonomous Systems @ Arizona State University

πŸ›  Tech Stack

Inference & GPU Optimization
TensorRT β€’ TensorRT-LLM β€’ CUDA β€’ CUDA Graphs β€’ ONNX Runtime β€’ vLLM

Machine Learning
PyTorch β€’ Transformers β€’ FP16 β€’ BF16 β€’ FP8 β€’ INT8 Quantization

Systems & Infrastructure
Docker β€’ Linux β€’ Async Execution β€’ Multi-threading

Profiling & Performance
Nsight Systems β€’ Nsight Compute β€’ PyTorch Profiler β€’ CUDA Events


πŸš€ Current Focus

  • High-throughput LLM serving
  • CUDA kernel optimization
  • Low-latency inference systems
  • Distributed AI infrastructure
  • GPU runtime performance engineering

Pinned Loading

  1. Optimization-of-Mistral-7B-Inference-on-Hopper-GPU Optimization-of-Mistral-7B-Inference-on-Hopper-GPU Public

    Python

  2. flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

    FlashInfer: Kernel Library for LLM Serving

    Python 6.3k 1.4k