Benchmark your local LLM server (Ollama, vLLM, any OpenAI-compatible API) in one command: how many users your GPU can serve, time to first token, tokens/s, p99.
-
Updated
Nov 14, 2026 - HTML
Benchmark your local LLM server (Ollama, vLLM, any OpenAI-compatible API) in one command: how many users your GPU can serve, time to first token, tokens/s, p99.
LAGEN: latency-aware vision-language-action (VLA) agents. Measure deployment latency, replay it in simulation, and train agents to act under it.
An open-source AI infrastructure profiler that connects AI workload telemetry to physical infrastructure behavior and economics.
Enterprise stakeholder RAG deployment platform with live student query simulation and financial ROI telemetry.
Local RAG evaluation framework for compressed trace retrieval, grounding, citation support, multi-step traces, latency profiling, and agentic efficiency.
Reproducible comparative study of KNN distance metrics across low- to high-dimensional regimes, evaluating preprocessing sensitivity, biometric class imbalance, PCA remedies, and CPU inference latency profiling.
Autonomy ML project for driving data, failure mining, policy learning, safety metrics, and latency benchmarking.
Optimized multimodal video understanding pipeline using Silero VAD gatekeeping and Groq LPUs to reduce processing latency by over 70%.
Performance analysis, data cleaning and visualization for Digital Twin experiments running on industrial testbeds (Fischertechnik). The result is published in the scientific article "Hierarchical Digital Twin Ecosystem for Industrial Manufacturing Scenarios" (2024 50th Euromicro Conference on Software Engineering and Advanced Applications - SEAA).
High-performance C++20 order book engine with REST API, React web terminal, LOBSTER replay, and online ML pipeline.
To associate your repository with the latency-profiling topic, visit your repo's landing page and select "manage topics."