algorithmicsuperintelligence/optillm

Optimizing inference proxy for LLMs

PythonApache-2.0 Last commit 2 days ago

Open on GitHub

Last 24 hours: +0; stars
Last 7 days: +9; stars
Last 30 days: +58; stars
Total stars: 4,316; 4.3k a month ago
Forks: 394; 0 contributors

Star history

Last 12 weeks · weekly cumulative stars · computed from public GitHub star events

Rank in its topics

Position among repos ranked in each topic (min. 20 stars gained)

Rank of algorithmicsuperintelligence/optillm in each topic for today, this week and this month
Topic	Today	This week	This month
Python	–	–	#510of 639
AI agents	–	–	#505of 542
LLM	–	–	#374of 431

README

README.md

optillm

Optimizing inference proxy for LLMs

Upstar hasn’t fetched this README yet. Read it on GitHub.

Contributors

Activity

Last commit: 2 days ago
Created: Aug 22, 2024
Language: Python
License: Apache-2.0
Tracked in: 3 topics

Similar repos

Rising in the same topics

LosaLosSantos/aurelio-finance

New

Open-source personal finance app with an AI financial advisor: track your net worth, investments, ETFs, cash and debts on your own computer.

Python3.3k Rising100

+3.3k

ARahim3/DigUp

New

Search your Mac by what's in your files: photos, PDFs, recordings, videos and code. On-device, built on Google DeepMind's EmbeddingGemma 2.

Swift2.3k Rising100

+2.3k

bherbruck/solidcraft

New

SolidCraft: an open-source parametric 3D CAD application built in pure Rust. Desktop, web, and automation through MCP.

Rust1.8k Rising100

+1.8k

onehumanbeing/esp32-iphone-agent

New

Let an AI model use a real iPhone with a $7 ESP32: AirPlay eyes, USB HID hands, any OpenAI-compatible vision model. No Mac, no developer account, no jailbreak.

Python1.5k Rising100

+1.5k

Report this repo

algorithmicsuperintelligence/optillm

Growth

Star history

Rank in its topics

README

optillm