rubyflow.com /1 month ago

llm_cost_tracker 0.14.1: RubyLLM 2.x, long streams, transaction-safe writes

llm_cost_tracker is self-hosted LLM cost tracking for Rails: every call through RubyLLM, the OpenAI and Anthropic SDKs, Gemini, or any OpenAI-compatible API is logged with tokens,...

Read source
rubyflow.com /1 month ago

LlmCostTracker 0.14.2: OpenRouter billed cost, xAI and Mistral prices, and a reprice

LlmCostTracker tracks LLM spend and budgets in a Rails app by user, feature, or any tag, in your own database and with no proxy.

Read source
rubyflow.com /1 month ago

llm.rb v17.0.0 released!

llm.rb is an agentic runtime for building AI applications on CRuby. It supports 14 different providers, it has zero runtime dependencies by default, and it can execute tool calls o...

Read source
rubyflow.com /1 month ago

Chat Modes: Configuring the LLM for Each Turn

RubyLLM::Modes is an extension for RubyLLM: before each chat turn, a router picks the instructions, tools, model, and thinking for that reply. The router uses Jev through the new R...

Read source
rubyflow.com /1 month ago

LLMCostTracker 0.15.0: per-run budgets for agents, RubyLLM 2.1, more providers

LLMCostTracker records the LLM calls your Rails app makes through RubyLLM, the official OpenAI and Anthropic SDKs or Faraday into your own database: priced per call, tagged by user...

Read source
rubyflow.com /2 weeks ago

llm.rb v18.0.0 released!

llm.rb is a runtime that supports agentic development. This release requires Ruby v4 (with v4.1.0+ recommended, even as a preview1). The standout feature (from this release) is bei...

Read source
hostinger.com /1 week ago

vLLM vs. Ollama: Which one should you use for LLM inference?

Choose Ollama for simpler local development and model management, and vLLM for high-throughput inference when your app needs to handle [...] Read More... The post vLLM vs. Ollama:...

Read source

Turn fresh research into a full content calendar

Use SocialBu to discover ideas, generate post drafts, and schedule them across your social channels.

Related searches