xybrid-ai/xybrid

Install and run a model in your language of choice.

Each badge links to its platform setup. See the full Installation Guide for all options.

Install in pubspec.yaml:

dependencies:
  xybrid_flutter: ^0.11.0

Run a model:

final model = await Xybrid.model('kokoro-82m').load();
final result = await model.run(XybridEnvelope.text('Hello world'));
// result → 24kHz WAV audio

Install in build.gradle.kts:

dependencies {
    implementation("ai.xybrid:xybrid-kotlin:0.11.0")
}

Run a model:

val model = Xybrid.model("kokoro-82m").load()
val result = model.runAsync(Envelope.text("Hello world"))
// result → 24kHz WAV audio

Install in Package.swift:

dependencies: [
    .package(url: "https://github.com/xybrid-ai/xybrid.git", from: "0.11.0")
]

Run a model:

let model = try await Xybrid.model("kokoro-82m").load()
let result = try await model.runAsync(envelope: Envelope.text("Hello world"))
// result → 24kHz WAV audio

Install in a React Native 0.76+ app with the New Architecture (or an Expo SDK 52+ development build):

npm install @xybrid/react-native@0.11.0

For bare React Native, run cd ios && pod install. For Expo, run npx expo prebuild; Expo Go cannot load the native module.

Run a model:

import { Envelope, GenerationConfigs, ModelLoader } from '@xybrid/react-native';

const model = await ModelLoader.fromRegistry('lfm2.5-230m').load();
const result = await model.run(Envelope.text('Name three rivers.'), {
  generationConfig: GenerationConfigs.greedy({ maxTokens: 64 }),
});
console.log(result.text);
await model.release();

See the React Native guide for Expo setup, streaming, and cancellation. On the iOS Simulator, llama.cpp uses the CPU for reliable inference; iOS devices retain Metal acceleration.

Install via OpenUPM (recommended):

openupm add ai.xybrid.sdk

Or add https://package.openupm.com as a scoped registry for scope ai.xybrid.

Install manually — add the git subfolder as a UPM package:

https://github.com/xybrid-ai/xybrid.git?path=/bindings/unity

Native libraries download automatically on import. See the Unity SDK guide for details.

Run a model:

var model = XybridClient.LoadModel("kokoro-82m");
var result = model.Run(Envelope.Text("Hello world"));
// result → 24kHz WAV audio

Install in Cargo.toml:

[dependencies]
xybrid = "0.11.0"

Run a model:

let model = Xybrid::model("kokoro-82m").load()?;
let result = model.run(&Envelope::text("Hello world"))?;
// result → 24kHz WAV audio

Install:

# macOS / Linux
curl -sSL https://raw.githubusercontent.com/xybrid-ai/xybrid/master/install.sh | sh

# Windows (PowerShell)
irm https://raw.githubusercontent.com/xybrid-ai/xybrid/master/install.ps1 | iex

Run a model:

xybrid run --model kokoro-82m --input-text "Hello world" -o output.wav

# voice-assistant.yaml
name: voice-assistant
stages:
  - model: whisper-tiny-ggml  # Speech → text
  - model: qwen2.5-0.5b       # Process with LLM
  - model: kokoro-82m         # Text → speech

xybrid run --config voice-assistant.yaml --input-audio question.wav -o response.wav

final pipeline = Xybrid.pipeline(yaml: yamlString);
final result = await pipeline.run(XybridEnvelope.audio(bytes: audioBytes, sampleRate: 16000));

val pipeline = XybridPipeline.fromYamlAsync(yamlString)
val result = pipeline.runAsync(inputEnvelope)
val transcript = result.stage("asr")?.text  // every stage's output, not just the last

let pipeline = try await XybridPipeline.fromYamlAsync(yamlString)
let result = try await pipeline.runAsync(envelope: inputEnvelope)
let transcript = result.stage("asr")?.text  // every stage's output, not just the last

using var pipeline = Pipeline.FromYaml(yamlString);
PipelineResult result = pipeline.Run(inputEnvelope);
string transcript = result.Stage("asr")?.Text;  // every stage's output, not just the last

let pipeline = Xybrid::pipeline(&yaml_string).load()?;
pipeline.load_models()?;
let result = pipeline.run(&Envelope::audio(audio_bytes))?;

All models run entirely on-device. No cloud, no API keys required. Browse the full catalogue at xybrid.ai/models, or run xybrid models list.

Tool calling: see the Tool Calling guide.

# Install xybrid skills into your project
curl -sSL https://raw.githubusercontent.com/xybrid-ai/xybrid/master/tools/scripts/install-skills.sh | sh

# Generate model_metadata.json from a HuggingFace model
claude /xybrid-init hexgrad/Kokoro-82M-v1.0-ONNX

{
  "model_id": "my-model",
  "version": "1.0",
  "execution_template": { "type": "Onnx", "model_file": "model.onnx" },
  "preprocessing": [],
  "postprocessing": [],
  "files": ["model.onnx"],
  "metadata": { "task": "text-generation" }
}

SDK MMP support: Flutter ✅ · Rust ✅ · Kotlin ✅ · Swift ✅ · React Native ✅ · Unity ✅

Tool calling: local models call functions you define — your tools are plain data and the loop is your code. See the Tool Calling guide.

Embeddings: text embedding models (e.g. EmbeddingGemma 2, all-MiniLM) already run as bring-your-own models: see the custom models guide. Registry models are coming.

• Private / offline — inference runs on-device and keeps working with no network after the first model download.
• One API, five platforms — iOS, Android, macOS, Linux, Windows.
• Many backends, one API — ONNX Runtime, llama.cpp (GGUF), whisper.cpp, Candle and CoreML.
• Multi-model pipelines — chain ASR → LLM → TTS in one call.
• Tool calling — local models call functions you define, on every SDK.
• Swap models without shipping an app — models resolve from the registry at runtime and cache on device.
• Cloud fallback — opt in per run (docs).
• Telemetry you control — opt-in behind an API key (docs).
• Hardware acceleration — Metal and the Apple Neural Engine on Apple, opt-in Vulkan on Linux; Android and Windows are CPU today (docs).

• Documentation
• Discord
• X (Twitter)
• GitHub Issues

We welcome contributions! See CONTRIBUTING.md for guidelines on setting up your development environment, submitting pull requests, and adding new models.

New here? Browse the good first issue label for small, self-contained tasks. Tasks are also grouped by area: area: core, area: sdk, area: examples, area: bindings, area: tests. Medium-difficulty tasks live under help wanted.

Apache License 2.0 — see LICENSE for details.