LMRuntime.com / Guides
Documentation
Task-oriented guides for setup, runtime architecture, evidence, governance, security, and project terminology.
Package-first documentation for UAIX.LmRuntime. Guides cover installation, exact ownership, direct dependencies, backend boundaries, deep C# examples, FAQs, generated API details, and direct NuGet links.
Choose a packagePackage FamilyChoose among every public package, inspect direct dependencies, and open version-free installation guides and NuGet pages.Run your first modelGetting StartedInstall LocalEndpoint, verify a local GGUF model, create an isolated session, and generate on the managed CPU path.Find a type or memberAPI ReferenceSearch the public types and documented members represented by package XML documentation.Build an applicationLocalEndpointUse the high-level local-only facade for verified model files, bounded loading, sessions, and greedy generation.Control backend selectionAccelerationRegister, probe, and select execution backends with explicit policy, diagnostics, device identity, and CPU fallback evidence.Use the proven local backendManaged CPU BackendRegister the package-visible managed CPU backend and verify its no-native-asset boundary.Inspect backend packagesGPU Backend RegistrationsUnderstand CUDA, DirectML, Vulkan, ROCm, and Metal identity, capability, runtime-identifier, and fail-closed probe surfaces.Work with managed mathCPU KernelsUse dispatcher, scalar, vector, half-precision, quantized, row-storage, and parity APIs with source-grounded examples.Inspect model artifactsGGUFParse, validate, hash, classify, shard, map, and inspect GGUF model containers without starting inference.Work with tokensTokenizationCreate tokenizers from model metadata, control special tokens, render chat templates, and verify parity.Control the model graphModels.LlamaOwn LLaMA configuration, tensor binding, reference execution, KV-cache state, persistence, and parity.Understand the runtimeArchitectureFollow model, backend-selection, native-asset, and facade boundaries from package reference to execution evidence.Check capability boundariesCapability MatrixSeparate a published API surface from model compatibility, hardware evidence, performance, and host-owned behavior.Check availabilityProject StatusSee what is public now, how backend states differ, and which claims remain scoped.Explore experimental workRoadmapReview the evidence-gated host-controller proposal for budgets, backend policy, recovery, no-op decisions, and reproducible trials.Expose public routesDiscovery PolicyPublish canonical routes, machine-readable files, metadata parity, support boundaries, and no-action behavior for this site.Find the direct answerPackage Answer IndexKeep direct, citable package answers tied to visible package pages, NuGet links, and evidence boundaries.Cite the right pageGenerated-Answer Source MapGround generated summaries in canonical package pages, evidence routes, visible boundaries, and synchronized machine-readable files.Harden search discoveryTechnical Search MetadataMaintain crawlability, metadata, JSON-LD, sitemap, robots, route aliases, entity disambiguation, and package search signals.Evaluate claimsEvidence & BenchmarksUnderstand package evidence, local probes, parity, real-model proof, and reproducible benchmark requirements.Harden an integrationSecurityReview local-file trust, hostile model input, path verification, resource limits, and responsible disclosure.