node-llama-cpp

v3.1.1
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
llama llama-cpp llama.cpp bindings ai cmake cmake-js prebuilt-binaries llm and 27 more...

Readme Versions Dependencies Scripts

Dependencies (30)

@huggingface/jinja async-retry bytes chalk chmodrp cmake-js cross-env cross-spawn env-var filenamify fs-extra ignore ipull is-unicode-supported lifecycle-utils log-symbols nanoid node-addon-api octokit ora pretty-ms proper-lockfile semver simple-git slice-ansi stdout-update strip-ansi validate-npm-package-name which yargs

Dev dependencies (44)

@commitlint/cli @commitlint/config-conventional @fontsource/inter @nolebase/vitepress-plugin-git-changelog @nolebase/vitepress-plugin-og-image @resvg/resvg-js @semantic-release/exec @semantic-release/github @semantic-release/npm @shikijs/vitepress-twoslash @types/async-retry @types/bytes @types/cross-spawn @types/fs-extra @types/node @types/proper-lockfile @types/semver @types/validate-npm-package-name @types/which @types/yargs @typescript-eslint/eslint-plugin @typescript-eslint/parser @vitest/coverage-v8 @vitest/ui eslint eslint-plugin-import eslint-plugin-jsdoc eslint-plugin-n feed husky rehype rimraf semantic-release sharp tslib typedoc typedoc-plugin-markdown typedoc-plugin-mdn-links typedoc-vitepress-theme typescript vite-node vitepress vitest zx
npm i node-llama-cpp

Metadata

  • MIT
  • >=18.0.0
  • Gilad S.
  • released 10/6/2024

Downloads

Maintainers