Skip to content
Castellan
Smith's icon

How-to · Smith

Read as

Set up the local AI

Set the local AI up on your NPU, graphics cards or processor from the Smith's page, what each tick means, what it downloads, and which NPUs it can use.

Article
1402
Applies to
Smith 0.8.3
Last reviewed
For
For everyone
Written for Smith 0.8.3. Smith is at 0.8.4 now (1 small release since: what changed).

Usually, it's done already#

Castellan's welcome sets the local AI up when you first install it (see Your first day with Castellan). Use the Smith's Set up to add a graphics card later, to add sharper search, or to set it up again when it isn't working.

Set it up#

  1. On the Smith's page, open Set up the local AI.
  2. Under This PC, choose Look at this PC. It lists your graphics cards, your NPU and your processor, as Windows reports them, and the order the local AI tries them in.
  3. Under Set up, tick the accelerators to set up.
  4. Tick what the local AI should do there (below).
  5. Choose Set up. It asks first, then downloads and installs what's needed. The lines below it say how it went.
TickWhat the local AI does with it
chatAnswers in words: summaries and labels.
picturesDescribes what a picture or a screenshot shows.
searchFinds things by meaning.
sharper searchGives the best results of a search a second look, for Reeve's search. A small extra model, a 639 MB download, unticked unless you tick it.

What it does#

  • The NPU first, with its maker's own software. Then each graphics card you ticked, or the processor, with the same models.
  • Everything it downloads is checked against the exact file it expects before it's installed.
  • The local AI is used only once it has answered a test question correctly.
  • Each graphics card keeps enough memory free for your desktop.
  • An NPU you set up yourself is left as it is, unless you tick it.

Downloads can take a while on a slow connection.

Which NPUs it can use#

NPUSupported
Qualcomm Snapdragon XYes
Intel Core UltraYes
AMD Ryzen AI 300Yes
AMD Ryzen 7040 and 8040Not yet: the local AI uses a graphics card or the processor instead.

An NPU the Smith can't use is named on its page, with the reason (an old driver, say: update it from your PC maker's site, then Look at this PC again).

Without an NPU, a graphics card does the work, and the processor takes what nothing else can.

Is this page right?

If something on it is wrong or out of date, tell us and we'll fix the page.

Still stuck? Write to support@castellan-software.com and mention article 1402. Every version of Smith, and what changed in it, is in its release notes.