How-to · Smith
Set up the local AI
Set the local AI up on your NPU, graphics cards or processor from the Smith's page, what each tick means, what it downloads, and which NPUs it can use.
- Article
- 1402
- Applies to
- Smith 0.8.3
- Last reviewed
- For
- For everyone
Usually, it's done already#
Castellan's welcome sets the local AI up when you first install it (see Your first day with Castellan). Use the Smith's Set up to add a graphics card later, to add sharper search, or to set it up again when it isn't working.
Set it up#
- On the Smith's page, open Set up the local AI.
- Under This PC, choose Look at this PC. It lists your graphics cards, your NPU and your processor, as Windows reports them, and the order the local AI tries them in.
- Under Set up, tick the accelerators to set up.
- Tick what the local AI should do there (below).
- Choose Set up. It asks first, then downloads and installs what's needed. The lines below it say how it went.
| Tick | What the local AI does with it |
|---|---|
| chat | Answers in words: summaries and labels. |
| pictures | Describes what a picture or a screenshot shows. |
| search | Finds things by meaning. |
| sharper search | Gives the best results of a search a second look, for Reeve's search. A small extra model, a 639 MB download, unticked unless you tick it. |
What it does#
- The NPU first, with its maker's own software. Then each graphics card you ticked, or the processor, with the same models.
- Everything it downloads is checked against the exact file it expects before it's installed.
- The local AI is used only once it has answered a test question correctly.
- Each graphics card keeps enough memory free for your desktop.
- An NPU you set up yourself is left as it is, unless you tick it.
Downloads can take a while on a slow connection.
Which NPUs it can use#
| NPU | Supported |
|---|---|
| Qualcomm Snapdragon X | Yes |
| Intel Core Ultra | Yes |
| AMD Ryzen AI 300 | Yes |
| AMD Ryzen 7040 and 8040 | Not yet: the local AI uses a graphics card or the processor instead. |
An NPU the Smith can't use is named on its page, with the reason (an old driver, say: update it from your PC maker's site, then Look at this PC again).
Without an NPU, a graphics card does the work, and the processor takes what nothing else can.
Related articles
Is this page right?
If something on it is wrong or out of date, tell us and we'll fix the page.
Still stuck? Write to support@castellan-software.com and mention article 1402. Every version of Smith, and what changed in it, is in its release notes.