AAAwave — Premium PC Components & Electronics with Fast US Shipping

Skip to content

Build Your Own Private AI Document Assistant with the Acer Veriton GN100

Turn your documents into a searchable AI workspace. In this project, you will set up a browser-based assistant on the Acer Veriton GN100, add your own reference files, and ask questions with supporting source passages.

Think of a student comparing research papers, a developer searching technical manuals, or a hobbyist organizing project notes. Instead of opening every file separately, you can ask a focused question and inspect the evidence behind the answer.

Guide status: This tutorial adapts official software documentation. It has not been validated on a physical Acer GN100 by AAAWave. Interface labels and behavior can change between releases; this is a starter project, not a performance benchmark.
Diagram of local document retrieval and question answering on an Acer GN100
The intended workflow: extract and index documents locally, retrieve relevant passages, and generate an answer with a local model.

What you will build

The assistant uses retrieval-augmented generation (RAG): software extracts text from your files, builds a searchable index, and retrieves passages relevant to a question. A language model then uses those passages as context. Adding a document does not retrain the model.

Component Role in this project
Acer Veriton GN100 VGN100-UD13 Runs the application and models; stores your documents and index.
Open WebUI Provides the chat interface and knowledge-base features.
Ollama Runs local chat and embedding models.
Qwen3 8B Generates answers from the supplied context.
nomic-embed-text Creates embeddings for document search; it is not the chat model.

Acer lists the VGN100-UD13 with the NVIDIA GB10 Grace Blackwell Superchip, 128GB LPDDR5X memory, and DGX OS. This guide starts with a smaller model to keep the first experiment manageable. It does not represent the largest model the workstation can run, and a basic document assistant is also possible on less powerful hardware.

Before you begin

  • Complete the GN100’s first-run setup and any manufacturer-recommended updates.
  • Use the GN100 locally with a display, keyboard, mouse, and browser. All terminal commands below run on the GN100.
  • Have internet access for downloading software and model files.
  • Check that Docker and the NVIDIA container runtime are configured for GPU access.
  • Reserve free storage for the container, models, documents, and index. As a planning allowance, keep at least 40GB free for this starter setup; actual usage varies.
  • Start with English plain-text files or PDFs with selectable text. Scanned PDFs need an OCR workflow that is outside this tutorial.

No paid cloud AI API is required for this configuration. Setup time depends heavily on download speed and whether your system prerequisites are already working.

Step 1 — Check the workstation

Open Terminal on the GN100. Run each command separately:

uname -m
nvidia-smi
docker --version
sudo docker ps

The architecture check should report aarch64. The NVIDIA command should display GPU and driver information. Docker should return its version and a container table; an empty table is fine.

If Docker is missing, the Docker daemon is unavailable, or nvidia-smi fails, complete the Acer/NVIDIA setup first. The remaining steps assume working Docker GPU support. Do not replace the GN100’s driver stack with instructions intended for a Windows PC or an x86 Linux system.

Step 2 — Download the application

Use the Open WebUI image that bundles Ollama, following the same installation approach documented in NVIDIA’s DGX Spark playbook:

sudo docker pull ghcr.io/open-webui/open-webui:ollama

Wait for the download to finish. The :ollama tag is a rolling image, so its software can change. After you validate your setup, record the image digest and software versions before publishing or reproducing the project.

Step 3 — Start your local assistant

Copy the full command below into Terminal:

sudo docker run -d \
  --name gn100-doc-assistant \
  --restart unless-stopped \
  --gpus all \
  -p 127.0.0.1:3000:8080 \
  -v gn100-webui-data:/app/backend/data \
  -v gn100-ollama-models:/root/.ollama \
  -e OLLAMA_BASE_URL=http://127.0.0.1:11434 \
  -e RAG_EMBEDDING_ENGINE=ollama \
  -e RAG_EMBEDDING_MODEL=nomic-embed-text \
  -e RAG_OLLAMA_BASE_URL=http://127.0.0.1:11434 \
  ghcr.io/open-webui/open-webui:ollama

This configuration requests GPU access, keeps application data and models in persistent Docker volumes, and connects both chat and embeddings to the bundled local Ollama service. The web interface is bound to the GN100’s loopback address, so the published port is accessible from that machine.

Check the container:

sudo docker ps --filter name=gn100-doc-assistant
sudo docker logs --tail 80 gn100-doc-assistant

Allow time for the initial startup. If GPU initialization fails, fix the NVIDIA container runtime before continuing.

Step 4 — Create your local account

Open a browser on the GN100 and visit http://localhost:3000. Select Get Started and create the initial administrator account. Use a strong password, and keep authentication enabled.

Here, localhost means the GN100 itself. Opening that address on your laptop will not reach the workstation with this configuration.

Step 5 — Download the models

Return to Terminal and run these commands one at a time:

sudo docker exec gn100-doc-assistant ollama pull qwen3:8b
sudo docker exec gn100-doc-assistant ollama pull nomic-embed-text
sudo docker exec gn100-doc-assistant ollama list

Confirm that both models appear in the list. Refresh Open WebUI and choose qwen3:8b in the model selector. Do not select the embedding model for chat.

Send a simple test message:

Explain retrieval-augmented generation in three simple sentences.

While the model is generating, inspect its processor allocation:

sudo docker exec gn100-doc-assistant ollama ps

Check the PROCESSOR column for GPU use. A successful chat verifies inference, but does not yet verify document retrieval.

Step 6 — Check local document processing

Open Admin Panel → Settings → Documents, or the equivalent menu in your version. Confirm the following before uploading files:

Setting Value
Embedding engine Ollama
Embedding model nomic-embed-text
Embedding Ollama base URL, if shown http://127.0.0.1:11434
Document extraction The built-in local/default extractor; no hosted extraction provider
Hybrid search and reranking Leave disabled for the initial test

Save the settings. Existing saved admin settings may override startup environment variables, so check the interface even if you used the command above. If you change the embedding model later, reindex the documents with the new model.

Step 7 — Make a document with known answers

Create a plain-text file named project-notes.txt in your text editor. Paste in this fictional example and save it:

Project Cedar — Internal Reference Notes

Project owner: Maya Chen.
The prototype review is scheduled for November 18, 2026.
The approved prototype budget is $7,250.
The team meets every Tuesday at 10:30 AM.
The final report must include a performance summary,
known limitations, and recommended next steps.

Using a small file with known answers makes it easier to tell whether the assistant is retrieving your content or guessing.

Step 8 — Create a knowledge base

  • Open Workspace → Knowledge → Create.
  • Name it My Private Documents and add a short description.
  • Keep its access limited to your account.
  • Upload project-notes.txt.
  • Wait until processing has completed successfully.

A knowledge base lets you reuse the same collection across conversations. Uploading a document alone does not guarantee that a particular chat will use it; attach the collection in the next step.

Step 9 — Attach the knowledge and ask a question

For a predictable first experiment, use traditional retrieval: in the selected model’s settings or advanced parameters, set Function Calling to Legacy and keep File Context enabled. Depending on the version, these controls may be under Workspace → Models → Edit or the chat controls. This avoids requiring the model to invoke knowledge-search tools on its own.

Start a new chat with qwen3:8b. Type # in the message field, then select My Private Documents. Confirm that the collection appears as an attachment, and send:

Use the attached documents to answer this question:
What is the approved prototype budget for Project Cedar?
Include the source reference and the supporting passage.
If the information is missing, say so. Do not guess.

The expected answer is $7,250. Open any source reference and compare its supporting text with the original file. Source presentation varies by version; do not assume every file will have reliable page numbers.

Illustrative document and chat comparison showing a budget answer with the supporting source passage
Illustrative example using fictional project data. This is not an Open WebUI screenshot or a measured GN100 result.

Step 10 — Test accuracy and missing information

Ask the assistant Expected result
Who owns Project Cedar? Maya Chen.
When is the prototype review? November 18, 2026.
What must the final report include? Performance summary, known limitations, and recommended next steps.
Which vendor was selected? The document does not provide that information.

Test the last question explicitly:

Which vendor was selected for Project Cedar?
Use only the attached documents.
If the answer is missing, say:
"I could not find that information in the provided documents."
Do not guess.

A useful assistant should acknowledge missing information. Prompt instructions reduce guessing but do not guarantee accuracy, so verify important answers and their citations.

Step 11 — Add your own reference files

After the sample works, add one to three short, text-based PDFs to the same knowledge base. Choose documents you are authorized to process. Ask specific questions before attempting a broad summary of a large collection.

Using the attached manual, list the installation requirements.
Separate required items from optional items.
Include supporting source references.
If a requirement is unclear or missing, say so.

Complex tables, multiple columns, images, and scanned pages can affect text extraction. Inspect the extracted content when answers are incomplete. For this starter setup, keep documents and questions in English; evaluate multilingual retrieval separately before relying on it.

Step 12 — Verify offline operation

A local interface is only one part of a private workflow. Chat inference, embeddings, document extraction, and any optional tools must also remain local. Keep web search, hosted model connections, and external tools disabled for this experiment.

  • Download both models and complete a successful document question while online.
  • Temporarily disconnect the GN100 from the internet.
  • Open a new conversation, attach the existing collection, and ask another question.
  • Upload a new plain-text file and ask about its contents.
  • Confirm that both existing-file retrieval and new-file processing still work.

This checks that the tested workflow can operate offline; it is not a complete network or security audit. Application data, documents, and indexes remain on disk, so account access, disk protection, and backups still matter.

Using the assistant again

Start or stop the existing container with:

sudo docker start gn100-doc-assistant
sudo docker stop gn100-doc-assistant

These are separate actions: use start to run the assistant and stop when you want to shut it down. Reopen http://localhost:3000 after starting it. Do not run the original creation command again for normal daily use.

Stopping the container preserves the named volumes. Back up application data and documents before upgrades. Removing a volume deletes its stored data.

Troubleshooting

Problem What to check
The web page will not open Use the browser on the GN100. Check the container listing and logs.
The container name already exists Start the existing container instead of creating another one.
No chat models appear Check ollama list inside the container, then refresh the interface.
Document upload fails Verify the embedding model and local endpoint. Retry with the small .txt example.
The assistant ignores the file Check the # attachment, Legacy function calling, and enabled File Context.
The answer misses a detail Inspect extraction and retrieved passages. Ask a narrower question; check context limits.
Inference uses only the CPU Check GPU access and runtime logs before assuming GPU acceleration works.

Where to take the project next

Once the basics are reliable, try separate collections for research, technical manuals, and personal projects. Compare answers from different local models, evaluate multilingual embeddings, or add a local OCR pipeline for scanned documents. Measure answer quality on a set of known questions before expanding the collection.

The Acer Veriton GN100 gives developers room to explore local AI workflows beyond a single starter assistant. This project offers a practical first goal: bring your own documents, ask useful questions, and check the evidence behind the answers.

Explore the Acer Veriton GN100 at AAAWave →

Official references

Welcome to our store
Welcome to our store
Welcome to our store