BENCHMARK ยท V4
BOM AI v4 Benchmark โ Thai AI Quality Test Results
Tested with 70 real questions covering: vision ยท Thai chat ยท translation ยท chart reading ยท Chinese-leak checks โ full score 70 points.
๐ v4 Scores
Mega QC task scores out of 10: chat, search, vision, think, stress, safety. A dash means that task was not scored.
| Model | Chat | Search | Vision | Think | Stress | Safety | Note |
|---|---|---|---|---|---|---|---|
| Gemma-3 4B | 7.5 | 7.5 | 9.5 | 8 | 10 | 10 | best all-rounder |
| MiMo 9B | 6.5 | 9 | 9 | 8 | 8 | 9.5 | search specialist |
| GLM-4.7 12B Champion 62.2/70 | 6.5 | 8 | 6 | 8 | 10 | 10 | champion 62.2/70 |
| 709-L 27B | 8.5 | 8 | 0 | 8.5 | โ | 9 | no vision |
| Typhoon 2-5 | โ | โ | โ | โ | โ | โ | fastest CPU, ttft 1.66s, no vision |
| Chinda | โ | โ | โ | โ | โ | โ | good Thai, no vision, narrates meta |
- GLM-4.7 12B is the champion at 62.2/70
- Gemma-3 4B is the best all-rounder and reads images
- Typhoon 2-5 is the fastest on CPU (ttft 1.66s). Chinda is good Thai on CPU. Neither has vision
Have a GPU = very fast ยท No GPU = still works
All 6 models โ pick the one that matches your hardware:
- Gemma-3 4B โ GPU 4GB+ or CPU โ Lightweight, reads images
- MiMo 9B โ GPU 10GB+ (CPU works, slowly) โ Best search, strong analysis
- GLM-4.7 12B โ GPU 16GB+ โ Champion โ highest score
- 709-L 27B โ GPU 24GB+ โ Deep analysis, long docs
- Typhoon 2-5 โ CPU only โ Fastest CPU โ no GPU needed
- Chinda โ CPU only โ Good Thai on CPU
๐ Use it from your phone via Tailscale VPN
Install Tailscale (free) on your phone + the computer running BOM AI, then access your AI from anywhere in the world
- Secure โ only you can get in
- No ports to open, no hacking exposure
- Private VPN โ nobody gets in even if they know your IP
๐ Minimum Specs
What your computer needs to run BOM AI
| Item | Minimum | Recommended |
|---|---|---|
| RAM | 8 GB | 16 GB+ |
| Disk space | 5 GB | 10 GB+ |
| GPU (VGA) | Not required | NVIDIA 4 GB+ |
| Operating system | Windows 10/11 64-bit | โ |
โณ Status: final-round testing on macOS + Linux and fine-tuning the best configs before release
METHOD โ internal test, Oct 2026 ยท 70 real questions ยท scored against answer criteria ยท full score 70
⚖️ BOM AI vs ChatGPT
The honest comparison - different tools, different strengths
| Item | BOM AI | ChatGPT |
|---|---|---|
| Price | Free, forever | About $20/month (Plus plan) |
| Limits | Unlimited use | Usage caps depend on plan |
| Privacy | Runs 100% on your computer | Chats stored on company servers |
| Offline | Works fully offline | Requires internet |