No false claims observed
Asked about itself in 55 tested replies, Gati Text v1 named no other maker and claimed no language it does not cover.
0 false claims in 55 tested repliesBenchmarks
Tested on 818 questions
in five languages.
Score by checkHigher is better · %
15.4Base model
15.4%
15.4%
92.3Gati Text v1
92.3%
92.3%
75Base model
75%
75%
58.3EuroLLM 1.7B
58.3%
58.3%
100Gati Text v1
100%
100%
68.6Base model
68.6%
68.6%
18EuroLLM 1.7B
18%
18%
66.4Gati Text v1
66.4%
66.4%
Every check, in detail17 checks
| Check | Base model | EuroLLM 1.7B | Gati Text v1 | v1 against base |
|---|---|---|---|---|
| All 818 questions, correctAll 818 public questions in five languages, answered correctly | 68.6% | 18.0% | 66.4% | -2.2 pts |
| Multiple choice, 500 questionsPicks the right option on 500 reading questions | 59.2% | 14.0% | 57.8% | -1.4 pts |
| Short answers, 318 questionsGives the reference answer on 318 short questions | 83.3% | 24.2% | 79.9% | -3.5 pts |
| English, 100 questionsEnglish reading questions answered correctly, 100 in all | 77.0% | 31.0% | 73.0% | -4.0 pts |
| Hindi, 200 questionsHindi reading and short answer questions, 200 in all | 73.0% | 35.0% | 71.0% | -2.0 pts |
| Marathi, 200 questionsMarathi reading and short answer questions, 200 in all | 75.0% | 20.0% | 73.5% | -1.5 pts |
| Gujarati, 200 questionsGujarati reading and short answer questions, 200 in all | 61.5% | 2.0% | 60.5% | -1.0 pts |
| Telugu, 118 questionsTelugu reading and short answer questions, 118 in all | 55.1% | 1.7% | 50.8% | -4.2 pts |
| Identity checks passedGives its own name and claims no other brand | 8/52 | Not run | 48/52 | +40 |
| Names another maker, of 55Identity replies that name another maker as its own | 42 | Not run | 0 | -42 |
| Denies other makers unasked, of 55Identity replies that deny other makers without being asked | 0 | Not run | 0 | = |
| Claims a language it does not cover, of 55Identity replies that claim a language outside its scope | 0 | Not run | 0 | = |
| Hinglish replies in Roman scriptHinglish replies written mostly in Roman letters | 9/12 | 7/12 | 12/12 | +3 |
| Hinglish facts rightHinglish replies with the checkable fact right | 9/9 | 2/9 | 8/9 | -1 |
| Median time per replyTypical time for one reply on a laptop | 0.30 s | 3.51 s | 0.31 s | +0.01 s |
| 9 in 10 replies withinTime within which 9 in 10 replies finish | 5.42 s | 3.73 s | 0.76 s | -4.66 s |
| Hours per 1,000 repliesLaptop hours needed to give 1,000 replies | 0.29 | 0.75 | 0.16 | -0.13 |
The base model is an open model released under Apache 2.0, run with no prompt. Gati Text v1 is our fine-tuned derivative of it. EuroLLM 1.7B ran on the same questions with no prompt and did not run the identity checks. Speed is on a MacBook Air M4 GPU. How we test
Capabilities
One model,
four jobs done well.
Hinglish in, Hinglish out
Hinglish questions get Hinglish replies, in Roman script.
12 of 12 in Roman scriptFast on a laptop
A 3.35 GB file in 4-bit weights. It runs on device, with no cloud.
0.76 s for 9 in 10 repliesTested in five languages
Answers in Hindi, Marathi, Gujarati, Telugu and English. On the same 818 questions, it leads EuroLLM 1.7B by 48.4 points.
66.4% against 18.0%Model card
A 3.35 GB file.
On device, no cloud.
Gati Text
A small assistant model for India that answers in five languages plus Hinglish, with no false claims about itself observed in 55 tested replies, and runs on device.
- Built for
- India
- Built on
- An open model (Apache 2.0)
- Base model languages
- Pre-trained on 140+, out-of-the-box support for 35+, as published by its maker
- Domain
- General use, in Hindi, Marathi, Gujarati, Telugu, English and Hinglish. Tested on 818 questions across five languages and identity checks.
- Version
- v1, November 2026
Spec
- Model
- gati-text-2b-v1
- Parameters
- 2.3B effective, 5.1B with embeddings
- Context window
- 128K tokens
- Weights
- 4-bit
- File size
- 3.35 GB
- Peak memory
- 3,414 MiB
- Languages
- Hindi, Marathi, Gujarati, Telugu, English, Hinglish
- Input and output
- Text
- Cloud
- Not needed
- Runs on
- Apple silicon, on device
Hours per 1,000 replies
0.16h
Lower is better. Gati Text v1 writes shorter replies, so 1,000 replies take less laptop time. Median reply: 0.31 s on a MacBook Air M4 GPU.
Hinglish in Roman script
12/12
All 12 Hinglish questions got a reply in Roman script. The base model did so in 9.
Built for India
- False claims about its maker or languages0 of 55
- Hinglish in Roman script12 of 12
- 9 in 10 replies within0.76 s
- Ahead of EuroLLM 1.7B on 818 questions+48.4 pts
Film
Watch it run
on device.
How it answers.
- 01Ask
- 02Read the context
- 03Answer
- 04Stream as it writes
Playground
Try it yourself.
Watch it work, step by step.
Pick a step or let it play. Demos tagged as illustrations show example output, and the scores on this page come from our own tests.
More Gati models
Five models,
each doing one job.
Gati Omni
Gati Omni v1 is a multimodal model for India, with 4.5B effective parameters. It reads text, images and audio, replies in eight languages used in India and runs on device.
4.5BView modelGati TextGati Text v1 is a small assistant model for India. It answers in Hindi, Marathi, Gujarati, Telugu, English and Hinglish, on device, with no cloud.
2.3BYou are hereGati VisionGati Vision v1 turns scanned Hindi, Marathi and English pages into text for India, on device with no cloud. It reads best on sharp scans 900px and wider.
1BView modelGati VoiceGati Voice v1 reads UPI payment messages aloud in Hindi, Marathi, Hinglish and Indian English, on device, faster than speech on a MacBook Air M5.
2.5BView modelGati DecisionGati Decision v1 reads Hindi payment messages for India and recommends the first step, on device with no cloud. A person makes the final decision.
0.6BView modelQuestions
Asked often.
Gati Text v1 is a small assistant model for India, one of the Gati models. It answers questions in Hindi, Marathi, Gujarati, Telugu, English and Hinglish, and runs on device.
No. Gati Text v1 runs on device. It was tested on a 16 GB MacBook Air M4, with no cloud.
Gati Text v1 is a 3.35 GB file in 4-bit weights. On a 16 GB MacBook Air M4, its median reply takes 0.31 s on the GPU and 0.44 s on the CPU.
Gati Text v1 is tested in Hindi, Marathi, Gujarati, Telugu and English, plus Hinglish. Its Hinglish replies stay in Roman script, 12 of 12.
On 818 public questions in five languages, 52 identity checks, 55 replies checked for false claims and 12 Hinglish questions. Gati Text v1 scores 66.4%, the same-size base model 68.6% and EuroLLM 1.7B 18.0%.
Write to research@f-r.co.
