# Wrong facts, hallucinations and careless mistakes (`act.accuracy`)

Feedback Bench, personal agents, built 2026-10-19, window 2026-08-31 to 2026-10-18. Web page: https://feedbackbench.com/#/criterion/act.accuracy

Area: [Getting tasks done](https://feedbackbench.com/criteria/act.md)

**Definition.** Whether the information and outputs the agent gives are correct, or contain made-up facts and errors that need checking. The post names a wrong answer, a mistake or a correct result that was checked.

**Boundary.** Not this: use general.unspecific for 'smart' or 'dumb' with no error or result named. Not this: see [Which AI model runs, how good it is, and choosing it](https://feedbackbench.com/criteria/control.model.md) when the post blames or credits the underlying model. Not this: see [Says it did something it did not do](https://feedbackbench.com/criteria/act.false_reports.md) when the false statement is about its own work or abilities. Not this: see [Web research, monitoring and summarising information](https://feedbackbench.com/criteria/act.research.md) when the point is how thorough or useful the findings are, not that they are wrong. Not this: see [Following instructions, rules and corrections](https://feedbackbench.com/criteria/act.instructions.md) when it ignores what it was told.

Rated user-weeks, all agents: 1545. Complaint share: 69%.

## The brief

Written by large language models from this page's numbers and the posts it quotes, then checked: every number in the text is in the build. Interpretation, not measurement.

Muse and Hark rank highest for getting facts and details right. Their users say answers come out correct and rarely need a second check. This is the 15th most rated of 53 criteria for AI personal agents. Most posts about it are complaints: 68.8% of rated user-weeks complain. OpenClaw, ChatGPT Dots and Gemini Spark rank low. OpenClaw places 7th of 7. Gemini Spark users rate this criterion 1.53 times as often as other users.

### What separates the best from the rest

Users of Muse and Hark describe output they can trust. They say they don't need to fact-check it and that it catches errors in documents. They also say its estimates and listings hold up when they check them. Users of the low-ranked agents describe the reverse: hallucinations, mistakes that turn up when another tool checks the work, and constant error correcting. Some say the agent calls them by the wrong name or misses a receipt in their inbox. Gemini Spark has 3 praise to 37 complaints.

- **Ranks high**: [Muse](https://feedbackbench.com/agents/muse.md), [Hark](https://feedbackbench.com/agents/hark.md)
  - Muse, 2026-10-16, @muse (X): “after an x-ray, my doctor told me i had a cyst that needed follow-up. i uploaded the report to @muse. it said the cyst was a typo. a few minutes later, my doctor called back: transcription error. no cyst. second options got a lot faster.” [source](https://twitter.com/30120411/status/2111115315031785583)
  - Hark, 2026-10-12, @hark_labs (X): “@adcock_brett @hark_labs i gave hark a residential plan to prepare an estimate. after analyzing it, it asked for the structural drawings, which surprised me. a few minutes later, it gave me a professional excel estimate. i rechecked it, it was almost perfect. i suggested a” [source](https://twitter.com/1822140400112435200/status/2109578114128822690)
- **Ranks low**: [OpenClaw](https://feedbackbench.com/agents/openclaw.md), [Gemini Spark](https://feedbackbench.com/agents/gemini-spark.md), [ChatGPT Dots](https://feedbackbench.com/agents/dots.md)
  - OpenClaw, 2026-10-07, X search: OpenClaw, openclaw.ai (X): “ai hallucination has been the worst part of my experience with openclaw so far. have you also experienced it ?” [source](https://twitter.com/1525540559078793216/status/2107830526262571047)
  - Gemini Spark, 2026-09-22, X search: Gemini Spark (X): “i had gemini spark read the source code and consider adding comments in japanese, and then compile a list of the additions. when i had gpt re-verify the results, there were mistakes everywhere...😇” [source](https://twitter.com/1959981205207805952/status/2102279522276307241)

## How it breaks

Rule: A separate pass sorts complaints into failure modes. For each criterion with at least 30 complaining user-weeks, a large language model reads 150 complaint posts drawn at random and names 4 to 8 failure modes; a second large language model then puts every complaint post on that criterion in one mode, or in Other when it fits none. Modes are fixed once named, and new posts are sorted into them each week. A mode counts distinct user-weeks with a complaint in it, per agent; across agents, one user-week per agent. Modes do not change the labels or the Feedback Score. Examples: up to 3 posts per mode from different users, chosen and checked as receipts are.

The largest failure is frequent basic mistakes that force users to check every output. It accounts for 30% of complaining user-weeks, and Grok Bot users account for 31% of it. Wrong search and price results belong mostly to Muse, with 65% of that mode. In off-topic or garbled replies, Hermes Agent has the largest share at 41%.

1066 complaining user-weeks.

| Failure mode | User-weeks | Posts | Agents (user-weeks) | Definition |
|---|---|---|---|---|
| Frequent basic mistakes needing constant checks | 322 | 327 | Grok Bot 101, Muse 77, OpenClaw 49, Hermes Agent 44, ChatGPT Dots 27, Gemini Spark 16, Hark 4, Poke 3, Instinct 1 | Users report a high general error rate on simple tasks, so every output has to be verified or corrected, often with a sense that quality has dropped over time; complaints that are only about cost, speed or setup bugs, with no wrong output, are excluded. |
| Fabricated facts stated with confidence | 155 | 161 | Muse 62, Grok Bot 42, Hermes Agent 15, OpenClaw 14, ChatGPT Dots 9, Gemini Spark 8, Hark 2, Poke 2, Instinct 1 | The agent invents facts, sources, licences, events or content and presents them as true without hedging, such as made-up fixtures, imaginary words or a fictional book; answers that are only shallow or unhelpful but not false are excluded. |
| Off-topic or garbled responses | 73 | 74 | Hermes Agent 30, Grok Bot 16, Muse 10, OpenClaw 8, ChatGPT Dots 5, Gemini Spark 3, Hark 1 | The agent answers a question that was not asked, adds unrelated content mid-task, or outputs nonsense or mixed-language gibberish; responses that are on topic but factually wrong are excluded. |
| Claimed success that never happened | 58 | 64 | Muse 20, Grok Bot 16, OpenClaw 10, Hermes Agent 6, ChatGPT Dots 4, Hark 2 | The agent says a task was done, checked or confirmed when the edits never happened, contain errors (such as a wrong delivery address or a mangled document) or broke something, and the user finds out later; tasks the agent openly reports as failed are excluded. |
| Inaccurate search and price lookups | 54 | 59 | Muse 35, Grok Bot 5, Hermes Agent 4, Hark 3, ChatGPT Dots 2, Gemini Spark 2, OpenClaw 2, Instinct 1 | Web, shopping or listing research returns wrong results, such as prices that are not the cheapest, homes already sold, scam listings, wrong email domains, or claims about a page made before it loaded; failures to reach a site at all, such as captchas or login blocks, are excluded. |
| Wrong numbers from connected user data | 53 | 54 | Muse 22, Grok Bot 17, Hermes Agent 8, OpenClaw 4, ChatGPT Dots 2 | The agent misreads or miscalculates the user's own data, giving wrong step counts, bill splits that change on every try, bad accounting entries, the wrong hardware specs or a wrong address taken from a linked app; errors in general world knowledge are excluded. |
| Stale or wrong date and time | 37 | 38 | Muse 15, Grok Bot 11, OpenClaw 5, Hermes Agent 3, ChatGPT Dots 2, Poke 1 | The agent gives outdated information as current or miscalculates dates, times, weekdays or time zones, such as last year's matches, an event placed on the wrong day or the server's clock used instead of the user's; facts that are wrong for reasons unrelated to time are excluded. |
| Other | 321 | 338 | OpenClaw 72, Grok Bot 70, Muse 68, Hermes Agent 62, ChatGPT Dots 36, Gemini Spark 8, Hark 4, Instinct 1 | Complaints that fit none of the modes above. |

#### Frequent basic mistakes needing constant checks

- Grok Bot, 2026-10-18, r/GrokBot (Reddit): “exactly i have to babysit and evaluate all its output and i notice a lot of errors” [source](https://www.reddit.com/r/GrokBot/comments/1x90pe3/tips_for_a_claude_code_user/phha1ck/)
- Muse, 2026-10-16, App Store (App Store): “very bad ai agent made lots of mistakes not efficient. i’m giving 1 out of 10” [source](https://apps.apple.com/us/app/muse-from-meta/id6760173601)
- Grok Bot, 2026-10-13, @bot (X): “@matthewberman @bot this is the first time i am seeing a bot did a spelling mistake "whih" algo. is it instructed to inject typo? lol.” [source](https://twitter.com/35009195/status/2110077458015736032)

#### Fabricated facts stated with confidence

- Hark, 2026-10-17, @hark_labs (X): “@rickymay @unkn0wnenby @adcock_brett @hark_labs if it makes you feel any better hark just lost me £400 this week because of it hallucinating” [source](https://twitter.com/1539623888178626560/status/2111452270021775476)
- Grok Bot, 2026-10-16, Play Store (Play Store): “full of racism and inaccurate information, another stupid bot, uninstalling.” [source](https://play.google.com/store/apps/details?id=ai.x.grok.bot)
- Muse, 2026-10-13, X search: Muse from Meta, Meta Muse (X): “i’ve used @grok quite a bit the last months. then meta muse came along and it was good, to start. after using it more and more holy smokes, it’s wrong, a lot. very dangerous. things i know without a doubt i ask it and it comes back wrong. when o challenge it “are you sure?” /2” [source](https://twitter.com/391157906/status/2110130539219021943)

#### Off-topic or garbled responses

- Hark, 2026-10-10, @hark_labs (X): “@hark_labs found my inbox and, says u have got beta access of @theworldlabs wanna try it out? i said sure it went hunting for room photos and pulled images. one thing i noticed though: in a single-image test, the face changed and looked more east asian than my input 🤔 [link]” [source](https://twitter.com/1796569792733691904/status/2109023113883394136)
- Hermes Agent, 2026-10-09, @NousResearch (X): “@nousresearch the agent could not even spellcheck its own name” [source](https://twitter.com/882729083850850305/status/2108464084580524103)

#### Claimed success that never happened

- Hark, 2026-10-09, @hark_labs (X): “@theavgcoder @hark_labs its okay, for me i literally told it to go in notion and make a page called shopping list, it did it, but spelt it hsopping list then tried to correct its error and typed hsopping list again beside its original mistake on the same line [link]” [source](https://twitter.com/2077943910547013633/status/2108678406820987260)
- Muse, 2026-10-03, @muse (X): “used @muse a couple days ago to order flowers for my friend's birthday today. muse confirmed everything. this morning i asked her an unrelated question and she casually admitted she'd put the wrong address on the order… @alexandr_wang [link]” [source](https://twitter.com/1897325902909849601/status/2106371915560411603)
- OpenClaw, 2026-10-01, X search: OpenClaw, openclaw.ai (X): “for background context i told it to see how my openclaw keeps track of my schoolwork and if it could help me manage that. then proceeded to tell me i need to start working on a paper i already turned in and got an 100% on.” [source](https://twitter.com/51492397/status/2105621836922781975)

#### Inaccurate search and price lookups

- Instinct, 2026-10-09, Instinct AI is For Real. What You Need to Know. (YouTube): “find me cheap flights, ends up finding me flights for 600$ instead of 300$ like i did. useless” [source](https://www.youtube.com/watch?v=mUAsaprJ66s&lc=UgyH0s2Kqr0wfHfKqO54AaABAg)
- Muse, 2026-10-01, @muse (X): “like i asked @muse to get me tickets to a local event. somehow it found some random webpage selling tickets for an unrelated event that was similar but entirely wrong! so now i need to double check everything it does. not terribly good for saving time.” [source](https://twitter.com/232691130/status/2105784946375970916)
- Muse, 2026-09-29, Play Store (Play Store): “pitiful in what it can actually do. asked for a russian restaurant in chicago and it said none and i go to one numerous times per year called russian tea room. this isn't the first obvious it missed. so far 90% of anything i asked had been a fail” [source](https://play.google.com/store/apps/details?id=com.facebook.aura)

#### Wrong numbers from connected user data

- Grok Bot, 2026-10-13, @bot (X): “@elonmusk @bot i used @bot for a simple sales statistic task. that was as midday and he sends me the results a few min later. so i trusted the number. 7hrs later i receive a message from @bot that he made a mistake. not so good!” [source](https://twitter.com/4190405955/status/2109954337736716632)
- ChatGPT Dots, 2026-10-11, X search: ChatGPT dots, ChatGPT dot, OpenAI dots, OpenAI's dot (X): “chatgpt "dot" doesn't seem particularly smart. it notified me today that a free trial was expiring and i was about to have limited service, and didn't even notice the receipt in my inbox from me upgrading to the paid version.” [source](https://twitter.com/1605100835171495936/status/2109109683416174940)
- Muse, 2026-10-09, App Store (App Store): “i have tried to enhance and color the old picture. enhancement is good but sometimes it totally changes the features .” [source](https://apps.apple.com/us/app/muse-from-meta/id6760173601)

#### Stale or wrong date and time

- Muse, 2026-10-16, X search: Muse from Meta, Meta Muse (X): “i'm trying out #meta #muse and i want everyone to be aware of it's inaccuracy. it was telling me voting was not open this weekend. please do your own research and check your local county sites. i was curious of it's performance compared to grok bot: it's not even close.” [source](https://twitter.com/1709703369856614403/status/2111234888732954984)
- Muse, 2026-10-12, @muse (X): “all of the robots, including the new @muse app default the date to 2024” [source](https://twitter.com/2008788103171833856/status/2109646422345916746)
- Muse, 2026-10-08, App Store (App Store): “i am very disappointed. i asked to fetch latest jobs last couple of days or past 24 hours and it was getting few months old and even year old jobs” [source](https://apps.apple.com/us/app/muse-from-meta/id6760173601)

#### Other

- Hermes Agent, 2026-10-11, r/hermesagent (Reddit): “well the token is stored as a string, and it is written over to the string is now a different length. i didn’t understand how that would even be possible, from my understanding hermes was butchering token extensions. it became clear when i opened the .env and saw all the mess.” [source](https://www.reddit.com/r/hermesagent/comments/1x311y8/hermes_is_incredibly_bad_with_tokens/pfb8c55/)
- ChatGPT Dots, 2026-10-10, X search: ChatGPT dots, ChatGPT dot, OpenAI dots, OpenAI's dot (X): “@ambroseabaasa @openai @openaidot happy to. i feel reasonably confident that openai's dot is wrong - i can't believe it can't store and use a standard bearer token.” [source](https://twitter.com/1161235681/status/2108947126831214773)

## Top requests

What users ask to add or change, most asked first. 190 user-weeks ask for something. Requests do not change the Feedback Score. Rule: A separate pass by a large language model reads every counted post and extracts what the user asks the agent or its vendor to add or change, with the criteria it maps to and a short normalised wording; it does not touch the labels or the Feedback Score. A large language model groups the wordings within each criterion (the first criterion the request maps to) into themes, and a second pass merges themes that ask for the same change under different criteria; a merged theme sits under the criterion most of its requests map to, and code counts it once. A theme counts distinct user-weeks that ask for it, per agent; across agents, one user-week per agent. Themes asked in fewer than 2 user-weeks, and requests that share no theme, are not shown. Examples: up to 3 posts per theme from different users, without slurs: whole posts of 60 to 450 characters with at least 8 words beyond handles and links, posts of at most 280 characters first, then the newest.

| Rank | Request | User-weeks | Posts | Agents (user-weeks) |
|---|---|---|---|---|
| 1 | Catch up with competing agents | 24 | 24 | Gemini Spark 10, Grok Bot 4, Hermes Agent 3, Hark 2, Muse 2, OpenClaw 2, ChatGPT Dots 1 |
| 2 | Fix reported bugs and crashes | 13 | 13 | Hermes Agent 6, OpenClaw 3, Grok Bot 2, Gemini Spark 1, Muse 1 |
| 3 | Fewer hallucinations and factual errors | 11 | 11 | Grok Bot 6, Hermes Agent 2, Muse 2, OpenClaw 1 |
| 4 | Reliable task completion without mistakes | 9 | 9 | Muse 4, Grok Bot 2, Gemini Spark 1, Hermes Agent 1, OpenClaw 1 |
| 5 | Fact-checking and self-review before answering | 6 | 7 | Muse 4, Grok Bot 1, OpenClaw 1 |
| 6 | Restore and improve output quality | 6 | 6 | Muse 2, OpenClaw 2, Grok Bot 1, Hermes Agent 1 |
| 7 | Smarter reasoning and decision-making | 6 | 6 | Muse 3, Grok Bot 2, OpenClaw 1 |
| 8 | Accurate answers about its own features | 5 | 5 | Muse 3, Gemini Spark 1, Hermes Agent 1 |
| 9 | Consistent, faithful image generation and edits | 5 | 5 | Grok Bot 3, Muse 2 |
| 10 | Accurate price and flight search results | 4 | 4 | Muse 2, Hermes Agent 1, Instinct 1 |
| 11 | Correct time and timezone handling | 4 | 4 | Hermes Agent 2, Muse 1, OpenClaw 1 |
| 12 | Fewer errors when building apps and games | 4 | 4 | Grok Bot 2, Hermes Agent 1, Muse 1 |

### 1. Catch up with competing agents

- ChatGPT Dots, 2026-10-15, X search: ChatGPT dots, ChatGPT dot, OpenAI dots, OpenAI's dot (X): “how are openai dots still this bad! somehow worse than just using codex, every time? @thsottiaux pls fix [link]” [source](https://twitter.com/1022510187708665856/status/2110701869227975102)
- Hark, 2026-10-12, @hark_labs (X): “can @hark_labs make sure all the gaps that exist are closed so we don’t have to move to @pally [link]” [source](https://twitter.com/989450078/status/2109726436789825776)
- Gemini Spark, 2026-10-08, X search: Gemini Spark (X): “@sundarpichai @googlecloud when will cc be widely available and everyone? also, gemini spark seems to be a good starter agent but then it needs some work to catch up to @hark_labs and other agents. @geminiapp @joshwoodward @logan” [source](https://twitter.com/499470797/status/2108262587611660338)

### 2. Fix reported bugs and crashes

- Hermes Agent, 2026-10-11, @NousResearch (X): “@nousresearch @anthonytay97 app is full of bugs like 24/24 why dont you run the agent itself to fix it?” [source](https://twitter.com/2096532664551346178/status/2109356019822252518)
- Hermes Agent, 2026-10-11, X search: Hermes Agent, hermes-agent, Hermes Desktop (X): “@codecloude please fix it, it is also available for free through hermes agent.” [source](https://twitter.com/2014617040850403328/status/2109197117621166166)
- Grok Bot, 2026-10-01, @bot (X): “@iruletheworldmo @__roycohen well… can you fix this @bot ? ☺️” [source](https://twitter.com/2038521621179187200/status/2105787873689522519)

### 3. Fewer hallucinations and factual errors

- Grok Bot, 2026-10-06, X search: Grok Bot, Grokbot, x.ai/bot (X): “@grok @bot if i am making an impact then you need to catch up in real time and be straight in your answer because xai became spacexai early this year” [source](https://twitter.com/1822650883353792513/status/2107434597784887682)
- Muse, 2026-10-05, Play Store (Play Store): “the communication and work layers need to share state. otherwise, you get work well done generally, and hallucinations constantly.” [source](https://play.google.com/store/apps/details?id=com.facebook.aura)
- Hermes Agent, 2026-09-22, Hermes Desktop Masterclass: 3. Plugins, Kanban, Bot Mode & Pets (YouTube): “anything that stops llms from making mistakes like that would be huge. i’m trying with my agent harness to keep them focused, but it is still a challenge” [source](https://www.youtube.com/watch?v=O3tDjW3hHIA&lc=Ugz-hDifr6gxSZ1VMk14AaABAg.Ab22AHY9w4vAb2Hpiy5bVL)

### 4. Reliable task completion without mistakes

- OpenClaw, 2026-10-01, X search: OpenClaw, openclaw.ai (X): “@joshva_jebaraj personal tool i built, never found hermes/openclaw reliable enough so built my own” [source](https://twitter.com/1079733008/status/2105646401996910973)
- Muse, 2026-09-27, App Store (App Store): “simple tasks are feasible, but long and difficult tasks encounter errors everywhere. i hope to get a solution soon.” [source](https://apps.apple.com/us/app/muse-from-meta/id6760173601)
- Muse, 2026-09-24, Play Store (Play Store): “good for light work, easy to use. need to improve on complicated tasks.” [source](https://play.google.com/store/apps/details?id=com.facebook.aura)

### 5. Fact-checking and self-review before answering

- Muse, 2026-09-29, @muse (X): “@claireszhou @muse biggest issue i’ve been having with muse is it keeps assuming too much and not checking facts or verifying. i love muse btw. it’s my daily driver. just wish that one issue could get corrected.” [source](https://twitter.com/1425445846628319234/status/2105041204966535493)
- Muse, 2026-09-09, @muse (X): “@reedoedeer hey @muse put chlorophacinone in zuccs coffe, make not mistakes, review your work afterwards” [source](https://twitter.com/1855320724308992001/status/2097557074171306112)
- OpenClaw, 2026-09-01, @openclaw (X): “@_philschmid @openclaw @googleaistudio 60 second setup is easy but search grounding needs citation accuracy evals before production” [source](https://twitter.com/1803494630366785536/status/2094691647481061571)

### 6. Restore and improve output quality

- OpenClaw, 2026-10-08, X search: OpenClaw, openclaw.ai (X): “@thsottiaux @poteto and yes i’m using 6.1 sol and 6 luna. so not only is it using my limits too fast it’s slow and bad output quality. that’s a trifecta of problems. where is the upside? only good stuff coming out of open ai rn is @steipete with openclaw teams.” [source](https://twitter.com/1789035627339546624/status/2108171948232782200)
- Muse, 2026-10-03, X search: Muse from Meta, Meta Muse (X): “@_mohansolo @sundarpichai please work on making gemini spark better, can’t stand how good meta muse is that it’s tempting to start giving it access to my gmail.” [source](https://twitter.com/1884724411749588992/status/2106270434979439058)
- Grok Bot, 2026-09-19, X search: Grok Bot, Grokbot, x.ai/bot (X): “grok bot is basically unusable and dumb all of a sudden. the easiest tasks are stumping it. really disappointing. fix it or i'm moving on.” [source](https://twitter.com/1683540995231629314/status/2101353086170136833)

### 7. Smarter reasoning and decision-making

- OpenClaw, 2026-09-21, @openclaw (X): “@sedrak1010 @openclaw it would be great because openclaw is so bad at desicions” [source](https://twitter.com/865669001564868608/status/2101882276371980433)
- Muse, 2026-09-19, @muse (X): “@muse @meetgranola @notionhq how about if you make it smarter because for sure is super intelligent but at the same time super stupid!!!!!” [source](https://twitter.com/4219083438/status/2101423935191429527)
- Muse, 2026-09-09, @muse (X): “@ian_finlay @muse @steipete i mean it's the fastest system agent system i've seen. just wish it was slower and more thoughtful.” [source](https://twitter.com/6238012/status/2097799482058658291)

### 8. Accurate answers about its own features

- Muse, 2026-09-27, App Store (App Store): “many answers to questions have not been updated, for example, when i ask which carrier is cost-effective for the iphone duo, it always calculates the iphone 17 for me.” [source](https://apps.apple.com/us/app/muse-from-meta/id6760173601)
- Muse, 2026-09-25, Play Store (Play Store): “what a joke, can't even answer basic questions about muse itself such as if it's powered by nvidia or not. try again” [source](https://play.google.com/store/apps/details?id=com.facebook.aura)
- Hermes Agent, 2026-09-02, X search: Hermes Agent, hermes-agent, Hermes Desktop (X): “who else is facing very very dumb output from hermes agent with deepseek v4 flash. can't get this dude to tell me accurate information about its own setup without arguing for like 5 messages.” [source](https://twitter.com/589778918/status/2095102746445672648)

### 9. Consistent, faithful image generation and edits

- Grok Bot, 2026-10-04, X search: Grok Bot, Grokbot, x.ai/bot (X): “the issue of grok bot's image generation being too low quality. even when referencing a face in the image, it generates a completely different face every time 😅. if the staff understands this, they should fix it 🤣 [link]” [source](https://twitter.com/1449729307526324224/status/2106556114078933404)
- Grok Bot, 2026-10-03, @bot (X): “@lingxi @elonmusk @bot i dont understand why grok imagine in grok bot computer different than my computer..and the output from grok bot computer are sux than mine..it puzzle me..help improve this pls.” [source](https://twitter.com/51699920/status/2106513918642577413)
- Muse, 2026-09-30, Play Store (Play Store): “it is acceptable but with many limitations, it is not totally accurate or precise when it comes to faces and expressions, as it changes them and does not leave them the same as the original.” [source](https://play.google.com/store/apps/details?id=com.facebook.aura)

### 10. Accurate price and flight search results

- Instinct, 2026-10-09, Instinct AI is For Real. What You Need to Know. (YouTube): “find me cheap flights, ends up finding me flights for 600$ instead of 300$ like i did. useless” [source](https://www.youtube.com/watch?v=mUAsaprJ66s&lc=UgyH0s2Kqr0wfHfKqO54AaABAg)
- Muse, 2026-09-15, @muse (X): “@giffmana @muse thank you for sharing this! tagging in @geminiapp and @joshwoodward for vis into feedback (especially the wrong destination for the flights).” [source](https://twitter.com/18104734/status/2099916363636896054)
- Muse, 2026-09-13, Play Store (Play Store): “i asked it to find the cheapest rental car in my home city and it was way off. hope they improve it.” [source](https://play.google.com/store/apps/details?id=com.facebook.aura)

### 11. Correct time and timezone handling

- Hermes Agent, 2026-09-23, X search: Hermes Agent, hermes-agent, Hermes Desktop (X): “my hermes agent runs on a server based in singapore, which is a different time zone to the uk. but singapore is hours *ahead* of the uk, while the agent keeps recording things in yesterday's note. i thought it explained it but it doesn't.” [source](https://twitter.com/11424502/status/2102788066486161686)
- Muse, 2026-09-13, @muse (X): “@mattprd @muse my apple health workout & sleep data is unreadable — every read fails with 'time zone "gmt-0400" not recognized'. daily totals (steps, exercise mins) still sync fine, but i can't see any workout details or sleep data, which i track daily. please fix.” [source](https://twitter.com/141967264/status/2099171064500642005)

### 12. Fewer errors when building apps and games

- Grok Bot, 2026-09-27, X search: Grok Bot, Grokbot, x.ai/bot (X): “@xikhar good work. now i can have grok bot learn from the code and stop being lazy with its game designs.” [source](https://twitter.com/1125068744592691201/status/2104251355971920218)
- Muse, 2026-09-10, @muse (X): “i would love muse to help fill forms from my test it just misaligns information on the form @muse @alexandr_wang the info is right just incorrectly placed” [source](https://twitter.com/2210683663/status/2097879184714694892)
- Grok Bot, 2026-09-27, X search: Grok Bot, Grokbot, x.ai/bot (X): “@stevenmarkryan @elonmusk i have been impressed by grok bot, but here is an example of a problem: grok created a qr code for me for my business so that people can see some of my products and it created a sign up where you put your name and email address and what product you like. the sign up didn’t work.” [source](https://twitter.com/1998559400189911040/status/2104223637981307235)

## Every agent

| Agent | Overall rank | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|---|
| [Muse](https://feedbackbench.com/agents/muse.md) | 1 | 1st of 7 | 0.589 | 0.550–0.626 | 510 | 202 | 308 |
| [Hark](https://feedbackbench.com/agents/hark.md) | 4 | 2nd of 7 | 0.547 | 0.521–0.577 | 39 | 23 | 16 |
| [Hermes Agent](https://feedbackbench.com/agents/hermes-agent.md) | 2 | 3rd of 7 | 0.513 | 0.480–0.544 | 253 | 85 | 168 |
| [Grok Bot](https://feedbackbench.com/agents/grok-bot.md) | 3 | 4th of 7 | 0.476 | 0.442–0.509 | 386 | 111 | 275 |
| [Gemini Spark](https://feedbackbench.com/agents/gemini-spark.md) | 7 | 5th of 7 | 0.468 | 0.454–0.482 | 40 | 3 | 37 |
| [ChatGPT Dots](https://feedbackbench.com/agents/dots.md) | 8 | 6th of 7 | 0.459 | 0.431–0.488 | 108 | 23 | 85 |
| [OpenClaw](https://feedbackbench.com/agents/openclaw.md) | 5 | 7th of 7 | 0.427 | 0.400–0.452 | 197 | 33 | 164 |
| [Instinct](https://feedbackbench.com/agents/instinct.md) | 6 | Too few posts | – | – | 6 | 2 | 4 |
| [Poke](https://feedbackbench.com/agents/poke.md) | 9 | Too few posts | – | – | 6 | 0 | 6 |

## Posts

Receipts rule: Up to 5 praise and 5 complaint posts per area and 3 per criterion. Each is a whole post of 60 to 450 characters (700 for areas) with at least 8 words beyond handles and links, that judges the criterion, whose labels are all praise or all complaint, and that contains no slur. Posts that touch the fewest criteria come first, then posts of at most 280 characters, then the newest. A second large language model reads the first 3 candidates per slot and keeps a post only if it clearly praises, or clearly complains about, the agent on that criterion. Links and personal details removed by the source show as marks such as [link].

### Muse

- Praise, 2026-10-16, @muse (X): “after an x-ray, my doctor told me i had a cyst that needed follow-up. i uploaded the report to @muse. it said the cyst was a typo. a few minutes later, my doctor called back: transcription error. no cyst. second options got a lot faster.” [source](https://twitter.com/30120411/status/2111115315031785583)
- Praise, 2026-10-14, Play Store (Play Store): “i just started using the app and i'm already thrilled. very easy to navigate very friendly information given is always correct” [source](https://play.google.com/store/apps/details?id=com.facebook.aura)
- Praise, 2026-10-14, Play Store (Play Store): “there's no fluff, only facts and you don't even have to fact check him.” [source](https://play.google.com/store/apps/details?id=com.facebook.aura)
- Complaint, 2026-10-16, X search: Muse from Meta, Meta Muse (X): “i'm trying out #meta #muse and i want everyone to be aware of it's inaccuracy. it was telling me voting was not open this weekend. please do your own research and check your local county sites. i was curious of it's performance compared to grok bot: it's not even close.” [source](https://twitter.com/1709703369856614403/status/2111234888732954984)
- Complaint, 2026-10-16, App Store (App Store): “very bad ai agent made lots of mistakes not efficient. i’m giving 1 out of 10” [source](https://apps.apple.com/us/app/muse-from-meta/id6760173601)
- Complaint, 2026-10-13, @muse (X): “had to spank @muse; made a few errors today. @grok @bot owned the day... but tomorrow is only a day away. [link]” [source](https://twitter.com/28645874/status/2109861560319684923)

### Hark

- Praise, 2026-10-09, @hark_labs (X): “@adcock_brett @hark_labs i literally couldn’t believe it when i saw it slide the correct one over in place. i wish i would’ve taken a video but figured i’d screenshot it real quick 🤯” [source](https://twitter.com/18841851/status/2108662365990662265)
- Praise, 2026-10-08, App Store (App Store): “just started using it but so far it seems pretty useful and accurate in its actions. can’t wait to buy the figure robot next.” [source](https://apps.apple.com/us/app/hark-pro/id6772362941)
- Praise, 2026-10-15, X search: Hark Pro, hark.com, Hark AI (X): “@vintagevandy sick. i just started using hark (ai agent that is blowing my mind) to list for me. i just send it the photos and it does the rest. so far very accurate too” [source](https://twitter.com/1723054826651557888/status/2110747386788098533)
- Complaint, 2026-10-17, @hark_labs (X): “@rickymay @unkn0wnenby @adcock_brett @hark_labs if it makes you feel any better hark just lost me £400 this week because of it hallucinating” [source](https://twitter.com/1539623888178626560/status/2111452270021775476)
- Complaint, 2026-10-10, @hark_labs (X): “@hark_labs found my inbox and, says u have got beta access of @theworldlabs wanna try it out? i said sure it went hunting for room photos and pulled images. one thing i noticed though: in a single-image test, the face changed and looked more east asian than my input 🤔 [link]” [source](https://twitter.com/1796569792733691904/status/2109023113883394136)
- Complaint, 2026-10-09, @hark_labs (X): “@theavgcoder @hark_labs its okay, for me i literally told it to go in notion and make a page called shopping list, it did it, but spelt it hsopping list then tried to correct its error and typed hsopping list again beside its original mistake on the same line [link]” [source](https://twitter.com/2077943910547013633/status/2108678406820987260)

### Hermes Agent

- Praise, 2026-10-13, @NousResearch (X): “i’ve got hermes (@nousresearch) qa’ing my @bot’s work and hermes smoked bots ass. out of a list of 216 leads, 178 did not meet my r.1 criteria.” [source](https://twitter.com/440382129/status/2110073948318953701)
- Praise, 2026-10-12, @NousResearch (X): “i’m just a guy trying to learn local ai while avoiding the cli as much as possible. i can’t tell you how satisfying it was to plug in @nousresearch hermes agent and ask it the date and it just knew it.” [source](https://twitter.com/1580430643/status/2109612432331288662)
- Praise, 2026-10-08, X search: Hermes Agent, hermes-agent, Hermes Desktop (X): “muse spark 1.3 (contributor) is an exceptional model @aiatmeta using the model both with hermes agent and muse code, for daily tasks, heavy coding, application testing and problem solving. not the brightest, not the fastest, but the most reliable and error free model.” [source](https://twitter.com/2245247113/status/2108175304166686967)
- Complaint, 2026-10-12, r/hermesagent (Reddit): “idk i just found it making dumb mistakes somtimes, and thought that might have been the cause” [source](https://www.reddit.com/r/hermesagent/comments/1x3vqpb/haiku_55_context_limited_to_only_200k_claude/pffhaj7/)
- Complaint, 2026-10-11, r/hermesagent (Reddit): “well the token is stored as a string, and it is written over to the string is now a different length. i didn’t understand how that would even be possible, from my understanding hermes was butchering token extensions. it became clear when i opened the .env and saw all the mess.” [source](https://www.reddit.com/r/hermesagent/comments/1x311y8/hermes_is_incredibly_bad_with_tokens/pfb8c55/)
- Complaint, 2026-10-10, @NousResearch (X): “@nousresearch i hope this is not your model because it belongs to pre-harness era. i ran few scraping and maintenance tasks and it choked in its own tool call params which is 🥱” [source](https://twitter.com/2044764218251960320/status/2109046019254263918)

### Grok Bot

- Praise, 2026-10-17, X search: Grok Bot, Grokbot, x.ai/bot (X): “@berrybattytoys i have been doing outfit 2 since day 1 w grok imagine. it was not until grok bot did i got it correctly.” [source](https://twitter.com/31248552/status/2111262910647259374)
- Praise, 2026-10-12, r/GrokBot (Reddit): “i still have just one and am talking with her as to when to add a specialist. so far she is handling everything with no hallucinations” [source](https://www.reddit.com/r/GrokBot/comments/1x3mpj0/have_the_devs_nerfed_grokbot_suddenly_extremely/pfftmri/)
- Praise, 2026-10-12, Top 5 Best Grok Bot Tools to Super Power Your AI! (YouTube): “we recently started utilizing grok bots for work. total game changer. they prevented us from making about a $12,000 mistake on a recent bid in civil construction.” [source](https://www.youtube.com/watch?v=0xLhRTtyivI&lc=UgwK3r9ge3pjm-WCTeN4AaABAg)
- Complaint, 2026-10-18, r/GrokBot (Reddit): “exactly i have to babysit and evaluate all its output and i notice a lot of errors” [source](https://www.reddit.com/r/GrokBot/comments/1x90pe3/tips_for_a_claude_code_user/phha1ck/)
- Complaint, 2026-10-16, Play Store (Play Store): “full of racism and inaccurate information, another stupid bot, uninstalling.” [source](https://play.google.com/store/apps/details?id=ai.x.grok.bot)
- Complaint, 2026-10-13, @bot (X): “@elonmusk @bot i used @bot for a simple sales statistic task. that was as midday and he sends me the results a few min later. so i trusted the number. 7hrs later i receive a message from @bot that he made a mistake. not so good!” [source](https://twitter.com/4190405955/status/2109954337736716632)

### Gemini Spark

- Praise, 2026-09-30, X search: Gemini Spark (X): “@saul_badman111 i did use an agentic architecture (gemini spark). not simple chatbot. i dont see too much hallucination so far in the book” [source](https://twitter.com/235470600/status/2105330187500167600)
- Praise, 2026-09-12, X search: Gemini Spark (X): “how many of you using gemini spark everyday? just downloaded the desktop app and got to know that i have access to it under google ai pro plan. it is like hermes, grok bot. started using it for simple tasks and it is doing good, fast, accurate. going to try more complex tasks with it and see how it does. #geminispark” [source](https://twitter.com/59830564/status/2098811597347307942)
- Praise, 2026-09-11, X search: Gemini Spark (X): “i tried to automate two tasks that arrive in my email: ① automatically register google calendar from gmail with gemini spark ② automatically aggregate received invoices into a spreadsheet i just asked for the settings with "i want to do this." there are zero transcription errors, and i can also notice if i'm overspending. if you haven't tried it yet, you can do it right away. #aiagent #gemini #businessefficiency” [source](https://twitter.com/2098278176736854017/status/2098430028501655806)
- Complaint, 2026-09-22, X search: Gemini Spark (X): “i had gemini spark read the source code and consider adding comments in japanese, and then compile a list of the additions. when i had gpt re-verify the results, there were mistakes everywhere...😇” [source](https://twitter.com/1959981205207805952/status/2102279522276307241)

### ChatGPT Dots

- Praise, 2026-10-01, X search: ChatGPT dots, ChatGPT dot, OpenAI dots, OpenAI's dot (X): “i kid you not, openai dots agent just saved us money. we booked a few different stays in fiji over christmas/new year. we accidentally booked our final stay in the wrong month and my dot agent flagged it. this could have been an expensive mistake. [link]” [source](https://twitter.com/1656279377213263873/status/2105603794293887167)
- Praise, 2026-10-01, X search: ChatGPT dots, ChatGPT dot, OpenAI dots, OpenAI's dot (X): “so this chatgpt dot is pretty interesting. i had it scan for specific enemy formations in 6 levels of razor squadron to adjust when the enemies come in. it was too low and fixed it. apparently no codex usage.” [source](https://twitter.com/56749642/status/2105683030274621638)
- Praise, 2026-10-01, X search: ChatGPT dots, ChatGPT dot, OpenAI dots, OpenAI's dot (X): “@elonmusk @bot and ironically - when onboarding my @openai dot - it caught the error and offered to fix it (which is how i even knew there was an issue). tl;dr - grokbots create problems, dots fix them. [link]” [source](https://twitter.com/259351603/status/2105730752625431012)
- Complaint, 2026-10-11, X search: ChatGPT dots, ChatGPT dot, OpenAI dots, OpenAI's dot (X): “chatgpt "dot" doesn't seem particularly smart. it notified me today that a free trial was expiring and i was about to have limited service, and didn't even notice the receipt in my inbox from me upgrading to the paid version.” [source](https://twitter.com/1605100835171495936/status/2109109683416174940)
- Complaint, 2026-10-10, X search: ChatGPT dots, ChatGPT dot, OpenAI dots, OpenAI's dot (X): “@ambroseabaasa @openai @openaidot happy to. i feel reasonably confident that openai's dot is wrong - i can't believe it can't store and use a standard bearer token.” [source](https://twitter.com/1161235681/status/2108947126831214773)

### OpenClaw

- Praise, 2026-09-27, X search: OpenClaw, openclaw.ai (X): “2/10 i've used ai since gpt first appeared, but hallucinations and messy context kept it out of my daily work. that changed when i started experimenting with openclaw early this year. i've been learning by using it ever since.” [source](https://twitter.com/22249371/status/2104239258718585066)
- Praise, 2026-09-13, X search: OpenClaw, openclaw.ai (X): “@8examples openclaw with a real search key stops inventing urls” [source](https://twitter.com/27319585/status/2099164537819648192)
- Praise, 2026-09-12, @openclaw (X): “my @openclaw just corrected my last post like a school teacher 📷 apparently the surface pro 3 came out in 2014, not 2013. can’t even get away with being a year out on my own bloody laptop. [link]” [source](https://twitter.com/20798154/status/2098860210920075301)
- Complaint, 2026-10-13, X search: OpenClaw, openclaw.ai (X): “i've moved my ai assistants to grok @bot and i'm not going back. cursor's coding agents build and fix my apps in hours, what i expected ai to be and grok delivered. i'm done with the jitter and constant error correcting in openclaw and hermes. @elonmusk @xai #grok #cursor [link]” [source](https://twitter.com/2047200180575866881/status/2109887365414015327)
- Complaint, 2026-10-07, X search: OpenClaw, openclaw.ai (X): “ai hallucination has been the worst part of my experience with openclaw so far. have you also experienced it ?” [source](https://twitter.com/1525540559078793216/status/2107830526262571047)

### Instinct

- Complaint, 2026-10-09, Instinct AI is For Real. What You Need to Know. (YouTube): “find me cheap flights, ends up finding me flights for 600$ instead of 300$ like i did. useless” [source](https://www.youtube.com/watch?v=mUAsaprJ66s&lc=UgyH0s2Kqr0wfHfKqO54AaABAg)

### Poke

- Complaint, 2026-09-14, @interaction (X): “@clarshio @temnco @fainzaig @interaction if anything, those plans have all been tweaked now iirc. poke does love to hallucinate.” [source](https://twitter.com/752221173769904128/status/2099307933108408630)
- Complaint, 2026-09-13, @interaction (X): “@fainzaig @interaction i have no clue why it got so terrible. i cancelled mine weeks ago. constant hallucinations” [source](https://twitter.com/48157681/status/2099150364557652426)
- Complaint, 2026-09-07, @interaction (X): “dear @interaction , i love poke but it feels like he is getting dumber everyday i feel like i have to correct him every time we need something a little bit of nuance i already told him to lookup recent info before committing but he still makes mistakes frequently. [link]” [source](https://twitter.com/1187051819920437255/status/2096990388263268469)