# Factory (Factory)

Feedback Bench, coding agents, built 2026-10-19, window 2026-08-31 to 2026-10-18. Web page: https://feedbackbench.com/coding-agents/#/agent/factory

| Measure | Value |
|---|---|
| Rank | 6 of 17 (rank range 5–7) |
| Feedback Score | 55.1 (95% interval 52.8–57.2) |
| Popularity | 0.475 (share of voice 0.97%) |
| Customer love | 0.572 (95% interval 0.553–0.591) |
| Place | Popularity 12th of 17 × Customer love 5th of 17 |
| Top quadrant | no |
| Users | 1396 |
| Posts counted | 3801 |
| Posts that judge the agent | 1055 |
| Criteria ranking high / low | 9 / 0 of 63 |

## The brief

Written by large language models from this page's numbers and the posts it quotes, then checked: every number in the text is in the build. Interpretation, not measurement.

Factory's users praise the work its Droid agent does on long tasks and the range of models one plan covers. Their complaints gather around support and account help. People choose it mainly for quality of work, where praise outnumbers complaints 134 to 31 in user-weeks, and for model choice. Support draws more complaints than praise. Factory ranks 6th of 17 coding agents overall and 12th of 17 for share of voice. In this window, no posts compared it head to head with another agent.

### Why people choose it

- **Long tasks run unattended and still work** ([Quality of work](https://feedbackbench.com/coding-agents/criteria/work.md)). 134 : 31: praise to complaints, in user-weeks. Ranks 3rd of 14 on “Quality of work”. Users describe missions that run for hours and still produce working results. One user describes a loop that has run for over 100 hours. Posts credit it with fixing stubborn bugs and building whole projects end to end. Some say missions need less steering than other tools, though some prefer normal sessions for quick jobs.
  Evidence:
  - 2026-10-13, @droid (X): “@droid mission mode is fantastic—long tasks run continuously for 7 hours and still work, which is great. [link]” [source](https://twitter.com/1159835302275346433/status/2109799365552624090)
  - 2026-10-12, @FactoryAI (X): “@davidwuuu92 @factoryai @droid in cursor projects you gotta steer a lot. missions are just built different” [source](https://twitter.com/1921198173110104066/status/2109471724844757057)
- **Paid plans stretch a long way** ([Pricing and limits](https://feedbackbench.com/coding-agents/criteria/paying.md)). 5th: of 13 on “Pricing and limits”. 35% of what users rate. Users say their usage lasts. They credit the harness, a separate pool for open models and discounted rates on new models. Complaints in this area still outnumber praise, and some users worry that usage will be cut.
  Evidence:
  - 2026-10-10, r/FactoryAi (Reddit): “have the $200 plan and it’s been great. limits actually stretch pretty reasonably long due to factory’s insanely good harness. been running opus 5.5 on high with like 8 subagents and haven’t hit the 5 hr limit lol” [source](https://www.reddit.com/r/FactoryAi/comments/1x2batu/how_generous_are_usage_limits_on_the_200_plan/pf25qt4/)
  - 2026-10-09, @FactoryAI (X): “@maxschen29 @factoryai it's humbling being able to chew through so much work without praying for resets.” [source](https://twitter.com/1923709631265959936/status/2108672431938564112)
- **One subscription covers models from many providers** ([Models](https://feedbackbench.com/coding-agents/criteria/models.md)). 1.6×: 16% of what users rate, 1.6× the rate for other agents. Ranks 3rd of 12 on “Models”. Users mix models from different labs in one plan. Some let a frontier model coordinate while cheaper models do the work. Others leave the choice to auto routing. Users say this keeps them from being locked into one provider when a better model comes out.
  Evidence:
  - 2026-10-06, @FactoryAI (X): “@0d7p7 @factoryai i think so, but using factory gives me more freedom regarding providers. if openai releases a better model, i’m not locked into anthropic.” [source](https://twitter.com/23220904/status/2107431201753481451)
  - 2026-10-02, @droid (X): “@fellipesoares @droid set it to auto and let it handle the rest, their router is best-in-class” [source](https://twitter.com/2070908287978246144/status/2105857273432326578)

### Why people leave


### What would move its score

Rule: For each area where an agent's customer love is below the category norm: the Feedback Score and rank it would have if that one area were at the norm (0.5) and everything else stayed the same, computed with the same formula as the ranking. An area's pull follows its weight, so an area many users of the category rate moves the score more than one they rarely mention.

Every area is already at or above the category norm. Moving any single area to the norm would not change the Feedback Score of 55.1 or the 6th place. Complaints lead praise in pricing, setup, interface, reliability and support. Customer love in each of these still sits at or above the norm.

### Six weeks

Weekly users grew from 160 to 349, peaking at 411 in the week of 2026-09-14. Rank rose from 10th to 4th, and share of voice from 0% to 1%. Category users fell from 32,348 to 26,760 over the same weeks.

## Top requests

What users ask to add or change, most asked first. 329 user-weeks ask for something. Requests do not change the Feedback Score. Rule: A separate pass by a large language model reads every counted post and extracts what the user asks the agent or its vendor to add or change, with the criteria it maps to and a short normalised wording; it does not touch the labels or the Feedback Score. A large language model groups the wordings within each criterion (the first criterion the request maps to) into themes, and a second pass merges themes that ask for the same change under different criteria; a merged theme sits under the criterion most of its requests map to, and code counts it once. A theme counts distinct user-weeks that ask for it, per agent; across agents, one user-week per agent. Themes asked in fewer than 2 user-weeks, and requests that share no theme, are not shown. Examples: up to 3 posts per theme from different users, without slurs: whole posts of 60 to 450 characters with at least 8 words beyond handles and links, posts of at most 280 characters first, then the newest.

| Rank | Request | Criterion | User-weeks | Posts |
|---|---|---|---|---|
| 1 | Official mobile app | [Mobile, remote-control and voice access](https://feedbackbench.com/coding-agents/criteria/surfaces.remote_mobile.md) | 15 | 15 |
| 2 | Subscriptions usable in third-party harnesses | [Using an existing subscription across tools](https://feedbackbench.com/coding-agents/criteria/billing.subscription_portability.md) | 14 | 14 |
| 3 | ChatGPT/Codex subscription usable in other tools | [Using an existing subscription across tools](https://feedbackbench.com/coding-agents/criteria/billing.subscription_portability.md) | 12 | 14 |
| 4 | DeepSeek V4.1 Flash model support | [Which models are offered on a plan and when](https://feedbackbench.com/coding-agents/criteria/models.catalog_access.md) | 10 | 10 |
| 5 | Higher overall usage limits | [How much use a plan's price buys](https://feedbackbench.com/coding-agents/criteria/limits.plan_value.md) | 8 | 10 |
| 6 | Free trial of paid plans | [Free tier and free model availability and limits](https://feedbackbench.com/coding-agents/criteria/billing.free_tier.md) | 8 | 9 |
| 7 | Honor promised credits and coupons | [Wrong charges, failed payments and plan provisioning](https://feedbackbench.com/coding-agents/criteria/account.billing_errors.md) | 7 | 9 |
| 8 | Linux desktop app and Linux support | [Install, launch and sign-in](https://feedbackbench.com/coding-agents/criteria/setup.install_signin.md) | 7 | 8 |
| 9 | Muse / Meta model support | [Which models are offered on a plan and when](https://feedbackbench.com/coding-agents/criteria/models.catalog_access.md) | 7 | 7 |
| 10 | Configurable font family and size | [How the interface shows work, and what the user can configure](https://feedbackbench.com/coding-agents/criteria/ui.display_settings.md) | 5 | 5 |
| 11 | Control local desktop sessions from mobile app | [Mobile, remote-control and voice access](https://feedbackbench.com/coding-agents/criteria/surfaces.remote_mobile.md) | 5 | 5 |
| 12 | Remove the 5-hour usage window | [Short rolling usage window blocks or interrupts work](https://feedbackbench.com/coding-agents/criteria/limits.window_interrupts_work.md) | 5 | 5 |

### 1. Official mobile app

- Factory, 2026-10-16, @FactoryAI (X): “i need an @interaction update about what’s cooking since @cognition acquired them, and i need a @factoryai mobile app. 🙏” [source](https://twitter.com/16124492/status/2111132531512783249)
- Factory, 2026-10-01, @FactoryAI (X): “@fellipesoares @factoryai it would be so clutch, especially when im in bed doomscrolling😅” [source](https://twitter.com/1553360279207124999/status/2105499836200198148)
- Factory, 2026-10-01, @FactoryAI (X): “@droid @factoryai bro you are perfect, just need a standalone mobile app please :( now i use paseo for remote access. webapp is fine sometimes but we need a mobile app.” [source](https://twitter.com/106697513/status/2105485693606846873)

### 2. Subscriptions usable in third-party harnesses

- Factory, 2026-10-10, @droid (X): “@gitmaxd @bot @droid you know what would be even better? if you implemented sign in with chatgpt and allowed us to use our xai/ super grok subscriptions with the droid harness, so that i could use the separate quota which my grok subscription gives inside grokbot.” [source](https://twitter.com/2491738032/status/2108929165324132454)
- Factory, 2026-10-09, @FactoryAI (X): “@adityawaslost @droid @factoryai droid is amazing i had to move off it because they don' t let you oauth in with your subs and i was so sick of having to update vibe proxy every couple of days with new models” [source](https://twitter.com/1564038873763549184/status/2108508648188387507)
- Factory, 2026-09-29, @FactoryAI (X): “@droid @factoryai hi droid dy guys support codex or claude oauth 👀” [source](https://twitter.com/2009540015605600256/status/2104764591758868838)

### 3. ChatGPT/Codex subscription usable in other tools

- Factory, 2026-10-01, @FactoryAI (X): “@droid @factoryai i want to use my codex subscription in it the way i can with hermes agent and other harnesses.” [source](https://twitter.com/1258948276272926732/status/2105464357509623880)
- Factory, 2026-09-29, @FactoryAI (X): “@factoryai @openai how about support for individuals and login with chatgpt?” [source](https://twitter.com/89291422/status/2105012446922670085)
- Factory, 2026-09-29, @droid (X): “if @droid would allow to use your own codex sub inside their harness, i would've found my absolute dev environment. would be great to see you allow this like devin does.” [source](https://twitter.com/1821640621347495936/status/2104996497863352687)

### 4. DeepSeek V4.1 Flash model support

- Factory, 2026-10-17, @droid (X): “hi @droid, i noticed deepseek has released v4.1 flash 1017, but it looks like droid may still be using an older build. would it be possible to update it when you get a chance? thanks!” [source](https://twitter.com/1845149059436449792/status/2111522522600812892)
- Factory, 2026-09-22, @FactoryAI (X): “@tereza_tizkova @factoryai @droid i have been trying to ask you about deepseek 4.1 flash being offered for weeks” [source](https://twitter.com/1258455699073441793/status/2102454686070571282)
- Factory, 2026-09-16, @droid (X): “@droid when are you guys planning to introduce deepsek v4.1 flash?” [source](https://twitter.com/1732405334487052288/status/2100221149082698170)

### 5. Higher overall usage limits

- Factory, 2026-10-15, @droid (X): “@droid but can we have more usage? the usage is not really good.although i'm at the20plan, my friend at the200plan faces the same issue too. 🥹🥹🥹🥹” [source](https://twitter.com/1518742213936570368/status/2110867042983395654)
- Factory, 2026-10-14, @FactoryAI (X): “@factoryai but the usage time limit for the cloud computer is really too little, 80 hours a month, and when i use half of it, the work stops and migration is particularly troublesome 😭” [source](https://twitter.com/2055515632146472960/status/2110184322175234471)
- Factory, 2026-10-09, @droid (X): “i have said many times, @droid limits are terrible and that's the truth. 🤷♂️ [link]” [source](https://twitter.com/160801814/status/2108612186436423854)

### 6. Free trial of paid plans

- Factory, 2026-10-16, @droid (X): “@droid heyo @droid was interested in testing it out with the 2d mmo i’m building, can you dm or smth?” [source](https://twitter.com/1435507055109066752/status/2111244511590719855)
- Factory, 2026-10-06, @FactoryAI (X): “@karanc_12 @droid @factoryai can i get droid voucher to try it.” [source](https://twitter.com/2084491395868532736/status/2107323627679146371)
- Factory, 2026-10-03, @FactoryAI (X): “@factoryai are we able to have a free voucher to try out droid” [source](https://twitter.com/2078904340094324737/status/2106527203223601559)

### 7. Honor promised credits and coupons

- Factory, 2026-10-13, @FactoryAI (X): “@djuang1 @factoryai @glean maybe ship a signal where it is automatically gets activated if it was promised in the meeting regarding private preview almost 2 weeks ago? @matansf [link]” [source](https://twitter.com/89731239/status/2109907281869713531)
- Factory, 2026-10-09, @FactoryAI (X): “@droid @factoryai scam company, i still haven't received your coupon to this day, so the $200 coupon promotion is just a fake marketing gimmick. who would dare use their ai products with such a scammer?” [source](https://twitter.com/1159835302275346433/status/2108698524217155637)
- Factory, 2026-10-09, @FactoryAI (X): “hi @factoryai @tereza_tizkova , i still haven't received any response on email about the promotional max voucher i applied for. i've been using factory with the pro plan for a few months now and would really like to try out max. thank you in advance!” [source](https://twitter.com/2095734015697285127/status/2108629254678200466)

### 8. Linux desktop app and Linux support

- Factory, 2026-10-02, @FactoryAI (X): “insane difference between opus 5.5 and sol 6.1 - both in speed and results. what's the best way to switch from chatgpt desktop to claude. i like the side chat interface and native browser so sticking to desktop app. also when will @factoryai release its linux app??” [source](https://twitter.com/1990461939466842113/status/2105835802131608028)
- Factory, 2026-10-01, @FactoryAI (X): “@droid @factoryai 1) as much byok and byos support as possible, in particular for codex, opencode and devin. 2) linux ubuntu desktop app. 3) paradigm where i talk to 1 agent that then dispatches work to other agents.” [source](https://twitter.com/392698133/status/2105541864699134435)
- Factory, 2026-09-28, @FactoryAI (X): “its been like a century since you released the desktop app and still no linux support? @factoryai this is so gay.” [source](https://twitter.com/1283352684448419842/status/2104421896078995783)

### 9. Muse / Meta model support

- Factory, 2026-09-21, @FactoryAI (X): “@factoryai thanks but can we have muse as well please? and qwen flash series?” [source](https://twitter.com/70830663/status/2102177611451716065)
- Factory, 2026-09-05, @FactoryAI (X): “@factoryai great job on model integration; any chance you will add muse spark 1.3 in the near future ?” [source](https://twitter.com/1612797507007877121/status/2096227746292842859)
- Factory, 2026-09-20, @droid (X): “i can use for example muse 1.3 spark free in open code to test out what open code harness can do - so if lets's say factory does a better job i'd like to test it out but there's no muse 1.3 spark free in droid so i'd likely stay on code or deep seek flash 4.1. how do i get hooked ?” [source](https://twitter.com/3781517712/status/2101601490615861536)

### 10. Configurable font family and size

- Factory, 2026-09-30, @FactoryAI (X): “@droid @factoryai customizing fonts (particularly font sizes and dyslexic font option) and contrast would be nice. some theming for colors as an option would be great. projects being able to exist without an open issue in sidebar would feel nice.” [source](https://twitter.com/1923709631265959936/status/2105435728201048288)
- Factory, 2026-09-08, @FactoryAI (X): “@droid @factoryai - management of /droids in factory app - change ui font family - "full screen" mode to view files - side bar is too limited size.. - pin *todos* to sidebar - sometimes when todo list is too long it blocked more than half the screen lol” [source](https://twitter.com/1257471091833884674/status/2097327955982811369)
- Factory, 2026-09-08, @FactoryAI (X): “@droid @factoryai adjust the ui and the font and size of the conversation, it's too small, it hurts my eyes.” [source](https://twitter.com/1912449457595248646/status/2097327812646748273)

### 11. Control local desktop sessions from mobile app

- Factory, 2026-10-06, @FactoryAI (X): “@prathamdby @factoryai @droid fr droid need a mobile app i need to use droid computer from my phone” [source](https://twitter.com/947588323/status/2107371155766366656)
- Factory, 2026-10-05, @FactoryAI (X): “@tereza_tizkova @factoryai i mostly work with droid cli and it was a pleasent experience. i would rank it in s tier if it has native mobile app and remote control support” [source](https://twitter.com/2071659097129463808/status/2107010143384940905)
- Factory, 2026-09-26, @droid (X): “@droid is there to tell which model auto model is using for a given task? also, mobile remote app please!” [source](https://twitter.com/2023937351815467008/status/2103962781032534497)

### 12. Remove the 5-hour usage window

- Factory, 2026-09-25, @FactoryAI (X): “i dont get it, why isn't @factoryai removing the 5h limit? it s an api wrapper harness.” [source](https://twitter.com/1834314883510226944/status/2103441639041540512)
- Factory, 2026-09-21, @FactoryAI (X): “@droid @melvindvivas @factoryai so are you going to cancel the 5 hour limit?” [source](https://twitter.com/714294369331707904/status/2101910616378409377)
- Factory, 2026-09-08, @FactoryAI (X): “@droid @factoryai usage reset! or you can just remove the 5h window” [source](https://twitter.com/1090325687448281093/status/2097416099201474962)

## Ranks highest on

Automatic model routing and fallback (2nd of 8), Can do the user's kind of task (3rd of 13), Long unattended runs and goal/loop mode (3rd of 8)

## Ranks lowest on

No criterion where it sits clearly in the bottom half.

Position on a criterion: its place among the agents with at least 30 rated user-weeks there, ordered by customer love. It ranks high when both its position and its 95% interval put it in the top half, low when both put it in the bottom half; neither otherwise, or when fewer than 4 agents qualify.

## All 63 criteria

Criterion love: 0.5 is the category norm. n: rated user-weeks.

### Paying and limits: 5th of 13 (customer love 0.581, n 177)

Users say their plans go a long way, helped by a separate pool for open models and discounts on new ones. Complaints still outnumber praise. Users split almost evenly on whether the plan is worth the price. More users complain about how long the quota lasts than praise it.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [How much use a plan's price buys](https://feedbackbench.com/coding-agents/criteria/limits.plan_value.md) | 5th of 12 | 0.532 | 0.504–0.561 | 105 | 55 | 50 |
| [Single prompt, model or effort level consumes disproportionate quota](https://feedbackbench.com/coding-agents/criteria/limits.burn_rate.md) | 3rd of 12 | 0.552 | 0.518–0.585 | 41 | 16 | 25 |
| [Short rolling usage window blocks or interrupts work](https://feedbackbench.com/coding-agents/criteria/limits.window_interrupts_work.md) | Too few posts | 0.493 | 0.479–0.512 | 18 | 1 | 17 |
| [Using an existing subscription across tools](https://feedbackbench.com/coding-agents/criteria/billing.subscription_portability.md) | Too few posts | 0.494 | 0.483–0.506 | 15 | 4 | 11 |
| [Free tier and free model availability and limits](https://feedbackbench.com/coding-agents/criteria/billing.free_tier.md) | Too few posts | 0.500 | 0.488–0.511 | 10 | 6 | 4 |
| [Usage meter visibility and accuracy](https://feedbackbench.com/coding-agents/criteria/limits.usage_meter.md) | Too few posts | 0.494 | 0.489–0.498 | 8 | 0 | 8 |
| [Quota reset timing and bonus or banked resets](https://feedbackbench.com/coding-agents/criteria/limits.reset_schedule.md) | Too few posts | 0.500 | 0.491–0.514 | 7 | 1 | 6 |
| [Pricing and plan terms stated clearly and consistently](https://feedbackbench.com/coding-agents/criteria/billing.pricing_clarity.md) | Too few posts | 0.513 | 0.492–0.553 | 7 | 1 | 6 |
| [Pay-as-you-go overage, fallback billing and spend caps](https://feedbackbench.com/coding-agents/criteria/billing.overage_charges.md) | Too few posts | 0.496 | 0.491–0.499 | 4 | 0 | 4 |
| [Price, allowance or plan terms changed](https://feedbackbench.com/coding-agents/criteria/limits.allowance_change.md) | Too few posts | 0.524 | 0.497–0.574 | 3 | 1 | 2 |
| [Prompt cache hits, misses and invalidation](https://feedbackbench.com/coding-agents/criteria/limits.prompt_cache.md) | Too few posts | 0.506 | 0.500–0.515 | 2 | 2 | 0 |

Most recent posts:

- Praise, 2026-10-17, @FactoryAI (X): “@soareso @factoryai yeah me too they are really solid and the best thing is the droid core pool feels unlimited” [source](https://twitter.com/1466416677713854477/status/2111508276852502789)
- Praise, 2026-10-17, @droid (X): “gemini 4 argon is in @droid at 0.8x, half off, the same rate as sonnet 5.5. i'm putting it on validator duty in my missions: a checker from a different model family than the worker doesn't share its blind spots. cheapest way i know to test a frontier model on real code. [link]” [source](https://twitter.com/2097323326993465344/status/2111359903872991261)
- Praise, 2026-10-16, @FactoryAI (X): “gemini 4 argo on half price of opus 5.5 its gold! @droid @factoryai [link]” [source](https://twitter.com/144564973/status/2111227174610964730)
- Complaint, 2026-10-18, @FactoryAI (X): “@ain3sh @itscynnamoroll @factoryai yeah its the same thing why do you guys think 80 hrs of compute/month is all a person needs? now i have to use all of my remaining usage locally or is there something wrong that im doing? im using environments [link]” [source](https://twitter.com/1579709674135621637/status/2111816779018404204)
- Complaint, 2026-10-16, @FactoryAI (X): “so disappointed with @factoryai this is the $200 plan remember, having just 80 hours of cloud agents limit. and they want to compete with devin 🙄 [link]” [source](https://twitter.com/1579709674135621637/status/2111157280016339426)
- Complaint, 2026-10-15, @droid (X): “@droid but can we have more usage? the usage is not really good.although i'm at the20plan, my friend at the200plan faces the same issue too. 🥹🥹🥹🥹” [source](https://twitter.com/1518742213936570368/status/2110867042983395654)

### Setting up and connecting: 4th of 12 (customer love 0.514, n 68)

Users are split on getting started, and complaints run slightly ahead of praise. Customer love here cannot be told apart from the category norm. No setup criterion has enough ratings to show on its own.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Connecting own API keys, local models and custom endpoints](https://feedbackbench.com/coding-agents/criteria/setup.provider_byok_local.md) | Too few posts | 0.505 | 0.487–0.522 | 26 | 15 | 11 |
| [Onboarding, discoverability and documentation](https://feedbackbench.com/coding-agents/criteria/setup.onboarding_docs.md) | Too few posts | 0.529 | 0.505–0.556 | 17 | 9 | 8 |
| [MCP servers, plugins, skills and hooks](https://feedbackbench.com/coding-agents/criteria/setup.extensions_mcp.md) | Too few posts | 0.487 | 0.473–0.499 | 14 | 3 | 11 |
| [Install, launch and sign-in](https://feedbackbench.com/coding-agents/criteria/setup.install_signin.md) | Too few posts | 0.496 | 0.485–0.513 | 11 | 1 | 10 |
| [IDE and editor integration](https://feedbackbench.com/coding-agents/criteria/setup.ide_integration.md) | Too few posts | 0.506 | 0.498–0.515 | 7 | 5 | 2 |

Most recent posts:

- Praise, 2026-09-29, @droid (X): “@sqs @beyang you can't use a claude code or muse code subscription in amp. this is a stark contrast to you can't use a claude code or muse code subscription in amp locally. this is a stark contrast to @droid that readily accepts localhost as base url for custom model.” [source](https://twitter.com/260499727/status/2104728192091365611)
- Praise, 2026-09-27, @droid (X): “so yeah, you can use custom models in @droid cli, which is great currently trying this setup, is performing great so far ! [link] [link]” [source](https://twitter.com/2028221376092581888/status/2104173498101117143)
- Praise, 2026-09-24, @droid (X): “@tereza_tizkova @droid @tastelabs it’s really nice - i’ve enjoyed learning how to setup and work with the design system. i dove right in with the trial - it will take you a long way towards understanding the platform so far, sooo good!” [source](https://twitter.com/1681456803832561664/status/2103159986998456329)
- Complaint, 2026-10-14, @FactoryAI (X): “@factoryai not a huge deal but i have to remove and readd the github integration in order to get newly created repos to the environment interface.” [source](https://twitter.com/1923709631265959936/status/2110519748601504165)
- Complaint, 2026-10-10, @droid (X): “@droid dart, @bearnotesapp and @ticktickteam these mcps are works then all of a sudden, looks like cli doesn’t know about these mcps and how to use them. always having this same pattern” [source](https://twitter.com/2995471962/status/2108777495386566673)
- Complaint, 2026-10-08, @droid (X): “factory @droid is currently not usable in t3 code @tereza_tizkova as no configoptions are returned like the acp specs require: [link]” [source](https://twitter.com/392698133/status/2108074580963418504)

### Choosing models: 3rd of 12 (customer love 0.613, n 80)

A strength. Users like having models from many labs in one plan. Access to the models they want comes up 2.08 times as often as for other agents. Auto mode, which picks the model, ranks 2nd of 8.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Which models are offered on a plan and when](https://feedbackbench.com/coding-agents/criteria/models.catalog_access.md) | 3rd of 11 | 0.589 | 0.556–0.619 | 46 | 33 | 13 |
| [Automatic model routing and fallback](https://feedbackbench.com/coding-agents/criteria/models.routing_auto.md) | 2nd of 8 | 0.552 | 0.530–0.576 | 30 | 21 | 9 |
| [Quality got worse or better over time](https://feedbackbench.com/coding-agents/criteria/models.quality_drift.md) | Too few posts | 0.512 | 0.497–0.528 | 11 | 5 | 6 |
| [Reasoning effort setting and its defaults](https://feedbackbench.com/coding-agents/criteria/models.effort_control.md) | Too few posts | 0.501 | 0.497–0.507 | 2 | 1 | 1 |

Most recent posts:

- Praise, 2026-10-18, @FactoryAI (X): “@antceowt this is droid from @factoryai , they gifted me $200 max plan. it's really great with opus 5.5.” [source](https://twitter.com/982678035320094720/status/2111893819319058716)
- Praise, 2026-10-18, @droid (X): “@nicolasmelo @willdobrev this cost only $10 with this model, and i didn't notice any loss of quality compared to claude!!! and it wasn't even this 1017 that everyone is talking about i only advise using it through @droid and not opencode [link]” [source](https://twitter.com/1247652022754689024/status/2111695907330671074)
- Praise, 2026-10-13, @FactoryAI (X): “@chris_petkas @factoryai @matansf they got mistral in plenty early and that's been the biggest ai thing for me in a hot minute. finding issues to fix is the hard part.” [source](https://twitter.com/1923709631265959936/status/2110012163536630108)
- Complaint, 2026-10-01, @droid (X): “@fellipesoares @droid opus 5.5, though heads up: they downgrade you to kimi k3 once you hit the limit. also, on the droid cli, you have to toggle off that setting if you don't want it added as a co-author.” [source](https://twitter.com/1783744572977455104/status/2105742742790025518)
- Complaint, 2026-09-26, @FactoryAI (X): “hey @factoryai, i think custom models are broken in the app right now. i’m unable to see or select any of my custom models from the model picker. they just don’t show up at all, so i can’t use them. not sure if this is a recent regression, but would appreciate a fix. @ross_cefalu” [source](https://twitter.com/1625280993966923777/status/2103738831778529329)
- Complaint, 2026-09-22, @FactoryAI (X): “@tereza_tizkova @factoryai @droid i have been trying to ask you about deepseek 4.1 flash being offered for weeks” [source](https://twitter.com/1258455699073441793/status/2102454686070571282)

### Instructing and context: Too few posts (customer love 0.514, n 24)

Users rarely rate how well it follows instructions or uses context: 4.8% of what they rate, against 10.0% for other agents. There are too few posts to rank it. Customer love cannot be told apart from the norm.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Images, PDFs and file attachments as input](https://feedbackbench.com/coding-agents/criteria/context.attachments.md) | Too few posts | 0.501 | 0.493–0.512 | 7 | 2 | 5 |
| [Direct in-prompt instructions and caps are followed](https://feedbackbench.com/coding-agents/criteria/context.instruction_following.md) | Too few posts | 0.505 | 0.496–0.516 | 5 | 3 | 2 |
| [Context compaction keeps what matters, cheaply and quickly](https://feedbackbench.com/coding-agents/criteria/context.compaction.md) | Too few posts | 0.506 | 0.500–0.515 | 3 | 3 | 0 |
| [Finding the right files in the codebase](https://feedbackbench.com/coding-agents/criteria/context.codebase_retrieval.md) | Too few posts | 0.505 | 0.500–0.512 | 3 | 3 | 0 |
| [Asks the user versus guessing](https://feedbackbench.com/coding-agents/criteria/context.clarifying_questions.md) | Too few posts | 0.504 | 0.500–0.512 | 2 | 2 | 0 |
| [Output degrades as the context window fills](https://feedbackbench.com/coding-agents/criteria/context.long_context_decay.md) | Too few posts | 0.498 | 0.494–0.500 | 2 | 0 | 2 |
| [Memory and state carried across sessions](https://feedbackbench.com/coding-agents/criteria/context.session_memory.md) | Too few posts | 0.496 | 0.490–0.500 | 2 | 0 | 2 |
| [Persistent project rules files are read and obeyed](https://feedbackbench.com/coding-agents/criteria/context.instruction_files.md) | Too few posts | 0.500 | 0.500–0.500 | 0 | 0 | 0 |

Most recent posts:

- Praise, 2026-10-09, @droid (X): “@wholyv smart auto compact is one of the reason why @droid is the best coding agent.” [source](https://twitter.com/1811332417099055105/status/2108524032710607206)
- Praise, 2026-09-27, @droid (X): “first time using anthropic models (opus 5.5). i use @droid. i gave it a task to design a landing page for my current project, and it asked questions i have never seen from an agent before. i hope the result comes out good, but so far, it's really impressive and i might not use openai models, unless they actually have a god response. also can only recommend the factory app. it's genuinely brilliant…” [source](https://twitter.com/1821640621347495936/status/2104230757883388046)
- Praise, 2026-09-07, @FactoryAI (X): “with other harnesses, i had to watch them closely because you never knew where they might veer off. with droid, there was no need for that, and i could barely notice any difference even across different frontier models. everyone i recommended it to and who tried it was amazed, like "is this the power of a harness?"” [source](https://twitter.com/1620561425600221184/status/2097105067631681580)
- Complaint, 2026-09-29, @droid (X): “@adityavg13 @droid a conversation can hold three days of context without crashing? after running for two days, it just becomes incredibly dumb.” [source](https://twitter.com/1212651734209724416/status/2105044576574779876)

### Doing the work: 3rd of 14 (customer love 0.616, n 165)

Its strongest area by customer love. Users describe missions that run for hours unattended and finish the job. Running long unattended makes up 8.0% of what users rate, against 1.2% for other agents. On whether it can do users' kind of task, praise far outweighs complaints.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Can do the user's kind of task](https://feedbackbench.com/coding-agents/criteria/work.capability.md) | 3rd of 13 | 0.574 | 0.552–0.597 | 95 | 86 | 9 |
| [Long unattended runs and goal/loop mode](https://feedbackbench.com/coding-agents/criteria/work.long_running_autonomy.md) | 3rd of 8 | 0.535 | 0.516–0.552 | 40 | 37 | 3 |
| [Subagents, parallel agents and orchestrators](https://feedbackbench.com/coding-agents/criteria/work.multi_agent_orchestration.md) | 3rd of 10 | 0.513 | 0.495–0.533 | 34 | 25 | 9 |
| [Diagnosing and fixing reported bugs](https://feedbackbench.com/coding-agents/criteria/work.bug_diagnosis.md) | Too few posts | 0.510 | 0.502–0.520 | 6 | 6 | 0 |
| [Spins, loops or gets stuck without progress](https://feedbackbench.com/coding-agents/criteria/work.stuck_loops.md) | Too few posts | 0.495 | 0.490–0.499 | 6 | 0 | 6 |
| [Tool approval prompts and autonomy modes](https://feedbackbench.com/coding-agents/criteria/work.permission_prompts.md) | Too few posts | 0.507 | 0.497–0.521 | 6 | 3 | 3 |
| [Plan-before-edit mode](https://feedbackbench.com/coding-agents/criteria/work.plan_mode.md) | Too few posts | 0.509 | 0.502–0.517 | 6 | 6 | 0 |
| [Frontend and visual UI output](https://feedbackbench.com/coding-agents/criteria/work.frontend_ui.md) | Too few posts | 0.498 | 0.491–0.504 | 5 | 2 | 3 |
| [Does unrequested work or over-engineers](https://feedbackbench.com/coding-agents/criteria/work.scope_overreach.md) | Too few posts | 0.495 | 0.490–0.499 | 5 | 0 | 5 |
| [Risky or irreversible actions without confirmation](https://feedbackbench.com/coding-agents/criteria/work.destructive_actions.md) | Too few posts | 0.513 | 0.499–0.528 | 4 | 3 | 1 |
| [Computer use and browser control](https://feedbackbench.com/coding-agents/criteria/work.computer_browser_use.md) | Too few posts | 0.502 | 0.496–0.510 | 3 | 2 | 1 |
| [Git commits, branches and sync](https://feedbackbench.com/coding-agents/criteria/work.git_workflow.md) | Too few posts | 0.506 | 0.500–0.514 | 2 | 2 | 0 |
| [Breaks existing code or reintroduces bugs](https://feedbackbench.com/coding-agents/criteria/work.regressions_introduced.md) | Too few posts | 0.499 | 0.496–0.500 | 1 | 0 | 1 |
| [Stops mid-task or answers instead of acting](https://feedbackbench.com/coding-agents/criteria/work.premature_stop.md) | Too few posts | 0.500 | 0.500–0.500 | 0 | 0 | 0 |
| [Games checks instead of fixing the problem](https://feedbackbench.com/coding-agents/criteria/work.reward_hacking.md) | Too few posts | 0.500 | 0.500–0.500 | 0 | 0 | 0 |
| [Safety filters block legitimate coding tasks](https://feedbackbench.com/coding-agents/criteria/work.safety_refusals.md) | Too few posts | 0.500 | 0.500–0.500 | 0 | 0 | 0 |
| [Length and clarity of replies, summaries and comments](https://feedbackbench.com/coding-agents/criteria/work.response_verbosity.md) | Too few posts | 0.500 | 0.500–0.500 | 0 | 0 | 0 |
| [Caves to or argues with the user's judgement](https://feedbackbench.com/coding-agents/criteria/work.sycophancy_pushback.md) | Too few posts | 0.500 | 0.500–0.500 | 0 | 0 | 0 |

Most recent posts:

- Praise, 2026-10-18, @droid (X): “@droid has already managed to reduce p90 by over 50% in a single pass, and it's still going! i'm not stopping until i'm confident that we're at the limits of the servers themselves. git can and will scale far beyond what github could ever imagine. [link] [link]” [source](https://twitter.com/2070908287978246144/status/2111933547984588823)
- Praise, 2026-10-15, @droid (X): “btw it's oneshot on @droid :) hyperframes + a reference video [link]” [source](https://twitter.com/1812492025683664896/status/2110777990422667576)
- Praise, 2026-10-14, @FactoryAI (X): “@itscynnamoroll @factoryai @namespacetab i have to agree. during the 15 days i’ve been testing it, it hardly ever got the route wrong, regardless of the mode used. it feels like i’ve been using it my whole life.” [source](https://twitter.com/23220904/status/2110254815200620891)
- Complaint, 2026-10-15, @FactoryAI (X): “@oliverzhang29 @factoryai argon is running for 5 hours straight and when i asked why it said it's searching for all the outdoors in [city] lmao” [source](https://twitter.com/2102780896692621312/status/2110536505458348089)
- Complaint, 2026-10-14, @droid (X): “@droid sometime when failed to start a subagent, it will hang all process and keep counting up. [link]” [source](https://twitter.com/2104010083500011520/status/2110398603110031378)
- Complaint, 2026-10-05, @droid (X): “@itscynnamoroll @droid although had to keep pausing it inbetween sometimes” [source](https://twitter.com/1333161864/status/2106992749736333619)

### Checking and finishing: Too few posts (customer love 0.508, n 10)

Users seldom discuss how it checks its own work, and there are too few posts to rank it. The few posts that do lean positive. Customer love cannot be told apart from the category norm.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Agent-performed code review finds real issues](https://feedbackbench.com/coding-agents/criteria/verify.agent_code_review.md) | Too few posts | 0.499 | 0.485–0.509 | 5 | 4 | 1 |
| [Claims work is done or fixed when it is not](https://feedbackbench.com/coding-agents/criteria/verify.false_completion.md) | Too few posts | 0.523 | 0.497–0.580 | 2 | 1 | 1 |
| [Builds, tests or runs its own changes](https://feedbackbench.com/coding-agents/criteria/verify.self_testing.md) | Too few posts | 0.504 | 0.500–0.511 | 2 | 2 | 0 |
| [Reviewing and approving the agent's changes](https://feedbackbench.com/coding-agents/criteria/verify.change_review_ui.md) | Too few posts | 0.499 | 0.497–0.500 | 1 | 0 | 1 |

Most recent posts:

- Praise, 2026-10-14, @FactoryAI (X): “today, i implemented @factoryai droid review to run after every submitted pr, using gpt-6 luna max. it found 4 issues (i used opus 5.5 for the spec and glm 5.3 flash as the worker). it is definitely worth conducting reviews using different code models. if the validation is performed by the person who wrote the code, you are unlikely to encounter any points of disagreement.” [source](https://twitter.com/23220904/status/2110363877317701855)
- Praise, 2026-10-13, @droid (X): “a real bug: clockedin's tests passed. its attendance tab crashed. @droid reproduced it on the iphone simulator with @swmansion's argent, fixed it, got overruled by lint, fixed it again, and checked the phone. run 3 of 3 · #closetheloop [link]” [source](https://twitter.com/947588323/status/2109992549452751114)
- Praise, 2026-10-11, @droid (X): “tap the heart in pocket-no. favorites stays empty. @droid reproduced it on the iphone simulator with @swmansion's argent, fixed it, caught that its first check proved nothing, and verified a fresh add. run 1 of 3 · #closetheloop [link]” [source](https://twitter.com/947588323/status/2109267781371760969)
- Complaint, 2026-10-01, @FactoryAI (X): “@philipnora7 @factoryai mission mode helps until the model optimizes for the checkbox instead of the diff. we hit that when cli agents "finished" with a summary and skipped the failing test” [source](https://twitter.com/1847773141231423489/status/2105469362174095644)

### Interface and sessions: 8th of 14 (customer love 0.511, n 68)

Users complain about the display and settings more than they praise them, 23 user-weeks to 15. Customer love for the interface cannot be told apart from the category norm.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [How the interface shows work, and what the user can configure](https://feedbackbench.com/coding-agents/criteria/ui.display_settings.md) | 4th of 12 | 0.515 | 0.492–0.540 | 38 | 15 | 23 |
| [Mobile, remote-control and voice access](https://feedbackbench.com/coding-agents/criteria/surfaces.remote_mobile.md) | Too few posts | 0.483 | 0.465–0.502 | 20 | 6 | 14 |
| [Cloud and remote sandbox execution](https://feedbackbench.com/coding-agents/criteria/surfaces.cloud_sessions.md) | Too few posts | 0.508 | 0.494–0.523 | 17 | 11 | 6 |
| [Saving, switching, resuming and rewinding sessions](https://feedbackbench.com/coding-agents/criteria/ui.session_history.md) | Too few posts | 0.498 | 0.490–0.509 | 6 | 1 | 5 |
| [Stopping and steering a running agent](https://feedbackbench.com/coding-agents/criteria/ui.interrupt_steer.md) | Too few posts | 0.501 | 0.500–0.504 | 1 | 1 | 0 |

Most recent posts:

- Praise, 2026-10-14, @droid (X): “@thecoderbtw agree. and sometimes you need a data viz. for coding, i think @droid nailed the ui. way underrated harness.” [source](https://twitter.com/1531318899630809089/status/2110371858415517927)
- Praise, 2026-10-12, @FactoryAI (X): “i've been moving more of my dev environment to cloud agents, especially for long-running @droid missions and loving the flexibility. though reproducibility has been a pain @factoryai 's new environment blueprints tackle exactly that. time to get droiding! [link]” [source](https://twitter.com/2101299643485196288/status/2109745495245496629)
- Praise, 2026-10-09, @FactoryAI (X): “@adityawaslost @droid @factoryai fr i'm addicted with driod mission mode, late night opus with my phone 🧑🏻🍳” [source](https://twitter.com/1812492025683664896/status/2108433332166082784)
- Complaint, 2026-10-15, @droid (X): “i know it probably isn't a top priority but i hope @droid can improve the web interface on mobile. on my pixel 10 pro it's kind of a mess with elements overflowing, some fields not being clickable, and generally feeling laggy. [link]” [source](https://twitter.com/2070908287978246144/status/2110827604936933791)
- Complaint, 2026-10-04, @FactoryAI (X): “@thecoderbtw @droid @factoryai yeh i agree with you on the con, bad ux for me as well. also have tried the browser if you switch thread it closes.” [source](https://twitter.com/1261173216455712768/status/2106828931337007512)
- Complaint, 2026-09-30, @FactoryAI (X): “@droid @factoryai the archive session tooltip covering up new session button would be nice. the new session button just shows the project and to the side. trivial behavior but bugs me.” [source](https://twitter.com/1923709631265959936/status/2105436180347322687)

### Reliability and speed: 5th of 13 (customer love 0.531, n 50)

Users bring up reliability less often than they do for other agents. When they do, complaints lead 36 to 14 in user-weeks. Customer love cannot be told apart from the category norm.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Latency, throughput and fast mode](https://feedbackbench.com/coding-agents/criteria/rel.response_speed.md) | Too few posts | 0.517 | 0.494–0.541 | 27 | 12 | 15 |
| [Client crashes, freezes and failed tool execution](https://feedbackbench.com/coding-agents/criteria/rel.client_failures.md) | Too few posts | 0.489 | 0.482–0.495 | 13 | 0 | 13 |
| [Outages, server errors and capacity or rate errors](https://feedbackbench.com/coding-agents/criteria/rel.service_errors.md) | Too few posts | 0.509 | 0.487–0.548 | 9 | 1 | 8 |
| [Updates break working setups](https://feedbackbench.com/coding-agents/criteria/rel.update_breakage.md) | Too few posts | 0.507 | 0.493–0.529 | 4 | 1 | 3 |

Most recent posts:

- Praise, 2026-09-27, @FactoryAI (X): “the speed of deepseek v4.1 flash in @droid is mind blowing. makes me rethink the ollama subscription - when @factoryai has it all. [link]” [source](https://twitter.com/1590702228234391552/status/2104263092364615842)
- Praise, 2026-09-27, @droid (X): “the speed of deepseek v4.1 flash in @droid is mind blowing. makes me rethink the ollama subscription - when @factory has it all. [link]” [source](https://twitter.com/1590702228234391552/status/2104258455695741401)
- Praise, 2026-09-11, @droid (X): “.@trycua + @droid + deepseek v4.1 peak performance + super fast [link]” [source](https://twitter.com/1430859177576976392/status/2098408456260874660)
- Complaint, 2026-10-18, @FactoryAI (X): “@factoryai anything possible to do with argon always at capacity? it's working for 20m then stop with error” [source](https://twitter.com/299279185/status/2111848678495277564)
- Complaint, 2026-10-18, @FactoryAI (X): “@factoryai is anything possible to do with argon always at capacity? it's working for 20m then stop with error” [source](https://twitter.com/299279185/status/2111848842157003079)
- Complaint, 2026-10-15, @droid (X): “hey @droid i keep running into this in my threads: 403 {"detail":"forbidden","status":403,"title":"forbidden","requestid":"pdx[IP address]ws-[number][card number][number]e4f98"}” [source](https://twitter.com/1842676170720231425/status/2110559701444280589)

### Account and support: 6th of 11 (customer love 0.513, n 45)

Complaints outnumber praise by the widest margin of any area. Support comes up 1.91 times as often as for other agents. Complaints about getting help outnumber praise 31 to 6.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Support, refunds and issue handling](https://feedbackbench.com/coding-agents/criteria/account.support.md) | 4th of 8 | 0.507 | 0.478–0.537 | 37 | 6 | 31 |
| [Wrong charges, failed payments and plan provisioning](https://feedbackbench.com/coding-agents/criteria/account.billing_errors.md) | Too few posts | 0.494 | 0.488–0.498 | 9 | 0 | 9 |
| [Data retention, training use and deployment isolation](https://feedbackbench.com/coding-agents/criteria/account.data_privacy.md) | Too few posts | 0.501 | 0.497–0.507 | 2 | 1 | 1 |
| [Account bans and access restrictions](https://feedbackbench.com/coding-agents/criteria/account.bans_restrictions.md) | Too few posts | 0.499 | 0.497–0.500 | 1 | 0 | 1 |

Most recent posts:

- Praise, 2026-10-04, @FactoryAI (X): “@devinofrivia @droid @factoryai droid is so awesome man. they have a very responsive team who listens to user feedback and they're moving quickly” [source](https://twitter.com/1921198173110104066/status/2106769297888641084)
- Praise, 2026-10-03, @FactoryAI (X): “@matansf @factoryai as a proud factory customer, can confirm. honestly pretty much never had a company spend more time with me and my team, and with real experts, not salespeople.” [source](https://twitter.com/19016936/status/2106468908257755169)
- Praise, 2026-09-07, @droid (X): “@da7_tech @droid did u try emailing them? they respond weekdays i had an issue couple weeks ago with billing and they were quite nice on support and fixed it for me” [source](https://twitter.com/70830663/status/2097000057631551922)
- Complaint, 2026-10-14, @FactoryAI (X): “@enoreyes @tonychang430 @herdrdev @orca_build @cognition @tryreplicas @bot @claudeai @conductor_build @factoryai the worst ide to ever exist. they kicked me from their discord after i complained about it. it's really shit.” [source](https://twitter.com/2080539111665147904/status/2110321811091337486)
- Complaint, 2026-10-10, @FactoryAI (X): “@factoryai i've been trying to contact you about the max voucher giveaway, but i haven't got any response yet... i know for sure it's hard to manage this volume of responses, but i've been waiting for over a week now... thx in advance.” [source](https://twitter.com/2095734015697285127/status/2108829446564163915)
- Complaint, 2026-10-10, @FactoryAI (X): “@factoryai i was one of the first to apply to your $200 max plans and i still haven’t received anythingc got an email where someone from support even said they’ll send me one 😭” [source](https://twitter.com/1729247211953827840/status/2108849289497641182)