# Devin (Cognition)

Feedback Bench, coding agents, built 2026-10-19, window 2026-08-31 to 2026-10-18. Web page: https://feedbackbench.com/coding-agents/#/agent/devin

| Measure | Value |
|---|---|
| Rank | 2 of 17 (rank range 2–4) |
| Feedback Score | 64.2 (95% interval 62.4–65.8) |
| Popularity | 0.638 (share of voice 2.85%) |
| Customer love | 0.611 (95% interval 0.595–0.626) |
| Place | Popularity 7th of 17 × Customer love 1st of 17 |
| Top quadrant | yes |
| Users | 4797 |
| Posts counted | 9730 |
| Posts that judge the agent | 2583 |
| Criteria ranking high / low | 12 / 2 of 63 |

## The brief

Written by large language models from this page's numbers and the posts it quotes, then checked: every number in the text is in the build. Interpretation, not measurement.

Users say Devin does real engineering work and gives them a lot of use for the money. The cost is the software around it: posts describe a desktop app and command-line tool that freeze, leak memory and crash. Quality of work is the area its users talk about most after pricing, and Devin ranks 1st of 14 there. Users also rate its plans and free tier above most agents. Crashes pull it down. On running without crashing, complaints outnumber praise 56 to 3. Overall it ranks 2nd of 17 coding agents, and its customer love is the highest in the category.

### Why people choose it

- **Its quality of work leads the category** ([Quality of work](https://feedbackbench.com/coding-agents/criteria/work.md)). 1st: of 14 on “Quality of work”. 34% of what users rate. Posts describe Devin looking into alerts, finding the root cause and opening a tested pull request. Teams say they hand it a growing share of bug fixes and small improvements. Individual users describe building whole apps with it in a short time.
  Evidence:
  - 2026-10-16, @cognition (X): “our eng team put devin on the on-call rotation. it investigates alerts, finds the root cause, and opens a tested pr for review. excited for our friends at @cognition to be officially launching this one! [link]” [source](https://twitter.com/94682674/status/2110916182580809832)
  - 2026-10-15, @cognition (X): “seeing us delegate an increasing proportion of bug fixes and minor improvements to devin. @cognition cooked.” [source](https://twitter.com/1463214210/status/2110753439248449752)
- **Plans give a lot of use for the price** ([Pricing and limits](https://feedbackbench.com/coding-agents/criteria/paying.md)). 3rd: of 13 on “Pricing and limits”. 42% of what users rate. Users describe weekly quotas that are hard to use up, discounts on other models, and a free month of SWE-2 that let them do much more work. Some say their costs will go up now that the free period has ended.
  Evidence:
  - 2026-10-15, @cognition (X): “first day using @devindevelopers from @cognition. the limits seem practically impossible to reach. it's been running nonstop for hours, and the weekly usage quota is only at 23%... i'm using opus 5.5 on xhigh all the time. [link]” [source](https://twitter.com/2096687342748585989/status/2110656059031572595)
  - 2026-10-15, @cognition (X): “it's the last day of free swe-2 max in devin... i have to say that having a model like this available for free is/was amazing. it allowed me to do so much within that month that's insane. thanks @cognition - and thanks to @chris_wozniczek for hooking me up with devin.” [source](https://twitter.com/423774207/status/2110625906528325726)
- **Cloud sessions run heavy work off your machine** ([Cloud sessions work](https://feedbackbench.com/coding-agents/criteria/surfaces.cloud_sessions.md)). 2.5×: 6% of what users rate, 2.5× the rate for other agents. Ranks 2nd of 5 on “Cloud sessions work”. Users run Devin on cloud machines with macOS, Windows or Ubuntu. That lets them build apps for systems they do not own and keeps heavy work off small laptops. Some say the cloud agents test changes for them.
  Evidence:
  - 2026-09-28, @cognition (X): “@cognition one thing i can say for sure! devin's cloud environment is the best available on the market! it's the only one that has macos, windows, and ubuntu! i'm a linux user and thanks to cloud agents i can compile my .dmg connectors for my clients perfectly.” [source](https://twitter.com/1829795481754468352/status/2104612822277611679)
  - 2026-09-28, @cognition (X): “i’ve been struggling to build macos apps on my 8gb m1 macbook. have to close everything else and even then i run out of memory finally started using @cognition devin's cloud mac. i get an m4 pro and 16gb ram! even gives me an attachment for the build! [link]” [source](https://twitter.com/2008296795181359104/status/2104674603029189041)

### Why people leave

- **The desktop app and CLI crash and freeze** ([Runs without crashing](https://feedbackbench.com/coding-agents/criteria/rel.client_failures.md)). 56 : 3: complaints to praise, in user-weeks. Ranks 8th of 11 on “Runs without crashing”. Posts describe the desktop app forcing window reloads, the CLI dying several times a day, lag on every keystroke, memory leaks and heavy disk use. Some users say the problems started after an update or after the switch from Windsurf to Devin.
  Evidence:
  - 2026-10-09, @cognition (X): “@cognition devin cli dies 3-4 times per 24 hours with a rust exception. do you need a core dump, or is this good?” [source](https://twitter.com/2006177515413594113/status/2108624704185512088)
  - 2026-09-23, @cognition (X): “@cognition @devindesktop @devindesktop @cognition devin desktop has forced me to reload my 4 windows six times in 30 minutes with no explanation as to why. every time, i have to restart all of my agents manually. what's going on?” [source](https://twitter.com/928932212/status/2102852071485800466)

### What would move its score

Rule: For each area where an agent's customer love is below the category norm: the Feedback Score and rank it would have if that one area were at the norm (0.5) and everything else stayed the same, computed with the same formula as the ranking. An area's pull follows its weight, so an area many users of the category rate moves the score more than one they rarely mention.

| Area at the category norm | Feedback Score | Change | Position |
|---|---|---|---|
| Setting up and connecting | 64.2 | +0.0 | 2nd of 17 |

Setup is the only area on the lever list. Moving it to the category norm leaves the Feedback Score at 64.2 (+0.0) and Devin 2nd, so no single area moves the score far. The sharpest complaints, about crashes and freezes, fall under Reliability, which already rates within range of the norm.

### Six weeks

Users rose from 459 to 1,938 in the week of 2026-09-07, which includes Cognition's SWE-2 on 2026-09-10. Share of voice rose from 1% to 6% and rank from 5th to 2nd. Users then fell each week to 567, share to 2%, and rank ended 3rd.

## Top requests

What users ask to add or change, most asked first. 753 user-weeks ask for something. Requests do not change the Feedback Score. Rule: A separate pass by a large language model reads every counted post and extracts what the user asks the agent or its vendor to add or change, with the criteria it maps to and a short normalised wording; it does not touch the labels or the Feedback Score. A large language model groups the wordings within each criterion (the first criterion the request maps to) into themes, and a second pass merges themes that ask for the same change under different criteria; a merged theme sits under the criterion most of its requests map to, and code counts it once. A theme counts distinct user-weeks that ask for it, per agent; across agents, one user-week per agent. Themes asked in fewer than 2 user-weeks, and requests that share no theme, are not shown. Examples: up to 3 posts per theme from different users, without slurs: whole posts of 60 to 450 characters with at least 8 words beyond handles and links, posts of at most 280 characters first, then the newest.

| Rank | Request | Criterion | User-weeks | Posts |
|---|---|---|---|---|
| 1 | Mid-priced tier between existing plans | [How much use a plan's price buys](https://feedbackbench.com/coding-agents/criteria/limits.plan_value.md) | 33 | 40 |
| 2 | Higher overall usage limits | [How much use a plan's price buys](https://feedbackbench.com/coding-agents/criteria/limits.plan_value.md) | 21 | 27 |
| 3 | Official mobile app | [Mobile, remote-control and voice access](https://feedbackbench.com/coding-agents/criteria/surfaces.remote_mobile.md) | 21 | 21 |
| 4 | Access or trial of max plan | [How much use a plan's price buys](https://feedbackbench.com/coding-agents/criteria/limits.plan_value.md) | 11 | 11 |
| 5 | Keep free models available permanently | [Free tier and free model availability and limits](https://feedbackbench.com/coding-agents/criteria/billing.free_tier.md) | 11 | 11 |
| 6 | Model choice in fusion mode | [Which models are offered on a plan and when](https://feedbackbench.com/coding-agents/criteria/models.catalog_access.md) | 11 | 11 |
| 7 | Auditable reversible memory changes | [Memory and state carried across sessions](https://feedbackbench.com/coding-agents/criteria/context.session_memory.md) | 10 | 10 |
| 8 | Cost per completed task metrics | [Usage meter visibility and accuracy](https://feedbackbench.com/coding-agents/criteria/limits.usage_meter.md) | 10 | 10 |
| 9 | Free trial of paid plans | [Free tier and free model availability and limits](https://feedbackbench.com/coding-agents/criteria/billing.free_tier.md) | 9 | 10 |
| 10 | Keep free model access unlimited | [Price, allowance or plan terms changed](https://feedbackbench.com/coding-agents/criteria/limits.allowance_change.md) | 9 | 10 |
| 11 | Mobile simulators and Mac VM for testing | [Computer use and browser control](https://feedbackbench.com/coding-agents/criteria/work.computer_browser_use.md) | 9 | 9 |
| 12 | Published exact usage limits per plan | [Pricing and plan terms stated clearly and consistently](https://feedbackbench.com/coding-agents/criteria/billing.pricing_clarity.md) | 8 | 9 |

### 1. Mid-priced tier between existing plans

- Devin, 2026-10-18, @cognition (X): “@scarletkc @yifanxu_ephai @cognition teacher, i want it too!!! save the kids, $20 is too painful! $200 is too expensive!” [source](https://twitter.com/1274899473244684293/status/2111643392585392219)
- Devin, 2026-10-17, @cognition (X): “@scarletkc @cognition i hope to add a plan between pro and max for $60 or $100!” [source](https://twitter.com/2065820231470399488/status/2111411366057988354)
- Devin, 2026-10-17, @cognition (X): “@scarletkc @cognition i only want to subscribe to their service, but i only have a budget of $100 for the main product 😢” [source](https://twitter.com/2104745988888141824/status/2111407848517415220)

### 2. Higher overall usage limits

- Devin, 2026-10-13, @cognition (X): “devin did a good job, it would be even better with more token limits @cognition @devindevelopers [link]” [source](https://twitter.com/2018156578617090049/status/2109846982470868997)
- Devin, 2026-10-07, @cognition (X): “@kalapowered @cognition oh yes, and we need a bazillion token and a monthly subscription in order to call it” [source](https://twitter.com/1460976271173820423/status/2107983516491497476)
- Devin, 2026-10-07, @cognition (X): “@jorybraun @kentcdodds @orchid_hq @cognition building a dining hall app for my college that gives you suggestions on where to go based on what you like. i need more tokens 😬” [source](https://twitter.com/1796338041604456448/status/2107643366737690929)

### 3. Official mobile app

- Devin, 2026-10-16, @cognition (X): “@cognition when available on web app or you announce a mobile app ? 🙄” [source](https://twitter.com/2109717807491424256/status/2110977973721374887)
- Devin, 2026-10-10, @cognition (X): “@mthlish @cognition @devinai @cognition when we expect native ios and android app ?” [source](https://twitter.com/102880167/status/2109010431297945993)
- Devin, 2026-10-06, @DevinAI (X): “i've wanted this for a while, ever since bookmarks feature (initially called "save for later") launched built entirely by voice chatting with @devinai devin is the most complete ai tool right now imo. just needs a mobile app” [source](https://twitter.com/1283544388333907968/status/2107461300901003722)

### 4. Access or trial of max plan

- Devin, 2026-10-15, @cognition (X): “@silasalberti @inferwerk @cognition could i get a devin max? want to give it a try” [source](https://twitter.com/1159835302275346433/status/2110623171829547282)
- Devin, 2026-10-06, @cognition (X): “@jorybraun @kentcdodds @orchid_hq @cognition would love a devin max plan, i use the $20 plan a lot at the moment. devin is awesome! i'm building an easy and powerfull self hosted workflow orchestration platform: [link]” [source](https://twitter.com/392698133/status/2107532419771334848)
- Devin, 2026-10-06, @cognition (X): “@chris_wozniczek @cognition building a free platform to help students get websites & professional digital identities. if possible, i’d love a devin max plan to help build it. thank you!” [source](https://twitter.com/1946086625374621697/status/2107493286743277873)

### 5. Keep free models available permanently

- Devin, 2026-10-17, @DevinAI (X): “@devinai if devin's swe is always free for pro, i will subscribe for ten years in one go.” [source](https://twitter.com/1872962850072961024/status/2111504151385645435)
- Devin, 2026-10-06, r/windsurf (Reddit): “devin without a free model is devin without customers. i know where i'm going if it happens” [source](https://www.reddit.com/r/windsurf/comments/1wytgez/is_swe_20_no_longer_free_after_1016_without_a/pe62hvx/)
- Devin, 2026-09-30, @cognition (X): “@cognition if you can continue to provide swe2 for free, along with this feature, plus your fusion, i won't need codex anymore, really.” [source](https://twitter.com/1429235681797148673/status/2105219487238656482)

### 6. Model choice in fusion mode

- Devin, 2026-10-18, @cognition (X): “@scarletkc @cognition can devin be allowed to add argon in fusion? by the way, let the argon inside be able to directly hear audio instead of relying on python to read waveforms and acoustic indicators.” [source](https://twitter.com/1921089528955273216/status/2111864789723193585)
- Devin, 2026-10-14, @cognition (X): “@cognition can we get the freedom to use whatever models we want with fusion?” [source](https://twitter.com/1610741871105409032/status/2110519362344173917)
- Devin, 2026-10-10, @cognition (X): “update: day 1 with devin max, and fusion mode surprised me. - opus 5.5 (high) as lead - swe 2.0 (medium) for execution hours of quality work, only 15% of my weekly quota used. @cognition, let cloud desktop pick models per fusion setup and this is 100%. what combo are you running?” [source](https://twitter.com/1679170287164698624/status/2109026634968019284)

### 7. Auditable reversible memory changes

- Devin, 2026-10-08, @cognition (X): “@cognition 'remove stale records' is the sentence i'd want a diff for. memory that silently rewrites itself across sessions is how a clean approval turns into a batched one six weeks later. versioned and auditable or it's just vibes with a schema.” [source](https://twitter.com/372889273/status/2108245596717133950)
- Devin, 2026-10-06, @cognition (X): “@cognition can i review and revert the overnight memory changes? an inferred preference needs a way to correct it when devin gets it wrong.” [source](https://twitter.com/1898512810272763904/status/2107567161229377558)
- Devin, 2026-10-06, @cognition (X): “@cognition i'd want the overnight rewrite as a diff. if dreaming commits memory changes straight in, nobody sees why the agent started behaving differently on monday. a reviewable pr for memory would make teams trust it.” [source](https://twitter.com/2040696623764766720/status/2107489519985688794)

### 8. Cost per completed task metrics

- Devin, 2026-10-08, @cognition (X): “@cognition the 66.2 fusion setup deserves a point on the cost chart too, with the opus lead included.” [source](https://twitter.com/2051888695100514304/status/2108084949157109849)
- Devin, 2026-09-30, @cognition (X): “@cognition cost per task at a named effort level is how i'd want every launch priced. in our own evals lower effort beat higher effort on some tasks, on quality as well as cost, so i'm curious what the 60.4% looks like at low.” [source](https://twitter.com/1659439170883026945/status/2105096107282055266)
- Devin, 2026-09-29, @cognition (X): “@cognition cheaper and ranking higher at the same time is the right direction. for long tasks the price per solved task matters way more than the price per token. would love to see that number next to the benchmark.” [source](https://twitter.com/2104260136701194241/status/2104924141195341830)

### 9. Free trial of paid plans

- Devin, 2026-10-17, @cognition (X): “@scarletkc @cognition congratulations, i hope there is a free membership experience 🤩” [source](https://twitter.com/2069615515186974720/status/2111448537749770623)
- Devin, 2026-09-28, @cognition (X): “@cognition could we get access to the mobile app, please? and a free month to fully test it out and provide you with feedback?” [source](https://twitter.com/1827382907188514816/status/2104679645056528671)
- Devin, 2026-09-24, @cognition (X): “i havent got to use devin, i think i wanna switch from grok/cursor if my experience on devin is good @devindesktop @cognition hope you guys can share me at free month devin max so i can test it....” [source](https://twitter.com/932727389523558400/status/2103072106942779813)

### 10. Keep free model access unlimited

- Devin, 2026-10-08, @cognition (X): “@devinai pls tell me you will keep swe2 unlimited @devindevelopers @cognition” [source](https://twitter.com/1825243355501973504/status/2108337230515142889)
- Devin, 2026-10-05, @cognition (X): “@cognition @devindevelopers any chance we can get an extension to the free swe-2 to the end of october ? or atleast just a couple of billions a month or some nice big number, even if it’s like 3/5 hours a day of free use.” [source](https://twitter.com/860967132489801728/status/2106992724507533611)
- Devin, 2026-10-02, @cognition (X): “i feel excited for fable 5.5 coming next week(?), but i am sad that @cognition swe 2 is not free anymore on cloud agents. can we ask for another expansion please?” [source](https://twitter.com/1767985295910383616/status/2105957038832631911)

### 11. Mobile simulators and Mac VM for testing

- Devin, 2026-09-17, @cognition (X): “@ptbthefirst @cognition a dedicated mac vm with ios simulator does close a real gap for mobile automation if it actually works reliably in practice.” [source](https://twitter.com/1963715144392863744/status/2100395669034852542)
- Devin, 2026-09-17, @cognition (X): “@ptbthefirst @cognition mobile dev automation has been stuck without device level testing so this is a meaningful unlock.” [source](https://twitter.com/2067687598571569152/status/2100393725713076709)
- Devin, 2026-09-17, @cognition (X): “@ptbthefirst @cognition giving devin its own mac vm with an ios simulator actually solves a real bottleneck for mobile testing.” [source](https://twitter.com/2058874736470327296/status/2100391330106974685)

### 12. Published exact usage limits per plan

- Devin, 2026-10-17, @cognition (X): “@scarletkc @cognition i also haven't received much usage information about my devin pro and max. i've always wanted to upgrade to the maximum plan, but they haven't mentioned how much more usage it offers compared to the pro $20 plan, which makes me hesitant to upgrade.” [source](https://twitter.com/2110945071172554752/status/2111457261952565504)
- Devin, 2026-09-17, @cognition (X): “@cognition @andrew_locke how much usage of swe2 i will have if i subscribe in max plan? it dont are clear, because theoretically it unlimited? i want more!! kkk [link]” [source](https://twitter.com/1430494132368183297/status/2100588399216214137)
- Devin, 2026-09-16, @cognition (X): “@cognition , i waned to test max account, but unfortunately i have no idea of how much it would endure, which makes too hard to take a decision to risk $200 on it. how can i know about it? miss a bit of clarity on this subject.” [source](https://twitter.com/64041638/status/2100226167705858439)

## Ranks highest on

Can do the user's kind of task (2nd of 13), Automatic model routing and fallback (3rd of 8), Single prompt, model or effort level consumes disproportionate quota (2nd of 12)

## Ranks lowest on

Latency, throughput and fast mode (7th of 10), Client crashes, freezes and failed tool execution (8th of 11)

Position on a criterion: its place among the agents with at least 30 rated user-weeks there, ordered by customer love. It ranks high when both its position and its 95% interval put it in the top half, low when both put it in the bottom half; neither otherwise, or when fewer than 4 agents qualify.

## All 63 criteria

Criterion love: 0.5 is the category norm. n: rated user-weeks.

### Paying and limits: 3rd of 13 (customer love 0.637, n 661)

Users rate the plans as worth the price, and the free tier ranks 1st of 7. The weak spots are unclear pricing, the usage meter, changing plan terms and cutoffs mid-task, which draw far more complaints than praise. Across the area, complaints outnumber praise.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [How much use a plan's price buys](https://feedbackbench.com/coding-agents/criteria/limits.plan_value.md) | 2nd of 12 | 0.556 | 0.529–0.584 | 318 | 164 | 154 |
| [Free tier and free model availability and limits](https://feedbackbench.com/coding-agents/criteria/billing.free_tier.md) | 1st of 7 | 0.548 | 0.520–0.577 | 156 | 113 | 43 |
| [Single prompt, model or effort level consumes disproportionate quota](https://feedbackbench.com/coding-agents/criteria/limits.burn_rate.md) | 2nd of 12 | 0.570 | 0.535–0.607 | 134 | 44 | 90 |
| [Short rolling usage window blocks or interrupts work](https://feedbackbench.com/coding-agents/criteria/limits.window_interrupts_work.md) | 3rd of 6 | 0.483 | 0.461–0.507 | 52 | 3 | 49 |
| [Pricing and plan terms stated clearly and consistently](https://feedbackbench.com/coding-agents/criteria/billing.pricing_clarity.md) | 4th of 6 | 0.483 | 0.464–0.513 | 40 | 1 | 39 |
| [Using an existing subscription across tools](https://feedbackbench.com/coding-agents/criteria/billing.subscription_portability.md) | 5th of 8 | 0.492 | 0.470–0.512 | 40 | 14 | 26 |
| [Usage meter visibility and accuracy](https://feedbackbench.com/coding-agents/criteria/limits.usage_meter.md) | 4th of 6 | 0.497 | 0.470–0.532 | 38 | 3 | 35 |
| [Price, allowance or plan terms changed](https://feedbackbench.com/coding-agents/criteria/limits.allowance_change.md) | 3rd of 7 | 0.531 | 0.473–0.599 | 36 | 3 | 33 |
| [Quota reset timing and bonus or banked resets](https://feedbackbench.com/coding-agents/criteria/limits.reset_schedule.md) | Too few posts | 0.507 | 0.491–0.524 | 15 | 4 | 11 |
| [Pay-as-you-go overage, fallback billing and spend caps](https://feedbackbench.com/coding-agents/criteria/billing.overage_charges.md) | Too few posts | 0.492 | 0.486–0.497 | 9 | 0 | 9 |
| [Prompt cache hits, misses and invalidation](https://feedbackbench.com/coding-agents/criteria/limits.prompt_cache.md) | Too few posts | 0.503 | 0.498–0.509 | 3 | 2 | 1 |

Most recent posts:

- Praise, 2026-10-18, @cognition (X): “@mingdynastyvase @cognition @scarletkc yes. i feel that devin's coding plan is a great deal for purchasing cloud computer usage rights.” [source](https://twitter.com/2073035346707968000/status/2111616377970954723)
- Praise, 2026-10-17, @cognition (X): “@yyhhyyyyyy @cognition devin 20x is equivalent to claude official 4x but still cheaper than pure api.” [source](https://twitter.com/756779273155858432/status/2111382740633534794)
- Praise, 2026-10-17, @cognition (X): “@tickswiz @devinai @devindevelopers @cognition devin offers other models like argon at 75% off and their harness is definitely superior and you have unlimited swe2 and no 5 hours limit only weekly” [source](https://twitter.com/1825243355501973504/status/2111504485130338426)
- Complaint, 2026-10-18, @cognition (X): “@scarletkc @cognition there is a bug with the gpt subscription. sometimes, using gpt fails directly and consumes the quota, possibly limited to using the gpt subscription only.” [source](https://twitter.com/2098049380192583680/status/2111635796671463565)
- Complaint, 2026-10-18, @cognition (X): “@scarletkc @cognition increase the max limit a bit, opus is not enough to use 😭” [source](https://twitter.com/844779026329718785/status/2111869927527510204)
- Complaint, 2026-10-17, @cognition (X): “@dabit3 @cognition devin cloud with macos is my go to alternative when for remote building. however, i noticed that for every minutes that the vm is live, it consumes much tokens, and more tokens consumption when it triggered child sessions when the more vm are being used.” [source](https://twitter.com/1994170271201415170/status/2111269191613641012)

### Setting up and connecting: 7th of 12 (customer love 0.500, n 96)

Users bring up setup less than half as often as they do for other agents. They rate it at the category norm.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Install, launch and sign-in](https://feedbackbench.com/coding-agents/criteria/setup.install_signin.md) | Too few posts | 0.513 | 0.492–0.536 | 29 | 9 | 20 |
| [MCP servers, plugins, skills and hooks](https://feedbackbench.com/coding-agents/criteria/setup.extensions_mcp.md) | Too few posts | 0.504 | 0.489–0.517 | 23 | 12 | 11 |
| [Onboarding, discoverability and documentation](https://feedbackbench.com/coding-agents/criteria/setup.onboarding_docs.md) | Too few posts | 0.500 | 0.487–0.517 | 18 | 4 | 14 |
| [IDE and editor integration](https://feedbackbench.com/coding-agents/criteria/setup.ide_integration.md) | Too few posts | 0.507 | 0.497–0.517 | 17 | 11 | 6 |
| [Connecting own API keys, local models and custom endpoints](https://feedbackbench.com/coding-agents/criteria/setup.provider_byok_local.md) | Too few posts | 0.492 | 0.481–0.501 | 12 | 3 | 9 |

Most recent posts:

- Praise, 2026-10-05, @DevinAI (X): “@devinai is the first agent that told me to paste a api key in chat and i like it [link]” [source](https://twitter.com/2071256076335673344/status/2107201649114759240)
- Praise, 2026-09-30, @cognition (X): “love how devin asks for credentials in the creation flow, instead of making me hunt down the .env file and paste the secret in manually. small ux detail, but it makes the whole agent workflow feel much smoother. @cognition [link]” [source](https://twitter.com/2093963949003935745/status/2105223276780040512)
- Praise, 2026-09-24, @DevinAI (X): “@devinai a quick and easy way to start to work on my projects alias dev="devin-desktop"” [source](https://twitter.com/1408012113549791238/status/2102953668391866798)
- Complaint, 2026-09-30, @cognition (X): “@cognition cannot login with my chatgpt sub, it shows "no account found for this email". why should i use two identical emails here?” [source](https://twitter.com/752498653894418433/status/2105105288835789194)
- Complaint, 2026-09-30, @cognition (X): “@cognition having a hard time setting this up with my chat pro account as they share the same email. it says that i already have an account with this email so it should show up under connections” [source](https://twitter.com/1993957296003833856/status/2105149087473680843)
- Complaint, 2026-09-30, @cognition (X): “@nightshadessx @cognition i encountere this either. that is asking you to login with your devin account, then it will redirect to chatgpt for oauth😅 bad ux” [source](https://twitter.com/752498653894418433/status/2105154607475552682)

### Choosing models: 2nd of 12 (customer love 0.635, n 141)

Users like that Devin offers the models they want, where it ranks 2nd of 11. They also say quality holds steady over time and that auto mode picks the right model.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Which models are offered on a plan and when](https://feedbackbench.com/coding-agents/criteria/models.catalog_access.md) | 2nd of 11 | 0.600 | 0.568–0.632 | 59 | 44 | 15 |
| [Quality got worse or better over time](https://feedbackbench.com/coding-agents/criteria/models.quality_drift.md) | 2nd of 7 | 0.551 | 0.526–0.576 | 39 | 26 | 13 |
| [Automatic model routing and fallback](https://feedbackbench.com/coding-agents/criteria/models.routing_auto.md) | 3rd of 8 | 0.547 | 0.523–0.571 | 37 | 23 | 14 |
| [Reasoning effort setting and its defaults](https://feedbackbench.com/coding-agents/criteria/models.effort_control.md) | Too few posts | 0.498 | 0.490–0.506 | 11 | 5 | 6 |

Most recent posts:

- Praise, 2026-10-18, @cognition (X): “@altagers @cognition i switched to devin and droid because i have every model in one sub and both harnesses are really great” [source](https://twitter.com/1466416677713854477/status/2111810899011059755)
- Praise, 2026-10-13, @cognition (X): “@chris_wozniczek @devinai @cognition i'm very happy that devin allows me to use gemini 4 argon!” [source](https://twitter.com/1067085110372171779/status/2110109819827060818)
- Praise, 2026-10-13, @DevinAI (X): “@nando_g_ai @devinai i think right now it's the best for having all models in one.” [source](https://twitter.com/2034540258365489152/status/2110079410791485450)
- Complaint, 2026-10-13, @cognition (X): “the intelligence of swe-2 has seriously declined in the last few hours @cognition @devindevelopers i have to re-enable kimi k3 #hermes” [source](https://twitter.com/2018156578617090049/status/2110014289776156767)
- Complaint, 2026-10-03, @cognition (X): “@_anishlk @cognition when will devin stop de-intelligencing deepseek models? you can charge more credits but you shall offer open models at their best, not de-intelligence them.” [source](https://twitter.com/1705140930888486912/status/2106388524270588212)
- Complaint, 2026-10-01, @cognition (X): “@dabit3 @robinebers @cognition @willyxiao1 why devin cloud fusion does not allow you to choose which frontier model and which helper model, please fix [link]” [source](https://twitter.com/2002397531226148864/status/2105807119568245010)

### Instructing and context: 3rd of 11 (customer love 0.522, n 59)

Users rarely discuss instructions and context. They rate them slightly above the category norm.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Memory and state carried across sessions](https://feedbackbench.com/coding-agents/criteria/context.session_memory.md) | Too few posts | 0.513 | 0.498–0.528 | 20 | 12 | 8 |
| [Finding the right files in the codebase](https://feedbackbench.com/coding-agents/criteria/context.codebase_retrieval.md) | Too few posts | 0.503 | 0.497–0.510 | 11 | 6 | 5 |
| [Direct in-prompt instructions and caps are followed](https://feedbackbench.com/coding-agents/criteria/context.instruction_following.md) | Too few posts | 0.510 | 0.499–0.524 | 9 | 5 | 4 |
| [Output degrades as the context window fills](https://feedbackbench.com/coding-agents/criteria/context.long_context_decay.md) | Too few posts | 0.499 | 0.490–0.511 | 7 | 1 | 6 |
| [Persistent project rules files are read and obeyed](https://feedbackbench.com/coding-agents/criteria/context.instruction_files.md) | Too few posts | 0.497 | 0.489–0.504 | 4 | 1 | 3 |
| [Context compaction keeps what matters, cheaply and quickly](https://feedbackbench.com/coding-agents/criteria/context.compaction.md) | Too few posts | 0.502 | 0.497–0.509 | 4 | 2 | 2 |
| [Asks the user versus guessing](https://feedbackbench.com/coding-agents/criteria/context.clarifying_questions.md) | Too few posts | 0.496 | 0.492–0.500 | 3 | 0 | 3 |
| [Images, PDFs and file attachments as input](https://feedbackbench.com/coding-agents/criteria/context.attachments.md) | Too few posts | 0.500 | 0.496–0.505 | 2 | 1 | 1 |

Most recent posts:

- Praise, 2026-10-10, @cognition (X): “@mystere___ @cognition it’s not all compatibility problems tho. devin supports a bunch of open standards and other harness semantics - prefer claude.md files to agents.md files? devin supports both. a myriad of other cross harness standards converge in devin.” [source](https://twitter.com/1095784409683374080/status/2109016245890883999)
- Praise, 2026-10-07, @cognition (X): “[link] 🚀🚀🚀 memories, one of the most awesome cascade features and the reason i loved windsurfing so much, is back! thank you so much, @cognition! #devin” [source](https://twitter.com/805962687851200516/status/2107874422531277305)
- Praise, 2026-10-05, @cognition (X): “@cognition @cognition tried it on the memory claude code kept for my project: 19 notes over 10 days. made it a git repo. a fresh devin session recalled what claude code had learned, then dreamed on it: 21 commits, 19 → 14 notes, duplicates merged, stale notes gone. [link]” [source](https://twitter.com/195622492/status/2107178413241106799)
- Complaint, 2026-10-10, @cognition (X): “@mystere___ @cognition if you have a lovely composed tree of agents.md files that works great in codex, your devin agent will get overwhelmed because the injection persists beyond the lifetime of the agents activity in that scope.” [source](https://twitter.com/1095784409683374080/status/2109009168959168649)
- Complaint, 2026-09-18, @cognition (X): “@cognition and that wraps that. the swe2 model has 0 adherence to prompt safety. tell it to do something a specific way, if it fails, it doesn't flag it and tries to workaround instead.. tell it not to do something, it will take that as instruction to do it. its just shit tier.” [source](https://twitter.com/1917224549604605953/status/2101091262363492357)
- Complaint, 2026-09-18, r/windsurf (Reddit): “devin bug: changed files in a chat session disappear if opening a new session in agent mode [removed]” [source](https://www.reddit.com/r/windsurf/comments/1wk5uj0/devin_bug_changed_files_in_a_chat_session/)

### Doing the work: 1st of 14 (customer love 0.670, n 543)

Users say Devin can handle their kind of task. It runs long jobs unattended, with 47 praise to 2 complaints. Subagents rate at the category norm.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Can do the user's kind of task](https://feedbackbench.com/coding-agents/criteria/work.capability.md) | 2nd of 13 | 0.638 | 0.611–0.662 | 396 | 337 | 59 |
| [Subagents, parallel agents and orchestrators](https://feedbackbench.com/coding-agents/criteria/work.multi_agent_orchestration.md) | 4th of 10 | 0.512 | 0.490–0.534 | 76 | 50 | 26 |
| [Long unattended runs and goal/loop mode](https://feedbackbench.com/coding-agents/criteria/work.long_running_autonomy.md) | 2nd of 8 | 0.537 | 0.520–0.553 | 49 | 47 | 2 |
| [Computer use and browser control](https://feedbackbench.com/coding-agents/criteria/work.computer_browser_use.md) | Too few posts | 0.495 | 0.484–0.504 | 16 | 6 | 10 |
| [Spins, loops or gets stuck without progress](https://feedbackbench.com/coding-agents/criteria/work.stuck_loops.md) | Too few posts | 0.521 | 0.488–0.562 | 15 | 2 | 13 |
| [Frontend and visual UI output](https://feedbackbench.com/coding-agents/criteria/work.frontend_ui.md) | Too few posts | 0.500 | 0.489–0.512 | 13 | 6 | 7 |
| [Diagnosing and fixing reported bugs](https://feedbackbench.com/coding-agents/criteria/work.bug_diagnosis.md) | Too few posts | 0.515 | 0.507–0.524 | 12 | 12 | 0 |
| [Does unrequested work or over-engineers](https://feedbackbench.com/coding-agents/criteria/work.scope_overreach.md) | Too few posts | 0.530 | 0.495–0.572 | 10 | 3 | 7 |
| [Risky or irreversible actions without confirmation](https://feedbackbench.com/coding-agents/criteria/work.destructive_actions.md) | Too few posts | 0.500 | 0.490–0.513 | 9 | 2 | 7 |
| [Tool approval prompts and autonomy modes](https://feedbackbench.com/coding-agents/criteria/work.permission_prompts.md) | Too few posts | 0.492 | 0.485–0.497 | 9 | 0 | 9 |
| [Length and clarity of replies, summaries and comments](https://feedbackbench.com/coding-agents/criteria/work.response_verbosity.md) | Too few posts | 0.508 | 0.499–0.519 | 7 | 4 | 3 |
| [Stops mid-task or answers instead of acting](https://feedbackbench.com/coding-agents/criteria/work.premature_stop.md) | Too few posts | 0.496 | 0.492–0.499 | 6 | 0 | 6 |
| [Breaks existing code or reintroduces bugs](https://feedbackbench.com/coding-agents/criteria/work.regressions_introduced.md) | Too few posts | 0.506 | 0.496–0.525 | 4 | 1 | 3 |
| [Git commits, branches and sync](https://feedbackbench.com/coding-agents/criteria/work.git_workflow.md) | Too few posts | 0.504 | 0.498–0.511 | 3 | 2 | 1 |
| [Plan-before-edit mode](https://feedbackbench.com/coding-agents/criteria/work.plan_mode.md) | Too few posts | 0.504 | 0.500–0.509 | 3 | 3 | 0 |
| [Games checks instead of fixing the problem](https://feedbackbench.com/coding-agents/criteria/work.reward_hacking.md) | Too few posts | 0.499 | 0.498–0.500 | 1 | 0 | 1 |
| [Safety filters block legitimate coding tasks](https://feedbackbench.com/coding-agents/criteria/work.safety_refusals.md) | Too few posts | 0.506 | 0.500–0.518 | 1 | 1 | 0 |
| [Caves to or argues with the user's judgement](https://feedbackbench.com/coding-agents/criteria/work.sycophancy_pushback.md) | Too few posts | 0.500 | 0.500–0.500 | 0 | 0 | 0 |

Most recent posts:

- Praise, 2026-10-16, @cognition (X): “our eng team put devin on the on-call rotation. it investigates alerts, finds the root cause, and opens a tested pr for review. excited for our friends at @cognition to be officially launching this one! [link]” [source](https://twitter.com/94682674/status/2110916182580809832)
- Praise, 2026-10-16, @cognition (X): “our eng team put devin on the on-call rotation. it investigates alerts, finds the root cause, and opens a tested pr for review. excited for our friends at @cognition to be officially launching this one! dlvr.it/tvx5r5 [link]” [source](https://twitter.com/143874022/status/2110918657547342125)
- Praise, 2026-10-16, @cognition (X): “i'm 17. for one month, devin was my entire engineering team. i woke up to 67 prs. 44 merged. i built an os, local ai models and a native multi-agent app between classes. everything i learned about @cognition @devinai 👇 [link]” [source](https://twitter.com/1810175539053006848/status/2110945930258399539)
- Complaint, 2026-10-15, @cognition (X): “last night i had the worst experience with devin from @cognition so far. devin deleted all the previous progress and switched branches. i will never use devin for any backend work. cannot be trusted [link]” [source](https://twitter.com/1536786963843403780/status/2110641298466340937)
- Complaint, 2026-10-12, @cognition (X): “what the check a simple.imort turned into 12 hours and there more with devin ai @cognition [link]” [source](https://twitter.com/2108480245279993856/status/2109661959767425475)
- Complaint, 2026-10-06, @cognition (X): “@cognition swe-2 has become very stupid recently. i specified it to complete a task in codebase a, but it actually went to read another codebase b, saying it needs to reference codebase a to modify codebase b. pure idiot, it makes me so angry.” [source](https://twitter.com/2087479844540178432/status/2107423954801746429)

### Checking and finishing: 2nd of 9 (customer love 0.526, n 52)

Users rarely discuss this area and rate it above the norm. Posts describe cloud agents that test changes for them.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Agent-performed code review finds real issues](https://feedbackbench.com/coding-agents/criteria/verify.agent_code_review.md) | Too few posts | 0.503 | 0.479–0.523 | 24 | 20 | 4 |
| [Builds, tests or runs its own changes](https://feedbackbench.com/coding-agents/criteria/verify.self_testing.md) | Too few posts | 0.509 | 0.498–0.519 | 16 | 13 | 3 |
| [Reviewing and approving the agent's changes](https://feedbackbench.com/coding-agents/criteria/verify.change_review_ui.md) | Too few posts | 0.496 | 0.489–0.503 | 8 | 2 | 6 |
| [Claims work is done or fixed when it is not](https://feedbackbench.com/coding-agents/criteria/verify.false_completion.md) | Too few posts | 0.495 | 0.491–0.498 | 7 | 0 | 7 |

Most recent posts:

- Praise, 2026-10-15, @DevinAI (X): “the amount of dead code @devinai has caught for me is insane it has a feature where it auto-reviews merges to main for bugs or dead code and i've gotten at least 10+ of these dead code messages i just reply "yes" and the pr's ready for me to merge in a few min later [link]” [source](https://twitter.com/1762175022527877120/status/2110525817390498195)
- Praise, 2026-10-13, r/CognitionLabs (Reddit): “what are you talking about? you should be happy that devin ci reviews your code and blocks it. check your review settings if you want faulty code per choice” [source](https://www.reddit.com/r/CognitionLabs/comments/1x4wpx3/warning_devin_injects_advertisements_into_pull/pghp44y/)
- Praise, 2026-10-10, @cognition (X): “@devindevelopers @devinai @cognition and reviewed by opus 5.5 at end and only spotted some minor bugs and that's it gonna miss swe 2 in next few days 😔” [source](https://twitter.com/1986324145555316740/status/2108968456511180844)
- Complaint, 2026-10-05, @cognition (X): “@cognition cool. hope this improves the pr reviews. they've gotten very prone to flagging non-issues the last few days.” [source](https://twitter.com/9648292/status/2107221862077915182)
- Complaint, 2026-10-13, r/CognitionLabs (Reddit): “while i did not give devin write access to my repo, a new pr kicked off an unrequested review by devin. not only did this review fail and block my pr, unjustly: you are editing pr messages to insert devin advertisements. in my view, this is evil behaviour. i have instantly cancelled my devin subscription. i would recommend you to avoid these malpractices, if you're serious about the future of devi…” [source](https://www.reddit.com/r/CognitionLabs/comments/1x4wpx3/warning_devin_injects_advertisements_into_pull/)
- Complaint, 2026-09-13, @cognition (X): “@cognition what's even more disturbing is swe-2 high tried to say my cursor hooks would have caught this. just lied to cover up it's tracks. very concerning. my cursor hooks are there to ensure loops are followed, this repo doesn't even have that enabled. it just read code and assumed! [link]” [source](https://twitter.com/329429514/status/2098930117560909920)

### Interface and sessions: 1st of 14 (customer love 0.598, n 176)

Cloud sessions draw the most ratings here, and users praise them far more than they complain. Display and settings sit at the norm, with more complaints than praise. Mobile and remote control rate above the norm, and users ask for an official mobile app.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Cloud and remote sandbox execution](https://feedbackbench.com/coding-agents/criteria/surfaces.cloud_sessions.md) | 2nd of 5 | 0.569 | 0.545–0.593 | 97 | 80 | 17 |
| [How the interface shows work, and what the user can configure](https://feedbackbench.com/coding-agents/criteria/ui.display_settings.md) | 6th of 12 | 0.501 | 0.479–0.522 | 51 | 17 | 34 |
| [Mobile, remote-control and voice access](https://feedbackbench.com/coding-agents/criteria/surfaces.remote_mobile.md) | 4th of 7 | 0.522 | 0.506–0.540 | 34 | 25 | 9 |
| [Saving, switching, resuming and rewinding sessions](https://feedbackbench.com/coding-agents/criteria/ui.session_history.md) | Too few posts | 0.493 | 0.485–0.501 | 12 | 1 | 11 |
| [Stopping and steering a running agent](https://feedbackbench.com/coding-agents/criteria/ui.interrupt_steer.md) | Too few posts | 0.497 | 0.492–0.500 | 3 | 0 | 3 |

Most recent posts:

- Praise, 2026-10-17, @cognition (X): “i'm blown away by the @devinai voice mode. chatting through an implementation plan my agent started humming and having the most impressive voice inflections. great job by the folks at @cognition. if you're curious to try it out: [link]” [source](https://twitter.com/2024126258389602304/status/2111576749150482758)
- Praise, 2026-10-16, @cognition (X): “trying to get to 20k steps today but can’t afford to take a break from work. fortunately, devin voice is quite literally jarvis so work doesn’t have to stop while i’m racking up those steps. @cognition crushed it with this one. [link]” [source](https://twitter.com/730703573760278528/status/2111096081115460092)
- Praise, 2026-10-16, @cognition (X): “shipping devin mobile app- 5g effortlessly manage permissions and enjoy full remote control on the go. now i can sip a drink☕️, soak up the sun 🌞at the beach🏖️, and get work 💻down! @cognition @jorybraun [link]” [source](https://twitter.com/1482840431994064904/status/2111182985735372877)
- Complaint, 2026-10-18, @cognition (X): “@yifanxu_ephai @cognition @scarletkc but a conversation can only be associated with one system, making it inconvenient to directly let the agent perform three system tests. cc @scarletkc i really hope this can be changed.” [source](https://twitter.com/3062134651/status/2111618600754913657)
- Complaint, 2026-10-06, @cognition (X): “@devindevelopers @devinai @cognition after migrating from devin cli to devin desktop 2 weeks ago, i have a long list of qol features that i think the app desperately needs if there's anyway of sharing it with the team” [source](https://twitter.com/2039180837434834944/status/2107482915831509031)
- Complaint, 2026-10-04, @DevinAI (X): “underlying @devinai uses the same model, but in the cloud, getting it up to the same accessibility still isn’t a walk in the park. i’m not gonna give up to get it to environment parity to local or claude code! [link]” [source](https://twitter.com/218098611/status/2106693742854041906)

### Reliability and speed: 7th of 13 (customer love 0.515, n 160)

Complaints far outnumber praise here. Users describe crashes, freezes and memory leaks, with 56 complaints to 3 praise on running without crashing. They also describe slow responses.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Latency, throughput and fast mode](https://feedbackbench.com/coding-agents/criteria/rel.response_speed.md) | 7th of 10 | 0.510 | 0.488–0.534 | 74 | 23 | 51 |
| [Client crashes, freezes and failed tool execution](https://feedbackbench.com/coding-agents/criteria/rel.client_failures.md) | 8th of 11 | 0.482 | 0.458–0.512 | 59 | 3 | 56 |
| [Outages, server errors and capacity or rate errors](https://feedbackbench.com/coding-agents/criteria/rel.service_errors.md) | Too few posts | 0.514 | 0.486–0.545 | 23 | 3 | 20 |
| [Updates break working setups](https://feedbackbench.com/coding-agents/criteria/rel.update_breakage.md) | Too few posts | 0.511 | 0.496–0.529 | 15 | 5 | 10 |

Most recent posts:

- Praise, 2026-10-14, @cognition (X): “@ultari_x @cognition @devinai @devindevelopers 30tps? faster than codex and i went up to 50 subagents” [source](https://twitter.com/1825243355501973504/status/2110193541964304462)
- Praise, 2026-09-28, @cognition (X): “@dannypostma and it’s even faster if you try opus with @cognition ‘s fusion model” [source](https://twitter.com/130668248/status/2104574312678342803)
- Praise, 2026-09-22, @DevinAI (X): “@rubenssoto_ai @devinai i haven’t had any issues on it at all. i use the cloud, devin desktop and occasionally devin cli.” [source](https://twitter.com/415168859/status/2102502516617560192)
- Complaint, 2026-10-15, r/windsurf (Reddit): “i'm using the windsurf ide and today any tasks is being donde very very slow by the agent. anyone else having this issue?” [source](https://www.reddit.com/r/windsurf/comments/1x6tser/why_is_so_slow_today/)
- Complaint, 2026-10-11, @cognition (X): “yo @cognition i'm out of ram. can you fix devin's language server? it has a memory leak. [link]” [source](https://twitter.com/98926715/status/2109408328656805903)
- Complaint, 2026-10-10, @cognition (X): “@cognition not there for some, and not working when there for the rest. [link]” [source](https://twitter.com/196604949/status/2108870489900798182)

### Account and support: 4th of 11 (customer love 0.545, n 42)

Users rarely discuss support and account matters. The area rates above the norm, but complaints outnumber praise 32 to 10.

| Criterion | Reading | Customer love | 95% interval | n | Praise | Complaint |
|---|---|---|---|---|---|---|
| [Support, refunds and issue handling](https://feedbackbench.com/coding-agents/criteria/account.support.md) | Too few posts | 0.529 | 0.496–0.566 | 26 | 7 | 19 |
| [Wrong charges, failed payments and plan provisioning](https://feedbackbench.com/coding-agents/criteria/account.billing_errors.md) | Too few posts | 0.491 | 0.485–0.495 | 12 | 0 | 12 |
| [Data retention, training use and deployment isolation](https://feedbackbench.com/coding-agents/criteria/account.data_privacy.md) | Too few posts | 0.513 | 0.499–0.530 | 4 | 3 | 1 |
| [Account bans and access restrictions](https://feedbackbench.com/coding-agents/criteria/account.bans_restrictions.md) | Too few posts | 0.497 | 0.494–0.500 | 3 | 0 | 3 |

Most recent posts:

- Praise, 2026-10-12, @cognition (X): “burned so many tokens on devin that @cognition personally showed up and gifted me this custom merch. [link]” [source](https://twitter.com/95556436/status/2109707560580472884)
- Praise, 2026-10-05, r/ClaudeCode (Reddit): “i missed to unsubscribe a day after renewal, they refunded me instantly my max subscription (went to swe devin since). you may have been unlucky but they are still fair on this part” [source](https://www.reddit.com/r/ClaudeCode/comments/1wym92f/anthropic_stole_my_money_and_my_tokens/pe40r57/)
- Praise, 2026-10-02, @DevinAI (X): “@jensenloke @devinai i'd like to point out they fix this in less than 24 hours. bruh” [source](https://twitter.com/415168859/status/2106076895313788974)
- Complaint, 2026-10-10, @cognition (X): “@cognition @dabit3 ticket [zip code]. chatgpt plan toggle is on. after 19:00 cst oct 10, ordinary gpt-6-1-sol-high and gpt-6-astra-medium (catalog marks both partner_provider_openai, not fast) still billed devin. daily quota hit 0%. please investigate and refund those charges.” [source](https://twitter.com/1796148761925947392/status/2108903736907366707)
- Complaint, 2026-10-04, @cognition (X): “@demetreminchev @da7_tech @devinai @cognition and if the team adds a third person, 'full' charges a fee, then if you cancel the third person's plan, you still have to pay. i'm completely helpless at this point.” [source](https://twitter.com/1999158181520637953/status/2106627104951747039)
- Complaint, 2026-09-30, @cognition (X): “@prathamdby @cognition yup. i was ghosted and blocked by their team instantly. no warning what happened until after when someone internal let me know” [source](https://twitter.com/1552915034585669633/status/2105414711814811818)