Strands Harness Cost and Customization Pain Points
Problem
Users are concerned about the high cost of non‑native harnesses, the need to evaluate each model release for compatibility, and the lack of cheaper alternatives as benchmarks become saturated; they also express frustration with limited customization and bloated system prompts.
Pain points
- High cost of non‑native harnesses requiring frequent compatibility checks for each model release
- Benchmark saturation limiting cheaper alternatives
- Frustration with bloated system prompts and limited customization
Questions to verify
- Would you be willing to switch if a cheaper alternative offered comparable benchmark performance?
- Do you currently evaluate each harness before using it with new model releases?
- Which improvements would you most like to see regarding system prompt bloat and customization?
Evidence
quote · @Anonymous
I am increasingly hesitant to use non-native harnesses - model providers are now starting to train their agents for use within the harness. An eval like terminal bench can only capture so much data. I don't want to have to assess each harness every model release to make sure it's working as well as it can.
quote · @Anonymous
Why is Pi not in the benchmarks? Deepseek beats Strands and its built on Pi so that’s all I needed to know.
quote · @Anonymous
> With Fable 5, Strands harness cost 77% less than Claude Code and scored higher on Terminal Bench 2.1.Terminal Bench 2.1 is saturated. Many token saving techniques would save money and score basically the same running Fable 5 against Terminal Bench 2.1. (They claim a better score but don’t say how much better. I’d bet my favorite hat that it’s not statistically significant.)This is at least the fourth time I’ve seen a project hit front page with a “save money with same score on saturated benchmark” claim.
quote · @Anonymous
I remember reading about strands SDK and it looked great in terms how everything is an event that you can extend, so this harness feels quite about right. However, for this kind of customisation, Pi is actually quite great. One of the most things I love about Pi is ability to ask it to create an extension and it does it quite well as it’s part of their docs. Also ability to customise the system prompt to avoid the clutter that Claude Code add (around 20k system prompt that mostly had nothing to do with the code).
Disclaimer: this card is distilled by AI from community discussions as “pain point evidence”. It is a starting point for need analysis and validation, not a “validated market need”. AI has analytical limits; please open the original discussion above to manually verify before key decisions.