Behaviour and trust · Push back with grounds
Challenge as conduct
Trustworthy systems sometimes push back. Naming impracticality or conflicting constraints is conduct, not error.
9 min read
Cover for Challenge as conductThe request says: use spinach before Wednesday and serve meals with fresh greens picked up day-of all week. The Meal Companion could silently pick one constraint to violate and hope the household does not notice until grocery day. The trustworthy response challenges: both constraints cannot hold as stated. Name the conflict. Explain why it matters. Offer tradeoffs the household can choose. Challenge as conduct is part of cognitive posture, and selective pushback builds reliance over time because users learn the system will partner on repair rather than absorb impossible weeks.
Helpful context: Contested decisions classifies disagreement types. Collaboration contract specifies challenge obligations. Refuse and defer covers hard stops when no tradeoff exists.
When to challenge
Challenge applies when hard and soft constraints cannot jointly satisfy, when temporary context makes an endorsed strategy inapplicable without notice, when the request implies authority the system lacks (paired with deferral), or when proceeding would require silent assumption on a material preference. Challenge does not apply to mere taste preferences without joint impossibility. Nagging about cuisine variety when constraints allow repeats is noise, not conduct.
| Situation | Conduct |
|---|---|
| Spinach-by-Tuesday conflicts with fresh-only day-of greens | Challenge with tradeoffs |
| User prefers Italian twice (no hard conflict) | Proceed or recommend, do not nag |
| Request implies medical interpretation | Defer, do not challenge into guessing |
| Hard allergy override requested | Refuse, do not challenge into compromise |
The distinction between challenge and other conduct modes matters because mixing them without naming confuses users. Challenge means a tradeoff exists and the user retains authority to choose among named options. Refusal means a hard rule or missing authority forbids action, as when someone asks to override a confirmed cashew allergy. Deferral means frontier terrain where the household or a professional must lead, as with interpreting an unfamiliar medical diet. Architects log which mode fired, UX labels it, and evaluation regression-tests that collisions trigger challenge rather than silent violation.
Introduction to Thoughtware Ch. 13Challenge when named constraints collide and the requested outcome cannot be honoured together.
Challenge in dialogue
Tone determines whether challenge reads as partnership or scolding. Consider the spinach conflict: "Those conflict. Fresh-picked greens day-of will not include Tuesday's fridge spinach. I can prioritize spinach before Wednesday with standard groceries, or fresh-picked greens from Thursday onward. Which matters more this week?" That response names the conflict, explains why it exists, and offers paths forward.
A different collision looks like this: "With four evenings under 25 minutes, variety beyond stir-fry and salad repeats is tight. Relax one busy flag, accept a repeat cuisine, or shift one meal to weekend prep?" The system is specific about the constraint it cannot satisfy, and each option is actionable. Challenge without respect reads as error messages. Challenge with respect reads as partnership.
The same pattern appears in enterprise domains with different vocabulary. Enterprise agents challenge impractical SLAs, conflicting policy clauses, or requests that imply authority the agent lacks. A compliance tool may challenge more formally than a household planner, but the architecture is the same: name the conflict, show tradeoffs. Tone is part of posture. Challenge templates name which clause conflicts with which, who owns resolution, and what partial work remains safe. The household planner vocabulary changes. The conduct pattern does not.
Challenge before expensive work
Challenge early saves iterations. Naming impossible weeks before composition avoids five critique passes that never satisfy fresh-greens and spinach-by-Tuesday together. The connection to when the system must stop is direct: challenge prevents loops from burning budget on impossible constraints. When a user adds conflicting hard constraints mid-session, challenge fires immediately rather than after composition completes: "Adding nut-free for guests conflicts with Tuesday's planned pesto. Swap Tuesday or change guest menu?" Delayed challenge after composition wastes work and feels like the system hid the conflict.
Users sometimes reject the framing and insist on impossible constraints. The system does not silently violate in response. It repeats the challenge with clearer tradeoffs, offers deferral if authority is missing, or stops unsuccessfully with visible state. Silent violation after challenge erodes trust faster than the initial conflict did. Recommend, don't only respond expects initiative within authority, and challenge is initiative at the boundary of impossibility. The system still proposes paths. It does not pretend all paths exist.
Targeted questions resolves a related but different situation. When conflict arises from a missing fact, ask. When conflict arises from incompatible supplied constraints, challenge. Both require restraint, but they differ in whether the gap is missing information or incompatible instructions. Critique loops challenge before patch. Patching silently around impossible constraints produces fluent plans that still fail at use time. Named challenge before composition completes is cheaper than five patch iterations that never resolve fresh-greens versus spinach-by-Tuesday.
When a user requests a plan that satisfies stated constraints but violates endorsed knowledge unless an assumption changes, challenge the assumption: "Your endorsed cap is 25 minutes on busy evenings. Thursday's roast needs 45. Override cap this week or swap Thursday?"
Challenge in evaluation
Challenge templates are regression-tested per constraint-collision class. Teams often golden-path test happy weeks and never test impossible ones. Incidents then trace to silent violation, the opposite of conduct. Log challenge class, constraints named, options offered, and user selection. Feed selections into experience becomes expertise when patterns repeat.
Challenge behaviour must be protected in training and evaluation pipelines the way allergy checks are protected in code. Fine-tuning on agreeable assistants reduces challenge unless conduct specs and eval cases reinforce it. Weekly regression includes at least one impossible constraint fixture per release train so challenge templates do not rot silently. Without that coverage, teams discover that challenge vanished only when production delivers a week that silently violated constraints a user expected the system to flag. The regression gap is invisible in happy-path test suites because impossible inputs never appear in them. Copy guidelines include examples of respectful challenge phrasing and forbidden nagging phrasing so designers and writers align with conduct specs rather than inventing pushback tone per screen.
When users pick a challenge option, the selection persists in working state with version. Future composition respects the tradeoff without re-challenging unless constraints change again. Persisted tradeoffs belong in contestable working state, and evaluation asserts tradeoff selections survive the next composition pass. Store selections where contestability UI can display them. Demos include one challenge moment so buyers see partnership behaviour alongside fluent completion. Omitting challenge from demos teaches sales teams that the product only agrees, and that expectation carries through to onboarding material and user documentation.
Challenge metrics track acceptance rate: how often users pick an offered tradeoff versus insist on impossible constraints. Low acceptance may mean unclear options. High silent violation after challenge means conduct regression. Data turns challenge from a tone issue into an architecture signal. Monthly review of challenge rates reveals where users send impossible requests, where specs are unclear, and where guards fail to fire before composition.
When one agent hands to another, challenge obligations do not drop. Secondary agents sometimes silently relax constraints to complete handoff. Conduct specs require challenge before handoff completes on known collisions.
What to do next
Challenge as conduct converts constraint collisions from silent violations into collaborative tradeoffs. The conduct pattern applies uniformly across household planners, enterprise compliance tools, and any domain where constraints can conflict. Evaluation protects it the same way it protects allergy enforcement: through regression suites that verify impossible inputs trigger named conflicts rather than fluent fiction.
Read targeted questions, when the system must stop, and recommend, don't only respond.
Read next: When the system must stop explains that challenge is one stop class among several.