Status: proposed evaluation method

This is a practical test design for evaluating assistant behavior. It is not a completed study, a customer result, a published academic paper or a claim of product superiority.

Fixture and task

Use fictional personal details, request forgetting of one item, and inspect both the confirmation and a later relevant response.

Procedure

  • Record which memory controls are available
  • Separate memory removal from chat deletion
  • Check later behavior without reintroducing the forgotten detail

What to score

Score the claimed removal and the observable follow-up separately. A behavioral result alone does not prove deletion from every storage location.

Limits and responsible interpretation

This method is not a privacy certification or a claim about any product's internal storage. No test result is published here.

Publish the date, exact product setup, source pack, sample size and failures with any future results. Keep expected answers with the evaluator. Do not combine unmatched API and consumer-app runs into one ranking.

Related reading