Savorant Research · Study protocol
Glass shuffle or pourer?.
Does blinding yourself with the glass shuffle give the same results as having someone pour?
- Status
- Open
- Protocol
- Version 1.0, 2026-10-18
- Consent
- S.shuffle.v1
- Investigator
- John Schuster, Drunken Unicorn Productions
- Preregistration
- Being posted to the Open Science Framework; the link will appear here
- Ethics review
- Not yet reviewed; we intend independent review before any results are published
- Target
- 35 tasters with at least 18 rounds in each mode on the same pair
- Runs until
- The target is reached, or 2029-10-18
Why this study
A triangle test is only valid if the taster can’t see which glass is which. With a pourer that is guaranteed by design. With the glass shuffle it depends on the shuffle: a taster who half-remembers where the marked glass went is no longer blind. If solo results run higher than results with a pourer, the shuffle is leaking; if they match, the shuffle is a valid way to test yourself.
What taking part means
Run triangle rounds on the same pair both ways over time: some with a pourer, some with the glass shuffle. Your triangle rounds, including which blinding mode each round used. The app has recorded the mode only since this study opened, so only rounds from then on are used.
To join: in the app, turn on research contribution in Settings → Research, then open Glass shuffle or pourer? under Research studies, read it, and agree. You can leave with one tap.
Hypotheses
- H1 (primary). For the same taster and pair, accuracy with the glass shuffle is equivalent to accuracy with a pourer, within ±10 percentage points.
Design
Observational, within-taster comparison of two blinding modes on the same pair.
Who can take part. Adults 21 or older in the United States who use Savorant, have research contribution turned on, and have joined this study in the app.
Outcomes
Primary. Per-taster difference in proportion correct, glass shuffle minus pourer, on the same pair.
Secondary and exploratory.
- Whether the mode used first affects the difference (exploratory; tasters choose their own order).
Sample size
35 tasters with at least 18 rounds in each mode on the same pair (TOST, margin 0.10, assumed standard deviation of the difference 0.20, α = 0.05, power 0.80, true difference 0: n = 34.3, rounded up). Recruitment target 50.
Analysis
Two one-sided tests (TOST) for equivalence with margins of ±10 percentage points, α = 0.05; mean difference reported with a 90% CI (the interval that matches TOST).
Only data filed after a taster joins is used.
When a study reports more than one secondary test, p-values are adjusted with the Holm method.
Limitations we know about
Tasters choose which mode to use and when, so modes are not counterbalanced, and practice on the pair may favor whichever mode comes later.
Standards every Savorant study follows
- Preregistration. This page is the protocol of record, versioned and dated, and is posted to the Open Science Framework (OSF) before any study data is analyzed. Hypotheses, outcomes, sample size and analysis are fixed here in advance.
- Primary and secondary outcomes. Each study names one primary outcome, tested at the stated alpha. Everything else is labeled secondary or exploratory and reported as such, with effect sizes and 95% confidence intervals rather than bare p-values.
- No peeking. No interim analysis of the outcomes. The only checks before the sample size is reached are for data quality (duplicates, impossible values), and they never look at results.
- Repeated measures. One taster contributes many rounds, so analyses use mixed-effects models with the taster as a random effect, or per-taster summaries, never pooled rounds treated as independent.
- Exact methods for small counts. Triangle results are analyzed against the exact binomial with chance at one in three, the way ISO 4120 sets out the triangle test, adapted here for repeated measures.
- Exclusions. Rounds are excluded only for the reasons listed in advance: test accounts, the founder’s accounts, rounds filed in a preview build, and duplicates. Every exclusion is counted and reported.
- Missing data. Tasters who stop early are kept for every analysis their data supports. The number who stop, and when, is reported.
- Deviations. Any change after data collection starts is logged on this page as a dated amendment with its reason, and reported in the paper.
- Reporting. Results are reported following the STROBE guideline for observational studies, with the analysis code published alongside.
- Conflict of interest. The study is run by the company that sells the app. Preregistration, publishing regardless of outcome, and public analysis code are how that interest is kept out of the result.
The consent you agree to
This is the exact text shown in the app before you join.
Amendments
- None. This is the first version of the protocol.
All open studies · The evidence review · Privacy policy · palate@savorant.com