Background | Background (frozen expected-count estimator) | Linking implementations | Simulation | Fitting human and LLM models | Applying the three methods | Parameter alignment after linking | TCC alignment | Gradient asymmetry: what linking fixes and what it does not | Lambda sweep: how $\lambda$ interacts with linking quality | The role of power tuning | Validation: what does $\lambda^*$ measure? | Test A — Perfect paired surrogate ($F = Y$) | Test B — Partially overlapping predictions | Test C — Stochastic LLM predictions (practical baseline) | Summary: PPI++ score vs. ability risk | Summary of findings | Recommendation | The marginal-MML fix

Simulate a 1PL test | Step 1: Fit the 1PL baseline | Step 2: Fit mixed-subjects MML (1PL) | Step 3: Correct covariance — $(J+1) \times (J+1)$ sandwich | Step 4: Ability-score risk and lambda tuning | Step 5: Verify — F = Y gives lambda > 0 | Compare 1PL and 2PL | Ability-score risk: 1PL vs 2PL parameterization

Simulate example data | Step 1: Fit the human baseline | Step 2: Fit the MML mixed-subjects model | Step 3: Select $\lambda$ by ability-score risk | Step 3b (recommended workflow): cross-fit $\lambda$ tuning | Step 4: Inspect the covariance | Compare calibrations | When the LLM is uninformative | Validation

Why per-item lambda? | Simulate a heterogeneous test | Step 1: Fit 2PL baseline and get global scalar lambda | Step 2: PPI++ score per item (fast diagnostic) | Step 3: Per-item ability-risk tuning | Step 4: Compare scalar vs. per-item parameter recovery | Important note on initialization | Approximation caveat

No exposure controls | RMSE of person abilities | Restricting item exposure | Visualizing the adjacency matrix

What a data loader returns | The resp object | The pers_tru object | The item_tru object | Function arguments | The bundled 1PL loader | A note on random seeds

The simulation state | Data loaders | Item selection functions | Parameter update functions | Putting it together | Checklist

Function signature | Bundled selectors | Sequential | Random | Maximum information | Network distance | Writing a custom selector | Best practices

Function signature | Bundled updaters | Maximum likelihood ability estimation | Elo-style updates (Maths Garden) | Paired Elo updates (Prowise Learn) | Best practices

Mathematical foundation | Implementation in meow | Using it | Extending the algorithm | Practical notes

Mathematical foundation | Edge weight strategies | Implementation | Using different edge weight strategies | Choosing a strategy | Considerations

Mathematical foundation | Implementation in meow | Using it | Practical notes

The setup | Naive pooling inherits the bias | $\lambda$ moves efficiency, not bias | Choosing $\lambda$ | Takeaways | Reproducing

Two objectives, two estimators | Example data | Ability-risk tuning: Minimizing $\mathbb{E}[g'\Sigma_\gamma g]$ | Cross-fit $\lambda$ tuning (recommended workflow) | Frozen expected-count estimator (fast approximation) | Minimizing $\text{Tr}\big[\Sigma_\gamma\big]$ (diagnostic only) | Choosing a procedure

Design | Does $\lambda$-selection track predictor quality? | Do standard errors achieve appropriate coverage? | Does the method improve downstream scoring? | What is the role of cross-fitting? | Is coverage valid at the tuned $\lambda$? | Summary | Reproducing these results

Why this vignette exists | Key Intuition | The three response matrices | 1. Observed human responses: $O$ | 2. Paired LLM-predicted human responses: $P$ | 3. Additional LLM-generated responses: $G$ | The mixed-subjects IRT objective | What lambda is learning | $$L_O^ | Ability-risk tuning | The approximate target is$$\widehat R(\lambda) | Why row alignment matters | Case A: perfect paired prediction | $$\lambda_ | \frac | Case B: row-shuffled perfect predictions | Case C: same DGP, fresh Bernoulli draw | $$\operatorname{Cov}(O_{ij},P_{ij}) | $$\operatorname{Var}(P_{ij}) | What kind of LLM data produces higher lambda? | One approach to row alignment: leave-one-item-out prediction | Another approach: covariate-based prediction | Something that probably won't work: item-text-only generation | How to generate $G$ | Summary | Technical Explanation | Overview: four objects, one objective | 1. The estimator and its estimating equation | 2. The sandwich covariance of $\hat\gamma$ | 3. Ability scoring and the implicit gradient | 4. Delta-method propagation and the risk | 5. Why this differs from the PPI++ trace objective

Overview | Simulation Engine | Scenario 1: Poor Predictions — DiM Wins | Scenario 2: Negatively Correlated Predictions | Scenario 3: Heterogeneous Prediction Quality — Double-Tuned Wins | Scenario 4: High Common-Mode Error | Scenario 5: Common-Mode Error + Heterogeneous Quality | Scenario 6: Near-Perfect Predictions | Summary Table

Overview | Why Mixed-Subjects Designs? | What This Package Does | Installation | A Quick Example | Simulating Experimental Data | Creating an MSD Data Object | Estimating the Treatment Effect | Understanding the Data Structure | What Data Do You Need? | Two Types of Predictions | Creating Your Data Object | Flexible Column Names | Formula Interface | The Seven Estimators | 1. Difference-in-Means (DiM) | 2. GREG (Calibration Estimator) | 3. PPI++ (Power-Tuned) | 4. D-T (Doubly-Tuned) | 5. DiP (Difference-in-Predictions) | 6. DiP++ (Power-Tuned DiP) | 7. D-T DiP (Doubly-Tuned DiP) | Comparing All Estimators | Choosing the Right Estimator | Decision Tree | When to Use DiP-Type Estimators | Variance Estimation | Delta-Method (Default) | Bootstrap (Optional) | Optimal Experimental Design | The Design Problem | Using optimal_design() | Interpreting the Results | Comparing Designs | Practical Workflow | Step 1: Pilot Study | Step 2: Estimate Prediction Quality | Step 3: Plan Your Main Study | Step 4: Run the Main Study | Step 5: Analyze and Report | Common Questions | Q: What if my LLM predictions are biased? | Q: How much do predictions need to correlate with outcomes? | Q: Should I use cross-fitting? | Q: What if predictions are worse in one treatment arm? | Q: How many folds should I use for cross-fitting? | Q: Can I use predictions from multiple LLMs? | Technical Details | Assumptions | Variance Formulas | Citation | Session Info