Rubin Observatory staff will need to routinely generate a variety of survey simulations, metrics, plots, and other diagnostics to monitor automated observing, evaluate survey strategy and scheduler performance, and understand the current state and progress of the Legacy Survey of Space and Time (LSST), while also communicating this progress and state to a variety of interested parties outside the project (including science collaborations, funding agencies, and the general public). This technote lays out an initial list of use-cases, including the simulations, diagnostics and metrics needed for these evaluations.