Comments/todos/➰ breadcrumbs for Grant proposal for Synthesis Infrastructure - NSF CHS / SOS 2020
Draft section on "we don't have this stuff in practice and don't know how much it really works and under what conditions"
Tools generally are "iTunes for papers" @qianITunesPapersRedefining2019a - I think this is very fair
@bosmanInnovationsScholarlyCommunication2016 - can see by far most popular tools are "iTunes for papers":
Tool choice constrained by "extrinsic" factors like whether it's free or not, or overlap with collaborators' practices
most academic studies aren't set up to be able to evaluate these, because we need serious usage. on the flip sides, industry folks either aren't sharing data, or aren't collecting it
so we lack a good understanding, beyond weak circumstantial/anecdotal evidence of the value of these design patterns
Comment Joel Chan I think within the three objectives/RQs subsections (e.g., here) is where the theory stuff fits in most naturally. We give the intuition for the SOTA, and then we dive into the hypothesized benefits in more detail, discussing the theoretical backing and lack of empirical evidence.