Comparing the length of post-publication peer reviews in F1000 Research to those done pre-publication in four major medical journals shows authors are less likely to receive constructive or substantial criticism with F1000 Research reviews, despite a highly academic reviewer pool.