Outdated very biased retrospective meta analysis selecting a small subset of studies, with a majority of results based on only 1 or 2 studies, showing positive (non-statistically significant) results for 10 of 11 primary outcomes across a total of 13 studies.
This analysis splits up studies in order to dilute the effects and avoid statistical significance. However, we can consider the probability of 10 of 11 positive effects occurring due to chance for an ineffective treatment, which is very unlikely (0.006), indicating efficacy.
The study is entirely retrospective in the current version. The protocol is dated April 20, 2021, and the most recent study included is from March 9, 2021. The protocol was modified after publication in order to include a close to null result (Gonzalez et al. "patients discharged without respiratory deterioration or death at 28 days"), so the current protocol is dated July 28, 2021. The analysis may become partly prospective in the future if the authors do not continue to change the protocol.
Authors excluded many studies by requiring results at a specific time, for example mortality, ventilation, etc. required results at exactly 28 days. Authors excluded all prophylaxis studies by requiring results at exactly 14 days.
Studies comparing with other medications were excluded, however these studies confirm efficacy of ivermectin. The only case where they could overstate the efficacy of ivermectin is if the other medication was harmful. There is some evidence of this for excessive dosage/very late stage use, however that does not apply to any of the studies here.
Studies using combined treatment were excluded, even when it is known that the other components have little or no effect. 3 of 4 RCTs with combined treatment use doxycycline in addition [1].
Other studies were excluded by requiring PCR confirmation.
Cochrane was reputable in the past, but is now controlled by pharmaceutical interests. For example, see the news related to the expulsion of founder Dr. Gøtzsche and the associated mass resignation of board members in protest [2]. For another example of Cochrane bias see [3].
Authors report funding from the German Federal Ministry of Education and Research, which may be influenced by [4].
Bias due to funding is ignored for both analyzed studies and Cochrane. For Cochrane funders see: [5, 6].
The BiRD group gave the following early comment: "Yesterday’s Cochrane review surprisingly doesn’t take a pragmatic approach comparing ivermectin versus no ivermectin, like in the majority of other existing reviews. It uses a granular approach similar to WHO’s and the flawed Roman et al paper, splitting studies up and thereby diluting effects. Consequently, the uncertain conclusions add nothing to the evidence base. A further obfuscation of the evidence on ivermectin and an example of research waste. Funding conflicts of interests of the authors and of the journal concerned should be examined."
Popp et al., 7/28/2021, preprint, 8 authors.