
Is this your show? Claim this page
PodCred
The people behind this show
People get invited back because someone remembered they were great.
PodCred is the verified record of who made this show. A credit here means people who were there confirmed the work.
Hosts
Guests
Who is on this show?
Think of the guest you still think about. The producer who makes the host sound smart. The editor who saves every episode. If a name is missing here, that person is invisible everywhere.
Add a creditEpisodes
196 episodes196: Every public dataset is now a data ATM
We're back! After a long break, we catch up on why it's been so long: Dan's promotion and James's new venture capital gig at Helena where he can argue about science for a living. Then it's on to how much meta-science...
195: Living meta-analysis
We discuss how living meta‑analyses - meta‑analyses that are continuously updated as new studies appear - can cut research waste and keep evidence current. We also chat about how using synthetic research participants is...
194: Author verification
We discuss whether preprint servers and journals should require author identity verification for submitting manuscripts. This would probably speed up the submission process, but is this worth the potential downsides? We...
193: The pop-up journal
Dan and James chat about a a new 'pop-up journal' concept for addressing specific research questions. They also answer a listener question from a journal grammar editor and discuss a new PNAS article on paper mills...
192: Outsourcing in academia
Dan and James answer listener questions on outsourcing in academia and differences in research culture between academic institutions and commercial institutions. Social media links Dan on Bluesky James on Bluesky...
191: Cleaning up contaminated medical treatment guidelines
James and Dan discuss James' newly funded 'Medical Evidence Project', whose goal is to find questionable medical evidence that is contaminating treatment guidelines. Links James' blog post from last year The carthorse...
190: What happens when you pay reviewers?
We chat about two new studies that took different approaches for evaluating the impact of paying reviewers on peer review speed and quality. Links James' 450 movement proposal The paper from Critical Care Medicine The...
189: Crit me baby, one more time
Dan and James discuss a recent piece that proposes a post-publication review process, which is triggered by citation counts. They also cover how an almetrics trigger could be alternatively used for a more immediate...
188: Double-blind peer review vs. scientific integrity
Dan and James discuss a recent editorial which argues that double-blind peer review is detrimental to scientific integrity. Links The editorial from Christopher Mebane: https://doi.org/10.1093/etojnl/vgae046 Other links...
187: What started the replication crisis era?
We chat about the events that started the replication crisis in psychology and Dorothy Bishop's recent resignation from the Royal Society Links The resignation blogpost from Dorothy Bishop The bluesky post from Sarah...
186: Evaluating journal quality
In this episode we chat about a Nordic approach for evaluating the journal quality and how we should be teaching undergraduates to evaluate journal and article quality Links The Norwegian journal register The Finnish...
185: The Retraction
We discuss the recent retraction of a paper that reported the effects of rigour-enhancing practices on replicability. We also cover James' new estimate that 1 out of 7 scientific papers are fake. Links The story about...
184: A race to the bottom
Open access articles have democratized the availability of scientific research, but are author-paid publication fees undermining the quality of science? The preprint by Morgan and Smaldino -...
183: Too beautiful to be true
Dan and James discuss a paper describing a journal editor's efforts to receive data from authors who submitted papers with results that seemed a little too beautiful to be true Main edisode takeaways (AI generated...
182: What practices should the behavioural sciences borrow (and ignore) from other research fields?
Dan and James answer a listener question on what practices should the behavioural sciences borrow (and ignore) from other research fields. Here are the main takeaways: Keeping laboratory records and using electronic lab...
181: Down the rabbit hole
We discuss how following citation chains in psychology can often lead to unexpected places, and how this can contribute to unreplicable findings. We also discuss why team science has taken longer to catch on in...
180: Consortium peer reviews
Dan and James discuss why innovation in scientific publishing is so hard, an emerging consortium peer review model, and a recent replication of the 'refilling soup bowl' study. Other things they cover and links: Which...
179: Discovery vs. maintenance
Dan and James discuss how scientific research often neglects the importance of maintenance and long-term access for scientific tools and resources. Other things they cover: Should there be an annual limit on...
178: Alerting researchers about retractions
Dan and James discuss the Retractobot service, which emails authors about papers they've cited that have been retracted. What should authors do if they discover a paper they've cited has been retracted after they...
177: Plagiarism
We discuss two recent plagiarism cases, one you've probably heard about and another that you probably haven't heard about if you're outside Norway. We also chat about the parallels between plagiarism and sports doping -...
176: Tracking academic workloads
We chat about a paper on the invisible workload of open science and why academics are so bad at tracking their workloads. This episode was originally recorded in May 2023 in a hotel room just before our live recording...
175: Defending against the scientific dark arts
We chat about a recent blogpost from Dorothy Bishop, in which she proposes a Master course that will provide training in fraud detection - what should such a course specifically teach and where would these people work...
174: Smug missionaries with test tubes
James proposes proposes a new type of consortium paper that could provide collaborative opportunities for researchers from countries that are underrepresented in published research papers. We also talk about...
173: How do science journalists evaluate psychology papers?
Dan and James discuss a recent paper that investigated how science journalists evaluate psychology papers. To answer this question, the researchers presented science journalists with fictitious psychology studies and...
172: In defence of the discussion section
Dan and James discuss a recent proposal to do away with discussion sections and suggest other stuff they'd like to get rid of from academic publishing. Links The paper on the proposed elimiation of the discussion...
171: The easiest person to fool is yourself (with Daniel Simons and Christopher Chabris)
We chat with Daniel Simons and Christopher Chabris about the science of cons and how we can we can avoid being taken in. We also cover the fate of the gorilla suit from the 'invisible gorilla' study, why scientists are...
170: Holy sheet
We discuss evidence of data tampering in a series of experiments investigating dishonesty revealed via excel spreadsheet metadata and how traditional peer review is not suited for the detection of data tampering. Links...
169: Using big data to understand behavior (Live episode with Sandra Matz)
In our first ever live and in-person episode, we chat with Sandra Matz about the opportunities and challenges for using big data to understand human behavior Links Everybody lies book, by Seth Stephens-Davidowitz A...
168: Meta-meta-science
Dan and James discuss a new paper that reviews potential issues in metascience practices. They also talk about their upcoming live show in May in Frankfurt. Links Our upcoming show on May 8th, which will be a part of...
167: Diluted effect sizes
Dan and James chat about a new study that uses homeopathy studies to evaluate bias in biomedical research, a new-ish type of authorship fraud, and the potential for Chat GPT peer-review. Links The Chat GPT paper library...
166: Is science becoming less disruptive over time?
Dan and James discuss a recent paper that claims that science is becoming less disruptive over time and the suggested causes for this decline. Links Our prior episode, which discussed PhD defences The paper on...
165: Self-promotion
Dan and James chat about self-promotion in academia, how they both wish they had doctoral defences (these aren't a thing in Australia), and replacing error bars with the letter "t". Links and stuff The now retracted...
164: The great migration
James and Dan discuss the recent migration of scientists from Twitter to Mastodon and the pros and cons of sharing the prior submission history of manuscripts The Mastodon thread discussion the submission history policy...
163: eLife's new peer review model
Dan and James discuss eLife's new peer review model, in which they no longer make accept/reject decisions at the end of the peer-review process. Instead, papers invited for peer review will receive an assessment from...
162: Status bias in peer review
We chat about a recent preprint describing an experiment on the role of author status in peer-review, dodgy conference proceedings journals, and authorships for sale. Links James' blogpost on conference proceedings...
161: The memo (with Brian Nosek)
Dan and James are joined by Brian Nosek (Co-founder and Executive Director of the Center for Open Science) to discuss the recent White House Office of Science Technology & Policy memo ensuring free, immediate, and...
160: Whistleblowing
Dan and James share ten rules for whistleblowing academic misconduct. The Safe Faculty Project website SLAPP statues https://en.wikipedia.org/wiki/Strategic_lawsuit_against_public_participation Other links Everything...
159: Peer review isn't working (with Saloni Dattani)
Dan and James are joined by Saloni Dattani for a chat about the history of peer review, a reimagination of what peer review could look like, what happens when you actually pay peer reviewers, peer reviewer...
158: Word limits
By popular demand, Dan and James chat about journal word and page limits.They also the debate around a recent meta-analysis on nudge interventions. Links The PNAS nudge meta-analysis The response letter The paper on...
157: Limitations
Dan and James discuss a new preprint that examined the types of limitations authors discuss in their published articles and whether these limitation types has changed over the past decade, especially in light of...
156: Looking for seeders
Dan and James discuss a recent paper that concluded (again) that most researchers aren't compliant with their published data sharing statement and whether torrents (remember them?) are a viable alternative for sharing...
155: Don't you know who I am?
We chat about appeals to authority when responding to scientific critique, university ranking systems, Goodhart’s law (and its origin), and private institutional review boards. Links The history of Goodhart's law The...
154: When the evidence is constructed around the narrative
We chat about the Theranos story and the parallels with academic research, as well as Twitter's new owner and whether academics will actually leave the platform Links Mastodon (the band) Elon Musk’s Onion article The...
153: Shame shame shame
We discuss a journal's new "wall of shame" page, which details unethical behaviours in an effort to discourage future misconduct. We also cover scientific ideas that won't die (but one idea that HAS died), and ECNP's...
152: Sorry Not Sorry
James and Dan chat about apologies vs. non-apologies, how to decide when to call it quits on a paper, and governments vetoing research proposals recommended by their own funding agencies Links for stuff we mention The...
151: The dirty dozen
Dan and James discuss a new preprint that details twelve p-hacking strategies and simulates their impact on false-positive rates. They also discuss the Great Resignation in academia and the academic job market. Links...
150: Why can't you do nothing?
We discuss the latest paper to seriously use the Kardashian index, which is the discrepancy between a scientist's publication record and social media following, and a listener question on whether original authors should...
149: Medical misinformation (with Rohin Francis)
Dan and James chat with cardiologist Rohin Francis about medical misinformation and how he uses YouTube for science communication via his 'Medlife Crisis' channel. Links to stuff that was mentioned: Rohin's YouTube...
148: Academic reference letters
Dan and James chat about why academic reference letters are terrible, a recent position statement on preprints, and whether the "great resignation" is also happening in academia. Links to stuff that was mentioned: The...
147: The $7000 golden ticket
We discuss the $7000 'accelerated publication' option for some Taylor & Francis journals that promises 3-5 week publication and a novel type of research fellowship. Details for the accelerated publication The New...
146: Skills pay bills
We answer a series of questions from a listener on whether to start a PhD, what to ask potential supervisors, the financial perils of being a PhD student, the future of higher education, the importance of skills, what...
145: Our boat is sinking slightly slower
We discuss the results from the cancer biology reproducibility project, the inevitable comparisons with reproducibility in psychology, and authorship expectations for posting public datasets. Links The paper...
144: The role of luck in academia
If your child asked you whether they should pursue a career in academia, what would you say? We discuss this question plus three more quick-fire topics: the death of expertise, memorable presentations, and including...
143: A little less conversation, a little more action
Dan and James discuss the differences between 'talk' and 'action' in scientific reform and why reforms are taking such a long time to be realised. They also chat about whether messy (but correct) code is worse than no...
142: Red flags in academia [Live episode]
In this live episode, Dan and James discuss red flags in academia, in terms of research fields, papers, and individuals. Thanks to everyone that participated in this live event! Links to stuff that was mentioned Get a...
141: Why we should diversify study samples (with Sakshi Ghai)
We chat with Sakshi Ghai (University of Cambridge) about why we should diversify sample diversity and retire the Western, educated, rich, industrialized and democratic (WEIRD) dichotomy in the behavioral sciences Links...
140: You can’t buy cat biscuits with ‘thank you’ emails
James proposes that peer review reports should be published as their own citable objects, provided that the manuscript author thinks that the peer review report is of sufficient quality and the peer reviewers agree...
139: Open science from a funder's perspective (with Ashley Farley)
We chat with Ashley Farley about her background as an academic librarian, the underrecognised importance of copyright in academic publishing, and her work as a Program Officer at the Gates Foundation An academic...
138: Preprints in the time of coronavirus (with Michele Avissar-Whiting)
We chat with Michele Avissar-Whiting about her role as the Editor-in-chief of the Research Square preprint platform and how she weighs up the benefits and costs of potentially problematic preprints during a pandemic....
137: Ten rules for improving academic work-life balance
Dan and James share their thoughts on a recent paper that proposes ten rules for improving academic work-life balance for early career researchers and the figure from this paper that became a meme. Here are the rules:...
136: Who peer-reviews the peer-reviewed journals?
We discuss Journal Reviewer (journalreviewer.org), which is a website that provides a forum for researchers to share and rate their experiences with journal's peer review processes. We also cover how some journals...
135: A loss of confidence
Dan Quintana and James Heathers chat about well-known psychology studies that we've now lost confidence in due to replication failures and the role of auxiliary assumptions in hypothesis-driven research. Other links The...
134: Paywalled questionnaires
We discuss a recent retraction triggered by the authors not paying a copyright fee to use a questionnaire (that also happened to be critical of the original questionnaire). Links for stuff that we mention: The paper...
133: Manuscript submission fees
Some journals use nominal manuscript submission fees to discourage frivolous submissions. However, it has been suggested that increasing submission fees could reduce article processing charges. Dan and James discuss...
132: Post-pandemic academia
Dan and James discuss how academia should operate in a post-pandemic world. What pandemic practices should we keep and what should we abandon? Links and details: Quiz: Norwegian metal band or Norwegian town? Things are...
131: Long live the overhead projector!
Dan and James answer listener audio questions on indirect costs for research grants, the mind/body problem, and why many academics aren't trained to teach. They also profess their love for the overhead projector Some...
130: Normalizing retractions (with Dorothy Bishop)
Dan and James chat with Dorothy Bishop (University of Oxford) about the importance of normalizing the retraction of scientific papers, publication ethics, and whether paper mills (companies that make fake papers at...
129: Transparency audits
Dan and James discuss the recently proposed "transparency audit", why it received so much blowback, and the characteristics of successful reform schemes The specifics... The computational research integrity conference...
128: How do you generate new research ideas?
Dan and James chat about how they come up with new ideas, why everyone seems to be trying to monetise their hobbies, and why it's so hard for most labs to have a singular focus of research. We had some problems with...
127: Speak up or shut up?
We discuss when is the right time in your academic career to begin speaking up to critique your research field or whether the risk of retaliation means you should shut up and keep your head down. This was a recorded...
126: The division of scientific labor (with Saloni Dattani)
We have a wide-ranging chat with Saloni Dattani (Kings College London and University of Hong Kong) about the benefits of dividing scientific labor, the magazine she co-founded (Works in Progress) that shares novel ideas...
125: Upon reasonable request
Dan has a blue-sky proposal to increase data sharing - that funders mandate scholars to store and analyse data on their servers for which the funder decides what constitutes a reasonable data request (among other...
124: From Ptolemy to Takeshi's Castle
We discuss under which circumstances retracting decades-old articles is worth the time. We also chat about why LinkenIn is underrated (yes, really) and special journal issues are overrated. A more specific list of...
123: Authenticated anonymity (with Michael Eisen)
Part two of our chat with Michael Eisen (eLife Editor-in-Cheif), in which we discuss the pros and cons of collaborative peer review, journal submission interfaces, Michael's take on James' proposal that peer reviewers...
122: Reoptimizing scientific publishing for the internet age (with Michael Eisen)
The internet should have transformed science publishing, but it didn't. We chat with Michael Eisen (Editor-in-Chief of eLife) about reoptimizing scientific publishing and peer review for the internet age. Here what we...
121: Transparent peer review
Dan and James discuss the pros and cons of transparent peer-review, in which peer review reports are published alongside manuscripts, as a keynote feature at the recent Munin Conference on scholarly publishing. Here's...
120: How false beliefs spread in science (with Cailin O'Connor)
Dan and James chat with Cailin O'Connor (University of California, Irvine) about the how false beliefs spread in science and remedies for this issue Here's what they cover: Why should psychologist scientists learn about...
119: Rules of thumb
Dan and James discuss how rules of thumbs in science, such as those often applied to sample sizes and effect sizes, lead to mindless research evaluation. More info and links: Is there any justifcation for holding back...
118: Evidence-free gatekeeping
Dan and James answer audio listener questions on the worst review comments they've received (and how the responded), their thoughts on the current state of preprints, and how institutional prestige influences researcher...
117: How we peer-review papers
Dan and James choose a preprint and walk through how they would peer-review it. James also provides an update on his recent proposal that scientists should be paid for performing peer reviews for journals published by...
Posts
No posts yet. Posts Everything Hertz shares on PodSubs, and what it publishes on Substack, YouTube and its own site, will show here.

Subscribe
Be on the front line of the show
Everything Everything Hertz sends its own people, first. Resources, announcements, behind the scenes, events, and giveaways, straight from the host. No account needed.
- The resources the host shares with subscribers
- Announcements before anyone else hears
- Behind the scenes from the team
- Events, invitations, and giveaways
- Only what the host sends, nothing else
Audio and video play straight from the show's own hosting. PodSubs stores and serves no media.
















