Non-standard Errors

Albert J. Menkveld, Anna Dreber, Felix Holzmeister, Juergen Huber, Magnus Johannesson, Michael Kirchler, Michael Razen, Utz Weitzel, David Abad, Menachem (Meni) Abudy, Tobias Adrian, Yacine Ait-Sahalia, Olivier Akmansoy, Jamie Alcock, Vitali Alexeev, Arash Aloosh, Livia Amato, Diego Amaya, James Angel, Amadeus BachEdwin Baidoo, Gaetan Bakalli, Andrea Barbon, Oksana Bashchenko, Parampreet Christopher Bindra, Geir Hoidal Bjonnes, Jeff Black, Bernard Black, Santiago Bohorquez, Oleg Bondarenko, Charles S. Bos, Ciril Bosch-Rosa, Elie Bouria, Christian T. Brownlees, Anna Calamia, Viet Nga Cao, Gunther Capelle-Blancard, Laura Capera, Massimiliano Caporin, Allen Carrion, Tolga Caskurlu, Bidisha Chakrabarty, Mikhail Chernov, William M. Cheung, Ludwig B. Chincarini, Tarun Chordia, Sheung Chi Chow, Benjamin Clapham, Jean-Edouard Colliard, Carole Comerton-Forde, Edward Curran, Thong Dao, Wale Dare, Ryan J. Davies, Riccardo de Blasis, Fany Declerck, Oleg Deev, Hans Degryse, Solomon Deku, Christophe Desagre, Mathijs A. van Dijk, Chukwuma Dim, Thomas Dimpfl, Yun Jiang Dong, Philip Drummond, Tom Dudda, Ariadna Dumitrescu, Teodor Dyakov, Anne Haubo Dyhrberg, Michał Dzieliński, Asli Eksi, Izidin El Kalak, Saskia Ter Ellen, Nicolas Eugster, Martin D. D. Evans, Michael Farrell, Ester Félez-Viñas, Gerardo Ferrara, El Mehdi Ferrouhi, Andrea Flori, Jonathan Fluharty-Jaidee, Sean Foley, Kingsley Y. L. Fong, Thierry Foucault, Tatiana Franus, Francesco A. Franzoni, Bart Frijns, Michael Frömmel, Servanna Fu, Sascha Füllbrunn, Baoqing Gam, Thomas Gehrig, Dirk Gerritsen, Javier Gil-Bazo, Lawrence R. Golsten, Thomas Gomez, Arseny Gorbenko, Ufuk Güçbilmez, Joachim Grammig, Vincent Gregoire, Björn Hagströmer, Julien Hambuckers, Erik Hapnes, Jeffrey H. Harris, Simon Hartmann, Jean-Baptiste Hasse, Nikolaus Hautsch, Xuezhong He, Davidson Heath, Simon Hediger, Terrence Hendershott, Ann Marie Hibbert, Erik Hjalmarsson, Seth A. Hoelscher, Peter Hoffmann, Craig W. Holden, Alex R. Horenstein, Wenqian Huang, Da Huang, Christophe Hurlin, Alexey Ivashchenko, Subramanian R. Iyer, Hossein Jahanshahloo, Naji Jalkh, Charles M. Jones, Simon Jurkatis, Petri Jylha, Andreas Kaeck, Arzé Karam, Egle Karmaziene, Bernhard Kassner, Markku Kaustia, Ekaterina Kazak, Fearghal Kearney, Vincent van Kervel, Saad Khan, Marta Khomyn, Tony Klein, Olga Klein, Alexander Klos, Michael Koetter, Jan Pieter Krahnen, Aleskey Kolokolov, Robert A. Korajczyk, Roman Kozhan, Amy Kwan, Quentin Lajaunie, F.Y. Eric C. Lam, Marie Lambert, Hugues Langlois, Jens Lausen, Tobias Lauter, Markus Leippold, Vladimir Levin, Yijie Li, (Michael) Hui Li, Chee Yoong Liew, Thomas Lindner, Oliver B. Linton, Jiacheng Liu, Anqi Liu, Guillermo Llorente, Matthijs Lof, Ariel Lohr, Francis A. Longstaff, Alejandro Lopez-Lira, Nicola Mano, Alexis Marchal, Charles Martineau, Francesco Mazzola, Debrah Meloso, Roxana Mihet, Vijay Mohan, Sophie Moinas, David Moore, Liangyi Mu, Dmitriy Muravyev, Dermot Murphy, Gabor Neszveda, Christian Neumeier, Ulf Nielsson, Mahendrarajah Nimalendran, Sven Nolte, Lars Nordén, Peter O'Neill, Khaled Obaid, Bernt Arne Ødegaard, Per Östberg, Marcus Painter, Stefan Palan, Imon Palit, Andreas Park, Roberto Pascual, Paolo Pasquariello, Lubos Pastor, Vinay Patel, Andrew J. Patton, Neil D. Pearson, Loriana Pelizzon, Matthias Pelster, Christophe Pérignon, Cameron Pfiffer, Richard Philip, Tomáš Plíhal, Puneet Prakash, Oliver-Alexander Press, Tina Prodromou, Tālis J. Putniņš, Gaurav Raizada, David A. Rakowski, Angelo Ranaldo, Luca Regis, Stefan Reitz, Thomas Renault, Rex Wang Renjie, Roberto Renó, Steven Riddiough, Kalle Rinne, Paul Rintamäki, Ryan Riordan, Thomas Rittmannsberger, Iñaki Rodríguez-Longarela, Dominik Rösch, Lavinia Rognone, Brian Roseman, Ioanid Rosu, Saurabh Roy, Nicolas Rudolf, Stephen Rush, Khaladdin Rzayev, Aleksandra Rzeznik, Anthony Sanford, Harikumar Sankaran, Asani Sarkar, Lucio Sarno, Olivier Scaillet, Stefan Scharnowski, Klaus Reiner Schenk-Hoppé, Andrea Schertler, Michael Schneider, Florian Schroeder, Norman Schürhoff, Philipp Schuster, Marco A. Schwarz, Mark S. Seasholes, Norman Seeger, Or Shachar, Andriy Shkilko, Jessica Shui, Mario Sikic, Giorgia Simion, Lee A. Smales, Paul Söderlind, Elvira Sojli, Konstantin Sokolov, Laima Spokeviciute, Denitsa Stefanova, Marti G. Subrahmanyam, Sebastian Neusüss, Barnabas Szaszi, Oleksandr Talavera, Yuehua Tang, Nicholas Taylor, Wing Wah Tham, Erik Theissen, Julian Thimme, Ian Tonks, Hai Tran, Luca Trapin, Anders Bjerre Trolle, Giorgio Valente, Robert A. Van Ness, Aurelio Vasquez, Thanos Verousis, Patrick Verwijmeren, Anders Vilhelmsson, Grigory Vilkov, Vladimir Vladimirov, Sebastian Vogel, Stefan Voigt, Wolf Wagner, Thomas Walther, Patrick Weiss, Michel van der Wel, Ingrid M. Werner, P. Joakim Westerholm, Christian Westheide, Evert Wipplinger, Michael Wolff, Christian C. P. Wolff, Leonard Wolk, Wing Keung Wong, Jan Wrampelmeyer, Shuo Xia, Dacheng Xiu, Ke Xu, Caihong Xu, Pradeep K. Yadav, José Yagüe, Cheng Yan, Antti Yang, Woongsun Yoo, Wenjia Yu, Shihao Yu, Bart Z. Yueshen, Darya Yuferova, Marcin Zamojski, Abalfazl Zareei, Stefan Ziesberger, S. Sarah Zhang, Xiaoyu Zhang, Zhuo Zhong, Z. Ivy Zhou, Chen Zhou, Xingyu Sonya Zhu, Marius Zoican, Remco C. J. Zwinkels, Jian Chen, Teodor Duevski, Ge Gao, Roland Gemayel, Dudley Gilder, Paul Kuhle, Emiliano Pagnotta, Michele Pelli, Jantje Sönksen, Lu Zhang, Konrad Ilczuk, Dimitar Bogoev, Ya Qian, Hans C. Wika, Yihe Yu, Lu Zhao, Michael Mi, Li Bao, Andreea Vaduva, Marcel Prokopczuk, Alejandro Avetikian, Zhen-Xing Wu

Publikation: Working paperForskning

Abstract

In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in sample estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence-generating process (EGP). We claim that EGP variation across researchers adds uncertainty: non-standard errors. To study them, we let 164 teams test six hypotheses on the same sample. We find that non-standard errors are sizeable, on par with standard errors. Their size (i) co-varies only weakly with team merits, reproducibility, or peer rating, (ii) declines significantly after peer-feedback, and (iii) is underestimated by participants.
OriginalsprogEngelsk
UdgivelsesstedOslo
UdgiverNorges Bank
Antal sider56
ISBN (Elektronisk)9788283792102
DOI
StatusUdgivet - 2022

Emneord

  • Non-standard errors
  • Multi-analyst approach
  • Liquidity

Citationsformater