Anil Dash asked people what their favorite file format was. David Robinson replied: CSV is similar to Markdown. No one global standard (though there are attempts) but a damn good attempt at "Whatever humans think it is at a glance, they're probably right" — David Robinson (@drob) February 8, 2018 His tweet reminded me a lot of this tweet from Stephen Turner In defense of Fahrenheit pic.twitter.com/qwDcBm0XVr — Stephen Turner (@strnr) February 20, 2015 There is a spectrum for tools from the theortically optimal to the most human usable.
In this post I describe the dslabs package, which contains some datasets that I use in my data science courses. A much discussed topic in stats education is that computing should play a more prominent role in the curriculum. I strongly agree, but I think the main improvement will come from bringing applications to the forefront and mimicking, as best as possible, the challenges applied statisticians face in real life. I therefore try to avoid using widely used toy examples, such as the mtcars dataset, when I teach data science.
Editor’s note: For the last few years I have made a list of awesome things that other people did (2016,2015, 2014, 2013). Like in previous years I’m making a list, again right off the top of my head. If you know of some, you should make your own list or add it to the comments! I have also avoided talking about stuff I worked on or that people here at Hopkins are doing because this post is supposed to be about other people’s awesome stuff.
Note: This post was originally published as part of a collection of discussion pieces on David Donoho’s paper. The original paper and collection of discussions can be found at the JCGS web site. Professor Donoho’s commentary comes at a perfect time, given that, according to his own chronology, we are just about due for another push to “widen the tent” of statistics to include a broader array of activities. Looking back at the efforts of people like Tukey, Cleveland, and Chambers to broaden the meaning of statistics, I would argue that to some extent their efforts have failed.
I like all of CGP Grey’s videos but most of them have to do with voting systems and so aren’t really relevant to this blog. But his latest video titled “How Do Machines Learn?” is highly relevant and I thought very well done. That said, although the animations of the robots were very cute and helped to tell the story, I found them a bit disconcerting in a way that I can’t quite explain.
A quick followup to Rafa’s analysis of the death toll from Hurricane Maria, from Axios: Puerto Rican Governor Ricardo Rosselló ordered a recount Monday of every death on the island since Hurricane Maria made landfall on September 20, as evidence continues to show that the official death toll grossly undercuts the true number, reports the New York Times. There are at least two ways to do this. One way is inferential in nature, taking a look at what we might expect the mortality to be and looking at what was observed.
Sometimes, when you’re recording a podcast, it’s actually difficult to listen. That’s because while you’re recording you’re monitoring the network lag, the sound levels, the show notes, and the outline. On some episodes I’m just barely hanging on by a thread. While Hilary Parker and I were recording Episode 50 of Not So Standard Deviations we had a discussion about her experience doing A/B testing at Etsy and how one experiment, which involved showing customers their passwords as they typed them, resulted in an increase in the number of failed login attempts, which was not what they were expecting.
This post by Kristian Lum is incredibly brave. It points out some awful behavior by people in our field and should be required reading for everyone. It took a lot of courage for Kristian to post this but we believe her, think this is a serious and critical issue for our field, and will not tolerate this kind of behavior among our colleagues. Her post has aleady inspired important discussions among the faculty at Johns Hopkins Biostatistics and is an important contribution to making sure our field is welcoming for everyone.
A recent preprint by Alexis R. Santos-Lozada and Jeffrey T. Howard concludes that The mortality burden may [be] higher than official counts, and may exceed the current official death toll by a factor of 10. The authors used monthly death records from the Puerto Rico Vital Statistics system from 2010 to 2016. Although data for 2017 was apparently not available, they extracted data from a statement made by Héctor Pesquera, the Secretary of Public Safety:
I read two blog posts on AI over the Thanksgiving break. One was a nice post discussing the challenges for AI in medicine by Luke Oakden-Rayder and the other was about the need for increased focus on basic research in AI motivated by AlphaGo by Tim Harford. I’ve had a lot of interactions with people lately who want to take advantage of machine learning/AI in their research or business. Despite the excitement around AI and the exciting results we see from sophisticated research teams almost daily - the actual extent and application of AI is much smaller.