Don’t Hype Analytics

Analytics
What if you could know someone's GPA just by simply looking at their phone? That's the first line spoken in this Dartmouth College video about their StudentLife study.  The problem with that line is that it starts to look like hype.  Like marketing.  Like a Buzzfeed clickbait article (apologies to Buzzfeed...it appears they are trying to go legit...I'll say it looks more like a Clickhole article).  I wanted to write this post to do two things: Commend the Dartmouth team on the work they've been doing Warn them not to add to the mountains of hype surrounding analytics and predictive modeling in ed tech The description of the study is wonderful.  They say: StudentLife is the first study that uses passive and automatic sensing data from the phones of a…
Read More

Regression vs. Machine Learning (ad infinitum)

Analytics, Models
I didn't invent statistics nor did I invent machine learning.  I'm not a published expert in either field.  However, I was on Jeopardy, so that's got to give me some street cred to be able to talk about the two techniques.  The discussion usually boils down to this -- regression is a more "pure" form of data analysis (where the causal relationship between the data and the outcomes are more clearly related) while machine learning is a more brute force approach to prediction (and other analyses).  I wanted to put my position out there and see what does or doesn't resonate with colleagues. There's a great Stack Exchange thread on this topic where many folks have chimed in with their take on the two approaches.  I've done a bit of…
Read More

No…Learning Is Not Like Madden

Analytics, Learning
I've previously written about sports analytics and parallels to learning analytics in higher ed.  So I was obviously excited to see this FiveThirtyEight article -- a behind-the-scenes writeup of the data behind player ratings in the Madden NFL video game.  With the 'gamification' thread that's picked up steam in higher ed over the last few years, it makes sense to keep an eye out for connections like this.  While there are definitely learnings between the gaming space and the learning space, there are also vast gaps that should not be glossed over.  Let me point out a few ways that learning is not like the Madden NFL game. 1. It's REALLY HARD (if not impossible) to simulate a learner .Let's unpack this statement by first talking about how Madden simulates players.…
Read More

Yes, I actually read the Tableau Online EULA

Analytics
I signed up for Tableau Online this week.  To understand why this was sort of a big deal for me, let me give you some background.  First, I love Tableau.  I've been a heavy user for over 5 years now.  If you do any sort of data wrangling, I urge you to give it a try.  While Excel is and has always been a great tool for exploring data, Tableau is in a whole different league.  It allows you to view/experience/feel/flip/play with data in so many ways with so little effort.  That's a huge advantage when you are trying to understand the story behind a data set.  The biggest tradeoff I've always claimed about Tableau is that it's a great analyst tool (for exploring data), but it's a poor enterprise…
Read More

I, for one, welcome our new analytics overlords

Analytics
Before I get into this post, I want to make sure that everyone gets the tongue-in-cheek nature of the post title and image, so please check the meme reference if you're not sure.  Now that I've got my implicit disclaimer out of the way, let's start by talking about sports analytics.  I'm a bit of a fanboy when it comes to sports analytics.  It's a mashup of two of my true passions.  I'm the data nerd who plays fantasy baseball and fantasy football every year.  I haven't been to the Sloan Sports Analytics Conference, but I'm sure I'll make it some day.  I'm a runner and I chart out my race times year over year.  I have a wi-fi enabled scale that tracks my weight.  If the Arizona Diamondbacks' Director of Analytics…
Read More

Context and Segmentation

Uncategorized
After the 2014 U.S. Midterm elections, the Daily Show aired a piece about how the elections looked in comparison to past results.  While observing how comments of the Democratic Party being in a shambles mirrored comments about the Republicans in 2012, Jon Stewart makes an aside remark about context: That joke was brought to you by context.  Context...look at how silly the world would be without context. This kind of biting sarcasm is a hallmark of the Daily Show, but it tends to be missing from higher education discussions (except on Twitter, of course).  The biggest bone I have to pick about the lack of context in higher ed has to do with student segmentation. To put it simply, there is no uniform definition of "a college student".  Now this may be…
Read More

Responsible vs. Accountable…the Retention Edition

Uncategorized
I'm going to do that thing where as a parent, I use something my kids do in order to make a point.  Since I have twin 12-year old identical girls, the topic of responsibility comes up a lot. My kid reference is about Nose Goes and a typical event looks like something this: 1) Dad kindly asks girls to clean their room 2) Girls play Nose Goes...both touch their noses at the same time and then stare at each other 3) Nobody cleans the room The takeaway is that I made the mistake of inferring that BOTH of the girls are responsible for cleaning their room.  This brings up the concept of responsibility vs. accountability.  Here's the context that I'm using for those two words.  'Responsible' means that the person or persons…
Read More

Monetize the Data :-(

Uncategorized
Yuck. I really don't like that phrase. I get it...especially in certain cases. Facebook gives users access to a free and (somewhat) valuable tool, so they have every right to use the data as they see fit (within ethical limits, of course). Where there is a reasonable expectation set between the user and the company about who does what with the data, there are definitely cases where companies can "monetize the data". But in educational technology? Nope. I think that's where companies really start to skirt the line. I've got a fair bit of involvement in the ed tech space. I've started my own analytics company, I network and partner with many technology companies, and I have advised other ed tech businesses. What I don't see is a model where…
Read More

Breaking down a post about Early Alerts

Uncategorized
Jim Ritchey at Delta Initiative posted a nice item about early alerts in Higher Ed.   I think he's spot in as to the questions and issues he raises. To that end, I wanted to break down his post and respond from Blue Canary's perspective.  Blue Canary has recently launched Lighthouse -- our early alert retention solution.  Read on for some insights: [line] "One solution component where it is difficult to evaluate benefits is early alert systems" Difficult, but not impossible.  It's hard to measure the benefits, but if you are adopting a solution, your vendor ought to be willing to work with you to show evidence of success [line] "Organizations are learning that how the score is calculated and what data the calculation uses is critical to effectively matching…
Read More

It’s So Simple, Anyone Can Use It!

Uncategorized
I dig infomercials.  Whether it's Tony Little, Billy Mays (R.I.P.), the Sham Wow guy, or the Godfather -- Ron Popeil, I've always been intrigued by their unabashed shamelessness in the face of overt consumerism.  As I think back to the great infomercials of the past, though, I draw a strong parallel between what these pitchmen/women do and what we do in the data & visualization space.  That parallel is around simplicity. The good infomercials realize that there needs to be a concise takeaway from the product demonstration: Ginsu knife: can cut a tin can and a tomato Matthew Lesko: the government is giving away free money Veg-o-Matic: it slices, it dices, it juliennes   Nevermind the veracity of the statements (or the relevance...how often does one need to julienne vegetables?).…
Read More