At the New England Area Conference, I had the chance to sit in on a thought-provoking session titled “Got Data?” led by Dr. Miko Nino from Rhode Island College. As someone who’s always looking for ways to enhance instruction and program design through data, this session was right up my alley. If you’ve seen Moneyball, you already know how powerful data can be—it even revolutionized baseball. So why not use that same power in education and program development?
Here are my key takeaways from this insightful session.
🔍 Rethinking What Counts as Data
Dr. Nino kicked off the session by challenging our assumptions about data. We often think of data as consisting solely of numbers, charts, and metrics. But there’s more:
- Heat maps on websites indicate where users tend to focus their attention.
- GPS data reveals patterns in behavior, like the 80/20 rule of road usage—80% of traffic occurs on just 20% of roads.
- Usability testing and engagement tracking can provide rich insights beyond simple numbers.
🧠 Key Insight:
Not all data is numerical—insights can come from behavior, movement, and interaction patterns too.
🛠️ Build Data Into Program Design from the Start
Too often, data collection is tacked on at the end of a program. Dr. Nino emphasized the importance of integrating data collection throughout the entire lifecycle of a program—from needs assessment to evaluation.
🔁 Data Should Be:
- Embedded in your workflow—not an afterthought.
- Simple and automatic—data should be collected as a byproduct of what you’re already doing.
📈 Data-Driven Program Lifecycle
Dr. Nino mapped out how data plays a role at every phase of a program:
1. Needs Assessment
Ask yourself:
Do we really need this program?
- Use internal surveys and performance metrics.
- Leverage external sources like the Bureau of Labor Statistics.
- Triangulate data using surveys, reports, and industry research.
2. Program Design
Use data to shape learning experiences:
- A/B Testing. Identify which instructional methods work best.
- Learning Analytics. Personalize learning paths based on user behavior.
- AI & Personas. Utilize data to segment your audience by modality preference (face-to-face, hybrid, online).
3. Delivery & Engagement
Track:
- Engagement Rates. Are learners completing the course?
- Assessment Results. Are questions or content unclear?
- Content Performance. Are learners interacting meaningfully?
I found a strong parallel here with my own work on Mastery Through Quizzing—exam results reveal instructional weaknesses or flawed assessments.
4. Evaluation & Impact
Define success before you start:
- What metrics will show that your program worked?
- How do you track improvement, performance, or even profitability?
🚧 Barriers to Using Data
While the promise of data is compelling, there are real challenges:
- Data Overload. Too many metrics without direction.
- Siloed Systems. Departments hoarding data instead of collaborating.
- No Clear Purpose. Collecting data with no idea how it will be used.
📝 Takeaway: Only collect data if you know how you’ll use it. Start with your desired report, then design your form.
🧭 Action Plan: Making Data Work for You
Dr. Nino wrapped up with a practical plan for using data effectively:
- Start small.
- Clarify your objectives.
- Conduct a data audit. What do you already have?
- Identify tool gaps. What do you still need?
- Implement, assess, and iterate.
This mirrors what I’ve long advocated in instructional design: build a foundation, make improvements, and continually tweak based on evidence.
🧠 Final Thoughts
This session served as a timely reminder: data isn’t just something you collect at the end. It’s a powerful driver of program design, implementation, and impact.
If you’re not already leveraging data at every stage of your programs, you’re likely missing out on major opportunities for improvement.
Let’s not just do the work. Let’s measure it, refine it, and improve it—continuously.
💬 What’s Your Data Strategy?
Are you integrating data into your design from the start? What metrics matter most to you? Drop your thoughts in the comments or connect with me on LinkedIn to continue the conversation.
Photos by Lukas and Antoni Shkraba Studio
