Club Admiralty

v7.2 - moving along, a point increase at a time

Multilitteratus Incognitus

Pondering what to learn next 🤔

Measuring Learning

I know... I know... This is perhaps a tricky question to answer, but bear with me here, Perhaps the answer to this question of "how do we measure learning" is "well, d'uh! with some sort of test or assessment".  This might be true in one-off training, you visibly see employees either performing or not performing, but when it comes to a higher education context what does it mean to have been badged, branded, certified (whatever the term you use) as having had an education?  In Higher Education we measure "learning" through a credit hour system. But what the heck does that mean? Well, I know what it means and its history, but how the heck does that connect to learning?

There are three critical incidents that got me thinking about this today.  First is a conversation I had with a prospective student for my day-job. The person who was inquiring about our program was asking about how many weeks our courses run each semester.  When I informed them that our programs run on a semester-basis and run for 13 weeks, this person was perplexed as to why the courses were 3 credits and not 5. This in turn perplexed me, which opened the door for an interesting mental exercise.  The potential student, it turns out, is used to a 8-week course structure for 3 credits, and so, they rightfully assumed that all schools do the same thing. There was also a good assumption (a folk explanation, but good for the amount of data that they had), that credits are based on the number of weeks a course runs.

For those who don't know, in the US the definition of a credit hour is a minimum of 3 hours of student effort per week for 15 weeks for 1 college credit). This means that a 3 credit course will require a minimum effort on the part of learners of 135 hours for each 3-credit course.  This, however, is the minimum.  A more realistic amount of effort is 4 hours of effort for each credit, which makes the total hours per 3-credit course 180 hours.  Now, your mileage may vary.  If you are taking a course in which you already know some stuff, your hours may be less.  If you are wicked smaht it might take less.  If you are like me (going off on tangents to explore interesting things) it might take more.  That said, the definition in the US ultimately boils down to the number of hours a student has put in some effort for those credits.  So, a 30-credit graduate degree from my department is something like 1400 hours - assuming you put in the minimum amount of time during class, and throw in some token time to study for your comprehensive exams. A bit short of Gladwell's 10,000 hour rule, but getting there ;-)

When I was an undergraduate, and even a graduate student, I didn't give this any thought.  I needed something like 120 credits for my undergraduate, and anywhere between 30-credits and 54-credits for my each graduate degree I earned.  I never really thought about what those credits meant, just that I needed them.  Courses were assigned a certain amount of credits, so I just scratched off courses from my list like a prison inmate at times.  My graduate degrees it didn't feel that bad, but my undergrad felt like I needed to put in my time.  Once those courses were done I banked my credits and moved onto the next course. Being now where I find myself, as a college lecturer, and a graduate program manager, what credits mean, and how to measure learning is much more important to me than when I was a student (ironic, eh?)

This whole situation reminded me of something that happened at work last year (incident #2). One of our alumnae was applying for a PhD program in Europe (#woot!) and she needed a document from us certifying she had completed a certain amount of graduate-level hours for her Masters degree in Applied Linguistics.  I was expecting to be able to do get some sort of US to ECTS conversion calculator and be done with it, but it was more complicated than that.  Europe also runs on a credit system as well.  Doing a little digging on the interwebs Masters programs are rated anywhere between 30-60 ECTS.  One ECTS, at least in Spain, is 25 hours of effort (Greece is 30), so the range of hours of effort for a European MA vary between 750 and 1500 hours.  This is still based on effort put in, and not real actual learning.  Students are still banking credits like I did.

Then, the third incident was a few weeks ago when I blogged about Campus Technology, one of the keynotes for this year, and competency based education. This isn't the first time there was something about Competency Based Education at a Campus Tech conference keynote,  A few years back there was a keynote by someone from Western Governors University.  The CBE model doesn't seem to be based on time spent on task, or effort put in by students. To some extent it seems to be more connected to what students can do rather than how much time is spent doing it.  That said, I am still left wondering how we go about measuring learning, measuring what students have learned so we can accurately certify them with confidence. This way we are reasonably assured that we have done our due diligence to prepare minds for the world outside of our own sphere of influence?

Even with the CBE model, it seems to me that there is a certain degree of banking that is going on.  I've gone through, I've completed x-many courses, I still have y-many courses left to complete to get my degree in Z. It seems to me that the discussions around curriculum are still constrained on the notion that undergrad degrees look like xyz, and they require abc of effort.  MA degrees, regardless of discipline, look like xyz, and they require abc of effort.  And so on.  I think that this isn't just a matter of assessment, bur also a matter of curriculum, but it all comes back to the same question for me: how do you measure something that may or may not be measurable?

Thoughts?
 Comments
Stacks Image 20

Archive

 Oct 2022 (1)
 Sep 2022 (2)
 Aug 2022 (3)
 Jul 2022 (1)
 Jun 2022 (1)
 May 2022 (2)
 Mar 2022 (2)
 Dec 2021 (2)
 Oct 2021 (1)
 Sep 2021 (1)
 Aug 2021 (2)
 Jul 2021 (1)
 Jun 2021 (1)
 Nov 2020 (1)
 Oct 2020 (1)
 Sep 2020 (1)
 Jun 2020 (2)
 May 2020 (2)
 Mar 2020 (1)
 Jan 2020 (3)
 Nov 2019 (2)
 Sep 2019 (1)
 Aug 2019 (1)
 Jun 2019 (1)
 May 2019 (1)
 Apr 2019 (1)
 Jan 2019 (5)
 Dec 2018 (1)
 Nov 2018 (2)
 Oct 2018 (2)
 Jul 2018 (1)
 May 2018 (1)
 Apr 2018 (2)
 Mar 2018 (2)
 Feb 2018 (1)
 Jan 2018 (1)
 Dec 2017 (2)
 Nov 2017 (1)
 Oct 2017 (2)
 Sep 2017 (2)
 Aug 2017 (2)
 Jul 2017 (4)
 Jun 2017 (7)
 May 2017 (3)
 Mar 2017 (4)
 Feb 2017 (5)
 Jan 2017 (5)
 Dec 2016 (9)
 Nov 2016 (1)
 Oct 2016 (6)
 Sep 2016 (4)
 Aug 2016 (7)
 Jul 2016 (8)
 Jun 2016 (9)
 May 2016 (10)
 Apr 2016 (12)
 Mar 2016 (13)
 Feb 2016 (7)
 Jan 2016 (11)
 Dec 2015 (10)
 Nov 2015 (7)
 Oct 2015 (5)
 Sep 2015 (8)
 Aug 2015 (9)
 Jul 2015 (7)
 Jun 2015 (7)
 May 2015 (15)
 Apr 2015 (2)
 Mar 2015 (10)
 Feb 2015 (4)
 Jan 2015 (7)
 Dec 2014 (5)
 Nov 2014 (13)
 Oct 2014 (10)
 Sep 2014 (8)
 Aug 2014 (8)
 Jul 2014 (5)
 Jun 2014 (5)
 May 2014 (3)
 Apr 2014 (4)
 Mar 2014 (8)
 Feb 2014 (10)
 Jan 2014 (10)
 Dec 2013 (4)
 Nov 2013 (8)
 Oct 2013 (6)
 Sep 2013 (10)
 Aug 2013 (6)
 Jul 2013 (4)
 Jun 2013 (3)
 May 2013 (2)
 Apr 2013 (8)
 Mar 2013 (4)
 Feb 2013 (10)
 Jan 2013 (11)
 Dec 2012 (3)
 Nov 2012 (8)
 Oct 2012 (17)
 Sep 2012 (15)
 Aug 2012 (16)
 Jul 2012 (19)
 Jun 2012 (12)
 May 2012 (12)
 Apr 2012 (12)
 Mar 2012 (12)
 Feb 2012 (13)
 Jan 2012 (14)
 Dec 2011 (19)
 Nov 2011 (21)
 Oct 2011 (31)
 Sep 2011 (12)
 Aug 2011 (8)
 Jul 2011 (7)
 Jun 2011 (3)
 May 2011 (2)
 Apr 2011 (8)
 Mar 2011 (5)
 Feb 2011 (6)
 Jan 2011 (6)
 Dec 2010 (3)
 Nov 2010 (2)
 Oct 2010 (2)
 Sep 2010 (4)
 Aug 2010 (9)
 Jul 2010 (8)
 Jun 2010 (5)
 May 2010 (4)
 Apr 2010 (2)
 Mar 2010 (3)
 Feb 2010 (7)
 Jan 2010 (9)
 Dec 2009 (5)
 Nov 2009 (9)
 Oct 2009 (13)
 Sep 2009 (13)
 Aug 2009 (13)
 Jul 2009 (13)
 Jun 2009 (15)
 May 2009 (15)
 Apr 2009 (14)
 Mar 2009 (13)
 Feb 2009 (10)
 Jan 2009 (12)
 Dec 2008 (6)
 Nov 2008 (8)
 Oct 2008 (2)
 Jul 2008 (1)
 Jun 2008 (6)
 May 2008 (1)
Stacks Image 18