The potential TEF metric – sustained employment from LEO

Back in 2016 the government released its first experimental LEO data (or Longitudinal Educational Outcomes to give it its full given name) and it has now matured to be considered under the TEF (Teaching Excellence Framework to give it its birth name) with TEF 2 including an element of it as a supplementary metric.

Unlike the salary data (which Adam did a superb job vizzing here) this metric is not going to grab the attention quite as easily. The metric is sustained employment 3 years after graduation.  The data is sourced form HM Tax returns and does have challenges (lack of self employment, maternity leave etc etc) but it does provide some interesting patterns by subject.

The first viz is a simple view showing where the HEI (Higher Education Institutions to give it its name that its Mother would use when telling it off) sit by its metric outcome grouped by subject.

The interactive viz is here

LEO 3 Year

As you can see the GB average is around 75% for most subjects with just Languages and Combined subjects falling below that. Economics, Education, Mathematical Sciences, Medicine and Dentistry and Nursing all have a GB average above the 75% seen in the other subjects.

At the moment this is just a supplementary metric which will only be used for context when selecting the TEF outcome (another excellent blog explaining TEF here) but it shows the direction of travel and HEIs need to get a handle on where they sit in this metric.

To aid that understanding Adam has created a magnificent more exploratory viz which allows the data to be split by sex, years after graduation (1, 3, 5) as well as region. It can then be viewed by subject with the ability to highlight your institution.

Take it for a spin here

LEO - Proportion of students in Sustained employment further study or both after graduating

Well I hope you enjoyed reading and found it informative – any questions, queries or feedback let us know.

Cheers

Dave

Advertisement

Teaching Excellence Framework | TEF

What is this framework of excellence you speak of?

deltoid-noddy-and-the-stairs.png

#VisualisingHE investigates…..

The Teaching Excellence Framework (TEF) aims to recognise and reward excellence in teaching and learning, and help inform prospective students’ choices for higher education.

If you want to read up a little on the background to TEF check the HEFCE pages. If not, dive in and enjoy the ride…..

TEF in a nutshell:

The Inputs:

  • Feeding into TEF are a collection of standard metrics deemed core to identifying ‘teaching excellence’ in higher education.
    • The metrics include student satisfaction on teaching on the course, assessment and feedback and provision of academic support during studies, dropout rates and employment destinations.

These key metrics are sourced from an annual survey about student satisfaction (the National Student Survey – NSS), dropout rates of students from standard provider HESA returns and employment success rates sourced from an annual destination of leavers survey (DLHE). These scores are bench marked by HEFCE for a provider to aspire to at institutional level.

  • In addition to these data driven performances, a supporting statement is written by each provider highlighting what great things they have done to date and what they are working on to improve key metrics.

The Output:

xfactorpannel

In what I can only imagine to be a ‘X’ factor styled showdown…

  • An HEFCE panel of experts assembled to assess this provider level data and textual statements to come up with a rating of Gold Silver and Bronze per provider.

What happened next?

There was a medal ceremony (well the data was released on the 22nd June 2017 to the public)

three-persons-on-winners-podium_318-27299.jpg

  • Some people challenged this initial synopsis
  • Many people wrote about it
  • Many hours have been spent analysing the data and understanding what it could mean for the sector going forward.
  • NEXT….Subject level TEF looming #TEFstillhotontheHEagenda

In summary

TEF has caused one heck of a hullabaloo in the HE sector……… featuring heavily in strategic decision making and has reached to the core of HE operations.

Since the data was released in June 2017, many a HE analyst and journalist have been busily crunching the data, splicing, dicing and waxing lyrical. As an example, WONKHE alone have written 140 articles tagged as TEF to date, that is a lot devoted to one topic……

VisualisingHE investigates

In this post I make no attempt to try and summarise what has been written about over the last two months, but do take a look if you have the time as there are some very interesting articles to get your teeth into. What we would like to do is viz a few facts sourced from the data.

Therefore #VisualisingHE have put together a few headline vizzes which hopefully introduce TEF to anyone that reads our blog, and, encourages a dabble into provider level performance underpinning the metrics.

Hope you enjoy our vizzes and insights in Tableau:

Higher Education Provider Medal distribution

TEF_The rings

Takeaway:

  • Wowza – 33% of HE providers got GOLD! that’s quite a statement for HE Education in the UK.

England – Higher Education Provider distribution by region

TEF by Region

Interact with the viz: TEF by region

Takeaway:

The TOP3 regions rich in GOLD:

  • #1 East Midlands – 89%
  • #2 East of England – 44%
  • #3 West Midlands – 42%
  • The East Midlands is by far and away the hot spot for GOLD laying claim to more than double the proportions achieving gold in other regions.
  • The North East and Yorkshire and the Humber heavier in Silver and the London Universities slightly weightier than other regions in the proportions gaining Bronze awards

UK | HE Provider – distribution by region

Who is paved in GOLD|SILVER|BRONZE?

TEF Awards by Region_HEonly

Interact with the viz: TEF by region (provider) to view which providers gained gold silver and bronze in which region.

TEF Awards by missions group

TEF colours_higher education institutions

Interact with the viz: TEF by mission group

Takeaway:

  • Across the Higher Education sector 32.8% of HE providers achieved GOLD status, 49.3% SILVER and 17.9% achieved BRONZE.
  • For the Former 1994 Group 36.4% of HE providers achieved GOLD, 45.5% SILVER and 18.2% achieved BRONZE
  • And in the revered Russell Group 38.1% bagged GOLD, 47.6% coming in in SILVER and the remaining 14.3% of providers picking up BRONZE

TEF awards – The Metrics and splits deep dive

Take a deep breath and have a look at the underpinning demographic splits also assessed in the TEF. These splits are also presented by category to help unpick areas for a provider to address and improve.

 

TEF_Region-Provider

Interact with this viz: Teaching Excellence Framework – Awards

Takeaway:

Knowledge is with the beholder…

Interventions in the hands of the provider…

Outcomes?… 

For the good of the student

Hope this has been an enjoyable and informative read.

Adam #VisualisingHE