Writing that counts or writing that is counted?

At the beginning of December, I went to Leiden in the Netherlands to present a paper on behalf of the Academics Writing project. The conference was the Accelerated Academy, which brings together scholars from across Europe, mainly from STS (Science and Technology Studies) but also from other disciplines, to share research about the acceleration of higher education and the increased use of metrics for research evaluation. Clips of some sessions from the Prague conference in 2015 can be found here.

Our paper focused on the tensions that have emerged from the project around the REF. The UK’s national research evaluation exercise pushes academics in competing directions in their writing. The REF and institutional policies around it drive academics to write more and better journal articles in each REF period, and this has become an overarching goal for academics’ writing practices: to publish enough and to target the right journals is to keep their job, to get promoted and to be considered successful. But not all academics really want to publish this sort of journal article, or at least not at the expense of other genres. Historians value monographs, but these take a long time to write and because four research outputs can be submitted to the REF, four has become something of a magic number. Four monographs in a single REF period would be more or less impossible, but departments expect at least four publications, so historians are pushed towards writing journal articles. For Marketing academics, four translates as four-star; their ultimate target for publishing. They are encouraged to publish in four-star journals, which they see as a.) unrealistically difficult and b.) pushing them out of their discipline. If it’s too hard to get into a four-star marketing journal, one can always aim for a four-star management journal.

Finally, although since 2014 the REF rewards writing for impact beyond academia, writing for non-academic audiences was widely perceived by our respondents to be of secondary importance to writing for peer-reviewed, high-impact journals. Many were interested in writing for the media, writing blog posts, tweeting and the like, but didn’t feel that their institutions valued these genres. This view is unsurprising given the relentless counting and evaluating by universities of writing that is aimed primarily at other academics.

How academics feel about social justice

There is plenty of evidence that academics embrace social justice in principle (who wouldn’t?), and also that they try to put this into practice in large numbers, engaging in civic engagement activities on top of their usual workload, for no reward and often in the face of active disincentives (Bond & Patterson, 2005; Watermeyer, 2015), but to what extent do notions of social justice actually motivate what they do? And do they share a common understanding of what social justice means?

These were the questions addressed by our recent paper at the Higher Education Close Up (HECU8) conference at Lancaster University, Historians don’t set out to change people’s lives. The Academics’ Writing project didn’t set out to find out about social justice, but we asked the academics who participated in our study about what shaped their writing and how they interpreted the idea of ‘impact’ as outlined in the REF since 2014 .

You can find our slides here and can read the associated paper here.

Paper presented at the Language, Literacy and Identity conference

The project team delivered a paper this weekend at the Language, Literacy and Identity conference at the University of Sheffield on the role of relationships in academic writing and identity. We drew on data from phase 1 of the project, in which participants talked about the importance of relationships in their writing practices.

Digital technologies such as Skype and Google Docs (plus many more digital platforms) made collaboration on writing easier and faster, but many of our participants told us that meeting face-to-face brought benefits that online communication could not by making it easier to build trust, to get others’ cooperation when leading a project, and to communicate in a second language, as many academics do. The social dimension of writing, as discussed by Uta Papen and Virginie Theriault in their presentation on writing retreats at the same conference, meant that being able to combine chat and coffee with writing made the experience more productive and enjoyable.

Academics talked about the “learning all the time” from conversations with others around writing, and this continued throughout their careers. Even senior academics spoke about the need for informal support networks to enable them to learn from their peers. This highlights the need for universities to foster a culture in which such informal relationships and networks can thrive.

These days, many universities are removing boundaries between student and staff spaces, and replacing staff common rooms with open seating areas accessible to all. This reduces the places where academics can talk in confidence about their research aspirations, about the inevitable rejection of papers from journals, and about the pleasures and pains of creating knowledge. Furthermore, workload pressures often mean that academics struggle to find time to chat informally about writing and the emotions it stirs up. This should be taken seriously given the role that relationships play in nurturing a writing culture and facilitating learning, not only about writing, but also about who we are as academics and team members.

The slides from our talk can be viewed here.

Holding our disciplinary ground

I had the pleasure of going to Ann Arbor last week to present at the International Writing Across the Curriculum conference on behalf of the Academics Writing project. Ann Arbor is home to the University of Michigan. It’s a lovely college town where, it seems, people have a passion for gardening and also apparently don’t lock their doors at night.

ann arbor garden

Our presentation focused on the ways in which academics’ disciplinary writing practices have been affected by changes at managerial level, particularly the REF. For some disciplines, the picture is rather bleak. For example, in Marketing, our participants were forced to aim their scholarly writing at specific target journals prescribed by the Association of Business Schools’ benign-sounding Academic Journal Guide, which ranks business and management journals according to their supposed quality.

Only 5 of the journals ranked highest (4-star) by the ABS guide in 2015 were in Marketing, making it a very small target to aim for. There is also a perception that most of these journals are US-based, and publish mainly quantitative work.

Here’s a taste of what our participants in working in Marketing departments in England said about this:

“Now it’s not just four star journals. It’s four star journals in marketing. Now the four star journals in marketing […] are US based four star journals. I think there were only 16. I can’t remember what the figure was but it was such an unbelievably low figure, of UK academics getting published last REF into US four star journals.” Charles, lecturer in Marketing

“Now I target management journals, which is one way of hitting a four star.” Diane, professor in Marketing

michigan league

There is much to comment on here about the primary purpose of publishing research, the effect of attempting to measure quality in this manner, the level of autonomy academics enjoy (or not) regarding what and where to publish, cultural differences, disciplinary boundaries, and much more. The other disciplines in our study are experiencing their own sets of pressures related to disciplinary values and practices, which you can find out more about by checking out the slides from the talk.

 

Many of the other presentations at the iWAC conference were pedagogically-oriented, focusing on improving students’ writing in the disciplines, but this still provided an opportunity to consider what it is that we are preparing our students for; what disciplinary writing actually looks like in the context of contemporary higher education.

Who do you work for anyway?

The project team had the pleasure of being invited to give a talk this week at a careers event at Manchester University, aimed at humanities researchers. The event included a panel discussion on the theme of What do you actually do?  The panel’s insights were not only very interesting and amusing, but also resonated with the findings of the Academics’ Writing project. For example, there was unanimous agreement that an academic’s job was roughly divided into three main areas: teaching, research and admin, which is consistent with what our research participants have said. However, the panel members added that there was also some “other stuff” too. Asked what this “other stuff” consisted of, they revealed that it included attending committee meetings, doing ethics reviews and the like. Much of this type of work we had categorised as “admin”, but some universities call it “service”.

As part of our analysis, we coded the transcripts of our interviews with participants, attaching a descriptive code to genres of writing that people talked about. 64 different genres emerged, but they did not all fit into the tripartite system of teaching-research-admin. Conducting peer reviews of books or articles, for example, is not exactly admin. It’s not for the benefit of the department or institution, nor the academic doing it, who receives no pay, credit or time for such work (although arguably, academics at the beginning of their career may do reviews to gain experience or help establish their reputation). Such work is central to academia as a way of upholding standards and creating disciplinary knowledge, but it is also time consuming, yet it is not accounted for in the workload allocation models academics are expected to adhere to. Similarly, responding to surveys and participating in disciplinary or professional fora do not fall neatly into research, teaching or admin, yet academics often see these activities as crucial for staying up to date with their field and contributing to their discipline.

This raises the question not just of what do academics actually do, but of whom they actually work for. Clearly, they are employed by their institution, but much of what they do could be argued to have benefits for others beyond or within the university. In the age of the REF,  is it one’s department that one primarily strives to benefit? This might actually work against any wider sense of disciplinary identity, since comparable departments must effectively compete with each other. What about the fee-paying students? Are they our “customers” who we must serve? Or is some of an academic’s work actually for themselves? After all, our h-index is ours alone, and when academics move institutions, they take their work with them. Or do they? Some argue that academics moving institutions prior to the REF be disallowed from submitting work done in the preceding year or two for the REF in their new institution.

Several panel members in Manchester, and our own participants, talked about their research writing as though it were something personal and rather indulgent. “I’m going to be selfish and use this time for myself” was the way one person described getting research writing done. Another piece of advice from a panel member was, “If you get a second that belongs to yourself, work on a paper”. Research writing was the thing that got squeezed by other work, and the thing most likely to get done in personal time; at home, on holiday and in the evening, partly because it was seen as something that belonged to the individual.

Cultures of counting: Metrics through a critical lens

Tuesday 24th May sees the Academics’ Writing project’s fourth and final workshop on the role of metrics in academic life. This time, we have invited two expert speakers to talk about what responsible metrics might look like in the context of both REF and TEF. The speakers are Professor Paul Ashwin of Lancaster University and Professor James Wilsdon of the University of Sheffield.

Metrics evoke a mixed reaction across the higher education community. A commitment to using data to inform decisions makes some enthusiastic about the prospect of granular, real-time analysis of our activities. Yet we only have to look at the blunt use of metrics such as
journal impact factors, h-indices and grant income targets, to be reminded 
of the pitfalls. Some of the most precious qualities of academic culture
 resist simple quantification, and individual indicators often struggle to do justice to the richness and plurality of our work.

Across both research and teaching, metrics are receiving greater emphasis from policymakers and managers. The November 2015 HE green paper outlines a new regulatory architecture, including the replacement of HEFCE with a new Office for Students, and the introduction of a Teaching Excellence Framework (TEF). Metrics are portrayed as crucial to the TEF, albeit with some scope for expert judgement alongside, and there are now fierce arguments raging across the sector about whether we need a TEF at all, and if so, how it should be designed, and what mix of quantitative indicators it should employ.

Metrics hold real power: they are constitutive of values, identities and livelihoods. How to exercise that power to more positive ends was the focus of The Metric Tide, a recent UK review of the role of metrics in research management and assessment. The Metric Tide sets out a framework for responsible metrics, and makes a series of recommendations for researchers, university managers, funders, policymakers and publishers.

In this seminar, James Wilsdon, who chaired The Metric Tide, will outline its main findings, and reflect on ongoing efforts to influence debates about UK research policy and funding, including over the design of the next Research Excellence Framework (REF), which is currently the focus of a further review by Lord Stern.

Paul Ashwin, in the context of the proposed TEF, will examine the challenges of developing measures of teaching quality that do not simply reflect institutional prestige.

Both speakers will consider what a culture of ‘responsible metrics’ might look like for research and teaching, and the opportunities and obstacles to achieving this.

James Wilsdon is professor of research policy at the University of Sheffield, and was chair of the UK’s Independent Review of the Role of Metrics in Research Assessment and Management. He is now chairing a European Commission expert group on the future of altmetrics.

Paul Ashwin is professor of higher education at the Lancaster University and a co-investigator in the ESRC/HEFCE funded Centre for Global Higher Education.

This talk is part of the Designing the Academic Self series, sponsored by the Academics Writing project, which is part of the Literacy research Centre at Lancaster and the Northwest Doctoral Training Center and is open to early career researchers and doctoral students from Lancaster, Manchester and Liverpool universities.  To book your place, visit Eventbrite. 

 

Academics’ experiences of professional networked learning

The project team have been presenting our findings on academics’ experiences of professional networked learning at the 2016 Networked Learning Conference. The slides can be found here: NLC10may2016_slides

It was a thought-provoking conference overall, with many sessions, including Helen Beetham‘s and Magda Bober‘s talk, echoing some of the themes that have emerged from our research. Helen talked about the disaggregation of professional roles in academia, including the blurring of boundaries between personal and professional time and identities. This is a major concern for our own participants – almost without exception, people talked about the pressure / drive to check email using portable digital devices, even when when not ‘at work’, and about concerns around the ways their identity could be constructed online. Magda talked about the ways in which students and staff in HE use mobile devices, and the symbolic meanings these held for these two groups.

What can and can’t metrics tell us?

Tuesday 26th April sees the third of four interactive workshops on the role of metrics in academic life, run by the Academics Writing  project, alongside  Masud Khokhar and Tanya Williamson of Lancaster University library, called What can and can’t metrics tell us?

Higher education institutions in the UK have to justify how they spend their research funding and demonstrate that this spending resulted in high quality research outcomes. This is achieved mainly through the REF (research excellence framework) and bibliometric measures associated with it. The research activity of individual academics, departments and institutions is measured in various ways and the resulting data used for a range of purposes. But are we asking the right questions? And are we using the data in an appropriate way?

This interactive workshop is part of the Designing the Academic Self series, and explores the ways in which quantitative indicators of research output are used, by both institutions and individuals. We begin by exploring what exactly are we trying to measure, and consider how well are the metrics we generate can do this. We will talk about case studies of how metrics are currently being used in different UK institutions, and will consider the potential positive and negative effects of these on academics.

To book a place, visit Eventbrite 

To blog or not to blog, that is the question

Our PI Karin participated in a public lecture in Lancaster last week on the theme of Teaching, Tweeting, and Trolling – Our Online Worlds.  In addition, I had the pleasure of going to Sweden to give talk at Stockholm University’s department of English on behalf of the Academics Writing project. In both of these talks we shared findings on how academics’ writing practices have been affected by technological changes.

We asked our participants if they did any writing on digital platforms such as Twitter, blogs, and Facebook, and found a bit of a trend across the disciplines (bearing in mind that our sample is too small to draw generalisations). Not many of the mathematicians used these platforms, while historians tended to speak rather more positively about them, even if they didn’t actually use them much.

The reasons our participants have given for not engaging with these new genres of writing include a perception that they were trivial or inconsistent with their professional identity. For example, one participant (a statistician) said, “I don’t necessarily approve of Twitter and Facebook so I tend to avoid them”. But these feelings of disapproval were not shared by everyone, and others were keen to use these platforms.

One History professor said, “I lay awake sometime last week thinking maybe I should have a blog. Haven’t got around to it. But the blogs I do read, some of them are terrific.” Another historian expressed similarly positive views: “I am really interested in the idea of blogs and sometime, maybe when I retire, I might get into blogs. I think they are really fun. I don’t do Twitter either. All those modes of communication seem quite interesting.”

The language these historians use speaks of the potential pleasures and creativity of these forms of writing, yet their take-up is constrained by the need to produce other, more privileged genres. This was particularly clear in David’s comment, “A lot of the work is grey literature where people have written blog pieces. I think that’s opened my eyes to what’s possible in that area but yes, if there’s time – I think it’s always a question of time. Again, that work is not valued by the university as far as I can see.” Although he saw potential in these forms of writing, particularly in terms of communicating to audiences beyond the academy, he acknowledged that peer-reviewed, scholarly publications take priority, partly driven by institutional demands to produce REF-able research outputs.

Where do you stand on these hybrid genres? Are they appropriate for academics? Should institutions value them more or would this simply add to already heavy workloads?

 

Dissemination events

As we reach the end of the first phase of the Academics Writing project, we are holding a series of dissemination meetings to share interim findings from the research and to invite responses and comments from those whose working lives the research may impact upon.

Because we have been asking our participants not only about scholarly writing, but also about teaching- and admin-related writing, there are interesting data about how academics decide what to prioritise among their workloads, the range of digital platforms and devices they use for writing, and how they create a space for themselves, both physically and psychologically, to get to the writing that really matters to them.

All of which has implications for how we prepare new researchers for their role, and for how their working hours and spaces are organised. Thus, the dissemination meetings are targeted not only at academics, but also at those involved in the professional development or training of early career researchers and doctoral students; those working in research management and support; those responsible for academics’ work spaces, and anyone with an interest in academic writing.

The meetings are on the 18th of March and the 19th and 22nd of April at universities around the North of England. If you’d like to attend, get in touch with Sharon on s.mcculloch@lancaster.ac.uk for more information. and we’ll send you details.