A few insights into the inner workings of the Australian Research Council

13 05 2022

I’ve been on the Australian Research Council (ARC) College of Experts now for a little over two and a half years. It has been a time-consuming, yet insightful experience. Without attempting to breach all the confidentiality agreements I signed when I joined up, I would like to explain a few of the internal machinations that go on behind the scenes once a grant application is submitted.

Given that academics spend A LOT of (i.e., way too much) time writing research grants, I think it’s essential to understand not only how to maximise your probability of success (see this post for some generic tips), but also how your grant is treated once you submit it. I’ve heard from colleagues (and been responsible for myself) many unhappy gripes about the ARC over time, which appear to have increased over the last five years in particular.

There are certainly some very good reasons to be upset about the research-grant environment in Australia. While I will restrict this post to issues concerning the ARC because that’s what I know best, I gather that many of the same issues plague other national agencies, such as the National Health and Medical Research Council (NHMRC). But to dispel the suspicion that the ARC is just out to make our lives hell, I’m going to provide a list of my experiences on what I think they do exceptionally well. I’m definitely not taking sides here, because after the list of pros, I’ll provide a detailed list of cons and some ways I think the ARC can move forward.

Impartiality

The ARC is very, very good at avoiding bias in the assessment process. Even if some potential bias does manage to creep in, the ARC is also extremely efficient at identifying and removing it. First, all assigned ‘carriages’ (College Experts) assigned to grants cannot work at the same institution as the applicants, they cannot have published with any of the applicants, nor can they have any other association with them. All potential conflicts of interest are declared and dealt with immediately up front.

Second, carriages cannot assign assessors with any of the aforementioned conflicts of interest given restrictions in the online applications that we use to identify and assign suitable assessors.

Third, during the actual deliberations, anyone who has any perceived conflict of interest must ‘leave the room’ (done in Zoom these days), nor can those people even see the grants under discussion for which they’ve been deemed conflicted.

Democracy

I have to admit that I’ve been involved in few processes that were more democratic than advisory panel meetings for deciding the fate of ARC grant applications. Any grant under discussion is not only pored over by the ‘detailed assessors’ (those are the comments to which you have to write a rejoinder), it is discussed in gory detail by the carriages. We not only read all of the detailed assessors’ reports and your rejoinder (after already having read the proposal itself many times), we also compare our scores among carriage members, discuss any scoring disparities, argue for or against various elements, and generally come to a consensus. For those grants under discussion, we also vote as an entire panel, with only majority ‘yes’ grants getting through.

Word of advice here — treat your rejoinder very seriously, and be succinct, polite, erudite, and topical. A good rejoinder can make or break any application.

Read the rest of this entry »




Open Letter from Members of the Australian Research Council College of Experts

25 01 2022

People outside Australia might not have heard about the (unfortunately, not unprecedented) intervention of the acting Minister for Education and Youth to deny funding to six Australian Research Council (ARC: Australia’s main scientific funding body) Discovery Grants that had been assessed and recommended for funding by the College of Experts. As an acting College of Expert member, I joined a long list of my fellow members in protest of this political interference, with whom I co-wrote/co-signed this letter published last week (the ARC Laureate fellows wrote an analogous open letter a few weeks before). I have copied the letter here for your viewing displeasure.


(letter originally posted here)

19 January 2022

To: The Hon Stuart Robert MP
Acting Minister for Education and Youth
stuart.robert.mp@aph.gov.au

CC: Professor Sue Thomas
CEO, Australian Research Council
ceo@arc.gov.au

As members of the Australian Research Council‘s (ARC) College of Experts, we write to express our concern over the Acting Minister for Education and Youth’s decision in late 2021 to reject six Discovery Project grants that were recommended for funding by the ARC.

As explained on its website, the ARC engages a College of Experts to play an essential role in identifying research excellence, in order to support the advancement of knowledge and contribute to national innovation. Its members are experts of international standing drawn from the Australian research community: from higher education, industry, and public sector research organisations. Many College of Experts members have extensive industry and community experience in addition to their specialist research expertise.

The quality of grant proposals submitted to the ARC is extremely high. The ARC runs a rigorous, multi-stage selection process. Each grant eventually recommended to the Minister for funding is first assessed by multiple international experts and multiple College members, and then individually discussed and voted on by College members at the Selection Advisory Committee panel meetings. The 19% of submitted proposals recommended for 2022 were therefore considered to be of the highest calibre measured against international standards for research across disciplines. Each was recommended on the strength not only of quality, innovation and feasibility, but also the wider benefit and value of the proposed research.

Read the rest of this entry »







%d bloggers like this: