As clear as clear can be?Posted: August 18, 2014
‘Transparency’ is a bit of a buzz word in the ombudsman world. Specifically, it features in Article 7 of the EU ADR Directive (to be implemented in the UK from summer 2015) and in the “Guide to principles of good complaint handling” of the Ombudsman Association. More generally, it is one of the characteristics cited frequently in the promotion of the ombudsman ‘brand’. But do ombudsmen walk the walk or just talk the talk when it comes to transparency?
In our research on the way ombudsmen use informal resolution, we are coming up against an odd sort of transparency. The organisations we’ve surveyed have been very generous in responding to us – that in itself is a form of transparency. Most, if not all, publish information on their work. The actual meaning of that information, however, is often quite opaque.
We noted in our last progress report that ombudsmen and other complaint handlers don’t use the same terminology to describe the complaints they receive and how they process them. We’re also finding that they don’t report on outcomes in the same way – something that the authors of The Ombudsman Enterprise identified when they stated that official statistics published by ombudsmen “have to be examined with care”. They note that changing methodologies and definitions “can make comparisons from one year to the next and between schemes problematic”. ‘Problematic’ is putting it rather mildly. Trying to make sense of reported statistics requires examining in detail the context behind the figures we’ve been given, something that isn’t within the scope of our current project but which requires further research.
‘Harmonisation’ is another buzz word. A recent essay on “Harmonising the Ombudsman Landscape” argues that redress providers under the EU ADR Directive should be modeled on ombudsmen as a way to promote the brand in the eyes of consumers, in part because of the level of transparency:
“The competent authority, alongside the Ombudsman Association, should work with ADR bodies to align the practice and processes that they use. For best possible effect, this should be done with the core model of an ombudsman scheme in mind: for the transparency of process it affords; for the simplification of the landscape; for the benefit of justice for the consumer; for the uniformity of decision; and for the benefits the gathered data can provide to regulation, government, and the consumer.” [p.4]
There are many assumptions here – that ombudsman processes are transparent, that they deliver justice, that decisions are or could be made uniform. These assumptions need further interrogation, something highlighted at a conference on ADR and ombudsman held in Oxford in April this year. The conference organisers concluded in a policy brief that ombudsmen will need to work toward greater harmonisation of processes, terminology, and standards in order to become an essential part of the justice system.
The EU ADR Directive and transparency
The issue of transparency takes on some urgency in light of the impending implementation of the EU ADR Directive. In Article 7(2), the Directive states that all ADR providers shall make their activity reports publicly available, and these should include, among other statistics:
(a) the number of disputes received
(c) the rate of disputes the ADR entity has refused to deal with and the percentage share of the types of grounds for such refusal …
(d) …the percentage shares of solutions proposed or imposed in favour of the consumer and in favour of the trader, and of disputes resolved by an amicable solution
(e) the percentage share of ADR procedures which were discontinued and, if known, the reasons for their discontinuation
(f) the average time taken to resolve disputes
(g) the rate of compliance, if known, with the outcomes of the ADR procedures…
Let’s take a) above as an example. The number of complaints received is reported in a number of different ways currently. Some schemes report all contacts or enquiries, and then break this down into a further category of accepted or eligible complaints. Not every enquiry is a complaint.
Figure c) above refers to those complaints that are out of jurisdiction, late, premature, or otherwise not within scope. Subtracting the figure in c) from that in a) should give you the figure of accepted or eligible complaints.
But it isn’t that simple, because in this space between ‘received’ and ‘resolved’ we have more than only those complaints the scheme has refused to deal with. We also have ones (according to our survey responses) where advice is given or where a complaint might be in scope but can be remedied with a ‘quick fix’. We have some that may or may not be in scope but might be amenable to resolution with the ombudsman’s intervention. And we have those that are accepted as eligible but not dealt with by one of the three categories of process set out in the directive: a solution, proposed, imposed, or agreed between the parties. Where, for example, a case handler identifies that a suitable remedy has been offered and declines to progress the complaint, is this a proposed solution or a rejection? Confusingly, we have found that this is sometimes categorised as a ‘resolution’.
When we move on the requirements to provide a rate or percentage, we need to know which figure is being used as the starting point. For instance, is the percentage of complaints ‘resolved by amicable solution’ referring to the percentage of all complaints received (a) or is it the percentage of all accepted or eligible complaints (c)? We are finding a range of approaches to this question, making it difficult to make comparisons or draw meaningful conclusions.
Why does it matter?
In a recent essay on evolving standards in ombudsmanry, Richard Kirkham and Philip Wells examine issues of due process and fairness in ombudsmen decision-making, which are linked to openness and transparency:
“The uncertainty surrounding decision-making in the sector is made more marked by the trend over time towards resolving complaints at the pre-report stage, often by way of a letter rather than a formally completed report (Buck et al., 2011 , Ch. 4). The outcomes of such early redress have often not been published. … But the strength of the connections between the benefits to be gained from transparency and the perceived weaknesses in the complaint-handling operation do provide strong grounds for believing that more openness about the decision-making process of complaint-handlers could significantly improve confidence in complaint-handling schemes.” [p.196].
In a 2010 consultation paper on public services ombudsmen, the Law Commission originally proposed that the ombudsmen should harmonise their reporting terminology and all publish reasons for decisions not to investigate specific complaints. This was considered to be overly onerous and was opposed by the public services ombudsmen, and the Law Commission altered its recommendation. It still argued for greater transparency to allow complainants to understand the handling of their complaints, but it stepped back from recommending that the terminology of the reports issued by each ombudsmen should be harmonised.
Does transparency require standardisation? Does harmonisation mean uniformity? And how do harmonisation and transparency fit with flexibility? The call for greater consistency among ombudsmen in the processes they use (for example, in the Harmonisation essay cited above) could be read as a call for a single informal resolution process to be adopted among ombudsmen. This would be an interesting point for us to reflect on as we take this research forward and discuss it with practitioners and policy makers in the ombudsman world.