Being ‘ombidextrous’: revisiting questions from our mapping study of the use of informal resolution approaches by ombuds

DrawingHands

MC Escher, Drawing Hands (Image source: Wikipedia)

 

In advance of the next biannual conference of the Ombudsman Association (on 25-26 May 2017, at Loughborough University), we thought it would be worth republishing[1] our conclusions from our mapping study of informal resolution approaches used by ombuds. We conducted this mapping research in 2014, and no doubt practices and approaches have moved on since then for many of the organisations in our study. The issues, however, remain as pertinent as ever, and as unresolved.

By Varda Bondy, Margaret Doyle and Carolyn Hirst

Conclusions and discussion points

Ombuds are themselves a type of informal resolution mechanism when seen in the context of ADR, being alternatives to judicial determination in court or tribunals, as pointed out by several of those responding to the survey. This study explored the informal processes that make up part of the overall ombud complaint-handling work. These are primarily the processes that do not involve investigation, adjudication and determination, the ombud’s traditional role. For some respondents this presented some confusion, used as they are to describing their overall process and approach as ‘informal’.

This was a scoping project designed to produce a descriptive mapping study, identifying the schemes that use informal resolution and those that do not, the reasons for doing so and the nature of those processes. Where possible, figures are provided in respect of various aspects of practice, but these need to be read as illustrative of models and trends rather than as a definitive representation of each individual scheme; even during the relatively short duration of the project in the first half of 2014 there were changes in the membership of the Ombudsman Association, new annual reports were published, and some schemes were in the process of changing their informal resolution processes.

The focus of this report is naturally on the 36 of 48 participating schemes that use some form of informal process, but in order to understand the nature of this aspect, it is necessary also to investigate the schemes that do not. In respect of some such schemes, for example those of a regulatory nature, it may appear obvious at first blush that informal resolution is inappropriate. Yet bodies of similar functions presented a variety of different approaches.

Main themes

The main themes to emerge from this survey are:

Terminology

It is apparent that some of the common terms used by ombuds mean different things, and conversely, similar terms are used to describe quite different processes. For example, does ‘mediation’ mean a full process conducted by a qualified mediator, or a settlement brokered by way of shuttle negotiations by a case officer on the basis of their assessment of what is a fair or expedient outcome? We came across both of these understandings of mediation.

We also found that mediation was not necessarily synonymous with early or even informal resolution. In at least one scheme, mediation takes place only after an investigation has been carried out and the complaint upheld. Similarly, one scheme refers to ‘conciliation’ as the informal part of the process, whereas another describes it as a formal process.

Does terminology matter? We think it does. The proliferation of terminology, at times contradictory, can be confusing for complainants as well as to complaint handlers as the terms used can also impact on how they exercise their function.

It is possible that consistent use of dispute resolution terms can lead to better matching of complaint to process, resulting in better outcomes – a point made by the National Alternative Dispute Resolution Advisory Council of Australia (NADRAC). NADRAC also suggests that common terminology contributes to consistent and comparable standards and provides a basis for programme development, data collection and evaluation.[2] Carrying out any comparative analysis of ombuds and complaint handlers is difficult when, as we have found, they each report using different terminology and different understandings of the same terms.

Criteria

What principles guide investigators in deciding whether to use informal resolution? What criteria, if any, are applied? We established that only a minority of schemes have some form of written criteria setting out when informal resolution can be used, and of these, only three are published and available in the public domain. Guidelines adopted informally by schemes include numerous references to case handlers’ judgements based on experience or knowledge, but little of what might be considered criteria.

On the whole, it appears that this is often a matter for individual caseworkers to decide. Is it a matter of, as one former ombud has said, ‘Like the elephant or the rhinoceros, you know one when you see one.’?[3]

Process

In addition to the difficulties of navigating the terminology applied, arriving at a common understanding of the machinations of specific process terms (mediation, conciliation, etc.) proved problematic. In other words, it was hard to tell what happens in practice. We believe that the majority of schemes employ shuttle negotiations by telephone and in writing, but only a handful of participants described the process in detail.

Publication of outcomes

Transparency and accountability are principles that all ombuds subscribe to. Indeed, the vast majority of schemes publish annual reports containing a variety of aspects of their work. Invariably, these include figures about the volume of complaints received and how they are addressed and concluded. However, there are nearly as many ways of presenting those (and other) facts as there are schemes, with the result that meaningful comparisons are almost impossible.

Discussion points and further research

This report is intended to raise questions for discussion and to identify areas for further research. Below are key discussion points arising from the study, as well as suggestions for issues arising from the study that require further research.

Describing, not defining

Should we move away from the problems of terminology and instead of defining the processes used by ombudsmen and other complaint handlers, should we attempt to describe them? This is the approach of the NADRAC[4] and of the EU ADR Directive. Both identify three types of ADR process: for NADRAC, these are advisory, facilitative, and determinative; for the ADR Directive, they are advisory, proposing, and imposing. Into these three fall the specific ADR process terms such as mediation, conciliation, early neutral evaluation, adjudication, arbitration, etc.

It may well be, as NADRAC believes, that it is impossible, and indeed inappropriate, to prescribe how such descriptions should be used by ADR providers. However, it seems sensible to require at the very least (and NADRAC supports this) that ‘descriptions of the actual process used by any provider should be available in forms that are easily understood by the users of the service’.[5]

In 2010, the Office of Fair Trading, in a summary guide to dispute resolution systems for consumer redress in the United Kingdom, stated that:

‘A useful distinction can be drawn between procedures in which a neutral third party proposes or makes a decision (ombudsmen, adjudicators, arbitrators) and those where the neutral party seeks to bring the parties together and assist them in finding an agreement by common consent (conciliation, mediation). Which of the above procedures is most appropriate will depend on the nature of the dispute to be resolved.’[6]

Such a distinction suggests a binary framework – the procedure is either one in which a decision is proposed or imposed by the scheme or one in which the parties reach an agreement by consent. It is a familiar framework. Applying it to ombud procedures, however, presents some difficulties as it does not reflect the actual practice of most ombuds, most of whom appear to be practising what the Administrative Justice and Tribunals Council, in its 2012 report ‘Putting It Right’, defined as

‘an independent person assessing the claims made by each side and giving an opinion on a) the likely outcome in court or tribunal [or, it could be added, likely ombudsman decision], b) a fair outcome, and/or c) a technical legal point. It is non-binding, and the parties decide how to use the opinion.’

Consensual agreements are different in an ombud context than they are in other areas, such as civil mediation generally. In this context, consensual agreements are not only of interest to the parties involved in the complaint, but potentially have wider significance. They are not made in a vacuum but in the ‘shadow’ of the ombud’s authority.

Ombuds have a place in the wider ADR sphere, but perhaps as an ADR process in itself (‘ombudsing’?) alongside mediation, conciliation, arbitration, etc. Unless we understand a process of ‘ombudsing’ as a distinct and defined process to sit alongside mediation and arbitration, for example, we have a confusing lack of clarity about what it is that ombuds are actually offering process-wise. What is missing, and appears to be needed, is a classification of the processes used by ombuds and their complaint-handling cousins.

Suggested framework of processes used by ombuds

In 2011 the Law Commission[7] identified three ways in which ombuds dispose of complaints: ADR, investigation and report, and dismissal. The latter ties in with one of the ‘resolution’ methods identified by some respondents to our mapping survey: rejection of the complaint. However, for the Law Commission ‘ADR’ included, in the majority of cases, the ombud informing the public body of the complaint made and encouraging the public body to resolve the matter. This might be described as a ‘referral back’.

In our mapping survey, we have identified a further ‘resolution’ process used by ombuds and complaint-handlers: advice to the complainant, possibly including signposting to another organisation.

It is possible to set out, in the ombud context, a spectrum of ‘resolution responses’ being used:

  • rejection
  • referral back
  • advice and signposting
  • bringing the parties together to facilitate an agreement by consent
  • hearing from the parties and proposing a solution
  • investigating and making (imposing?) a determination

Given the important role that ombuds have in improving service provision and complaint handling by the bodies they investigate, one could add, on the top and bottom of the above list, prevention and lesson learning.

But once a complaint has been accepted and is being looked at by the scheme, what are the key processes used to ‘resolve’ them? They appear to fall under the three broad headings in the final bullet points of the list above:

  • bringing the parties together (process) to facilitate an agreement by consent (outcome)
  • hearing from the parties and negotiating (process) and proposing a solution (outcome)
  • investigating (process) and making, or imposing, a decision (outcome)

This echoes both the NADRAC descriptions and those in the EU ADR Directive.

Training and skill set required

A question for ombuds and complaint-handling schemes is whether caseworkers have the appropriate skills needed if they want to increase the number of complaints resolved through informal processes and improve the quality of the process. The use of quicker and less formal methods of complaint determination, in addition to the more traditional method of adjudication, is broadening the skills set that complaint handlers need to possess. And different skill sets need to be valued by the organisation as a whole:

‘Getting our managers to think more about coaching and shifting that behaviour away from the legalistic kind of checking… and that has an impact on our board as well because it means that our board would need to recognise behaviours that normally they don’t see… the organisation would… in the past… probably value people with that… legalistic bent whereas in the future the real value comes from people who are good at talking and fixing things and that’s quite a change.”[8]

What skill set is needed for a resolution focus, and is it different from that needed for investigation and determination? If so, what specific training might be needed to ensure a consistent approach to informal resolution?

Is it desirable, and possible, to develop agreed best practice (in process, training, data recording)?

An earlier study of ombuds’ use of ADR[9] concluded with a number of suggested principles – including clarity about the processes, transparency about the criteria for using different processes, and informed consent by the parties – and suggested actions, including staff training and assessment and evaluation of outcomes achieved through informal resolution processes. Is it time to revive interest in the development of best practice guidance?

Is informal resolution a necessary form of filtering in an age of austerity?

To some extent, is informal resolution is a form of ‘filtering’ – identified in a recent report as ‘a major part of the work of complaint handlers’?[10] Filtering can involve any or all of the functions of resolving, signposting (directing a complaint to an alternative appropriate route of redress) and rejecting.

Is informal resolution a sign of failure?

Two schemes that have a low rate of informal resolution, and one scheme that is said not to be using informal resolution at all, told us that a low rate reflects good complaint handling practice on part of body complained against. Conversely, a high rate of informal resolution by ombuds suggests a failure in the system, in that complaints capable of being resolved informally should be resolved at an earlier stage. Is this an indication of a mood change among ombuds in their attitude to informal resolution?

Does greater use of informal resolution pose a threat to ‘justice’?

Can it be said that the methods of informal resolution of complaints provide the information that ombuds need in order to fulfil their role in promoting service standards, first-tier decision-making and good administration? And for ombuds dealing with private-sector providers and services, does informal resolution put them at risk of being assembly lines of mass case processing, a sort of ‘Complaints ‘R Us’?

Future research

This mapping study has shined a light on the informal processes used by ombuds and other complaint handlers in the UK and Ireland. It is a limited light, and there is more to learn and study.

First, we have noted that many organisations with a significant role in complaints handling – whether as part of administrative justice or consumer redress – were not included in this mapping survey. Broadening out the mapping work to include these other relevant organisations would be helpful.

Although we have focused on the ombuds community, we are sensitive to the overlaps between ombuds and other routes to redress for complainants. There is much opportunity to share learning between courts, tribunals and ombuds, for example. It would be useful to explore the extent to which ombudsmen might adopt the ‘mapping’ factors for identifying the appropriate dispute resolution route for tribunal claims.[11]

Specific aspects covered in this research require closer examination, including:

Process: There is a need for in-depth research on how the process actually works and to identify the appropriate realistic methodology for studying the journey of a complaint from initial acceptance, through resolution and outcome.

Outcomes: How is ‘success’ defined in informal resolution context? We have examined the use of informal resolution, but its success is an area for further exploration. There is also a need to examine the views held by users of ombud services (both complainants and those in the departments and organisations that are the subject of complaints).

Criteria: For many schemes, informal resolution appears to be the default approach to complaint handling, with a move to investigation if the complaint did not resolve at this stage of the process or if there was some reason to investigate. On reflection, a more informative and potentially productive question to have asked in our survey would been ‘What are your criteria for deciding whether or not a complaint needs to be investigated?’

Timescales/speed: This survey did not ask specifically about timescales of informal resolution processes, but what we were told was intriguing and worth further study. Only a handful schemes told us they have a timescale (time limit) for attempts to informally resolve a complaint (ranging from one hour to one day mediations, to ten working days).

Classification of disputes

One further question arising is whether some processes are more suitable for some types of complaint, and whether there is scope to developing classifications that can be used across the range of schemes. There is also a need to explore whether the same category of complaint is dealt with differently by ombuds in different jurisdictions. Such classification could help in developing guidance on what disputes and complaints, and in what circumstances, are best suited to particular resolution approaches.

In the ombud context this differs from guidance on the suitability of mediation and other forms of ADR because ombuds have a wider, authoritative role. They are not simply dispute resolvers but have the additional (and some would say more important) responsibility to influence good practice by bodies in jurisdiction. They do this through their determinations as well as through their ‘good offices’ – persuasion, guidance, and feedback.

The classification of disputes may be needed in order to identify a comprehensive approach for influencing how cases should be allocated to a route to redress – what forum for which fuss. This might involve categories of complaints – e.g. fundamental rights cases, in which adjudication is necessary, and, at the other extreme, ‘cases where the claimed entitlements could not themselves satisfy the claimants and where the interests of all parties might be better served by a negotiated resolution’.[12] Endorsing the view that a proportionate and appropriate system must involve a range of dispute resolution techniques, the AJTC identified a number of principles and mapping factors to help identify the suitability of a specific dispute resolution process, such as early neutral evaluation, mediation, and traditional hearing.[13]

Finally

These are only some of the aspects considered in this report. Our aim has been to present a nuanced snapshot of the ethos and practices of informal resolution by ombuds at the time of conducting the research. We hope this will further the understanding of current issues and research needs in this field, and lead to greater consistency in the use of terminology and processes in future.

 

[1] This is the final section of our report ‘The use of informal resolution approaches by ombudsmen in the UK and Ireland: A mapping study’, which was funded by the Nuffield Foundation and supported by the University of Essex and De Montfort University. We have republished it here unchanged aside from replacing ‘ombudsman/men’ with ‘ombud/s’ when used in a generic sense.

[2] National Alternative Dispute Resolution Advisory Council (2003) ‘Dispute resolution terms: The use of terms in (alternative) dispute resolution’ (Canberra: National Alternative Dispute Resolution Advisory Council): 1.

[3] Jefferies, R (2001) “A review of mediation”, The Ombudsman, Issue 15 (March).

[4] See, for example, National Alternative Dispute Resolution Advisory Council (2000) ‘The development of standards for ADR: Discussion paper’ (Canberra: Legislative Services, Commonwealth of Australia): 6.

[5] National Alternative Dispute Resolution Advisory Council (2000).

[6] Office of Fair Trading (2010), ‘Mapping UK consumer redress: A summary guide to dispute resolution systems’, OFT1267 (May).

[7] Law Commission (2011) ‘Public Services Ombudsmen’, Law Com No 329, HC 1136 (London: The Stationery Office).

[8] Gill, C, Williams, J, Brennan, C and O’Brien, N (2013) ‘The future of ombudsman schemes: drivers for change and strategic responses’, a report for the Legal Ombudsman (Edinburgh: Queen Margaret University).

[9] Doyle, M (2003) ‘The use of ADR in ombudsman processes: Results of a survey of members of the British and Irish Ombudsman Association’, (London: Advice Services Alliance).

[10] Bondy, V and Le Sueur, A (2012) ‘Designing redress: a study about grievances against public bodies’ (London: Public Law Project): 55.

[11] Administrative Justice and Tribunals Council (2012) ‘Putting it right – A strategic approach to resolving administrative disputes’ (London: AJTC): 36–37.

[12] Richardson, G and Genn, H (2007) ‘Tribunals in transition: Resolution or adjudication?’ Public Law 2007, pp.116-141: 141.

[13] Administrative Justice and Tribunals Council (2012) ‘Putting it right – A strategic approach to resolving administrative disputes’ (London: AJTC).

 

About the authors:

Varda Bondy, Margaret Doyle and Carolyn Hirst are the co-authors of ‘The use of informal resolution approaches by ombudsmen in the UK and Ireland: A mapping study’, which was funded by the Nuffield Foundation. More information about the project and the team is available at http://www.ombudsresearch.org.uk, where there is also a blog covering aspects of research on ombuds and complaint handlers.


Alice meets ombud, that fabulous monster

alice_in_wonderland_clip_art_24772

 

“’Ah, what is it, now?’ the Unicorn cried eagerly. ‘You’ll never guess! I couldn’t.’ The Lion looked at Alice wearily. ‘Are you animal — or vegetable — or mineral?’ he said, yawning at every other word. ‘It’s a fabulous monster!’ the Unicorn cried out before Alice could reply.”

Our colleague on the ombudsresearch team, Carolyn Hirst, gave the keynote address at the 2016 conference of the Australian and New Zealand Ombudsman Association (ANZOA) in May. Her address, which is available here, explores the context in which ombuds in the UK are changing and the challenges these changes present. She traces the evolution of UK ombuds and gives a clear overview of the stages of development. She also considers the contributions made by recent research on ombudsry, including work she and colleagues at Queen Margaret University have carried out, work by Naomi Creutzfeldt and Chris Gill on online ‘ombuds-watchers’, and our team’s mapping work on informal resolution by ombuds. She notes the impact of recent developments such as the EU ADR Directive, which is not only ‘resulting in procedural change for ombud schemes here but is having an influence across the UK redress landscape by impacting on existing models of redress and encouraging new and often rival ADR providers to emerge’.

A self-described ‘pracademic’ (practitioner and academic), Hirst is honestly reflective about her concerns about the state of ombuds now and going forward:

“A question which has been bothering me for a while is whether the purpose of an Ombuds is to determine disputes by way of adjudication or to resolve conflicts by enabling parties to come to a consensual agreement? Or is it both? For me, this goes to the core of what it is that an Ombuds does. And I think that associated with this are the increasing tensions for Ombuds between the concepts of right, fair, just, and reasonable.”

Citing work by our colleague Nick O’Brien to retain the democractic accountability role of ombuds in the face of rushing consumerism, Hirst notes the tension between the ‘micro’ and ‘macro’ functions of ombuds: “‘Micro-justice’ or individual redress can work well, but Ombuds also need to consider the needs of ‘macro-justice’ and the interests of citizens who are not party to the individual dispute, but who may be affected by the matter complained about.”

Hirst is an impassioned supporter of the ombud institution, and in her critiques she plays the role of critical friend: “I think that the fabulous creatures which are Ombudsmen can be one model with many applications, as long as there is both clarity and confidence about who they are and what they stand for.”

“So where do we want to go? I think that one of the biggest challenges ahead for UK Ombuds is to decide what they want to be. And in doing this they need to be out, loud and proud in clarifying their place and role as a distinctive and integral part of the dispute resolution landscape.”


Compare and contrast – informal resolution by sector

We are grateful to the Nuffield Foundation for providing us with some supplementary funding in order to follow up on some of the issues that arose when we launched our report on The use of informal resolution approaches by ombudsmen in the UK and Ireland last month. One of the pieces of work we want to do is to look at approaches used by schemes operating in the same sectors but in different jurisdictions to see what similarities and differences there are in the way they handle the same types of complaints.

For example, three organisations in our mapping study deal with complaints about financial services: the Financial Ombudsman Service (UK) (FOS), the Financial Services Ombudsman Scheme (Isle of Man) (FSOS) and the Financial Services Ombudsman’s Bureau (Ireland) (FSOB). They are vastly different in size: the FOS handles half a million complaints each year, while the Isle of Man scheme handles fewer than 300, with FSOB at nearly 8,000. All three schemes use informal resolution, but the extent to which they do ranges from 94% of complaints (FOS) to 22% (FSOS) down to <1% (FSOB). Both FSOS and FSOB use a process they call ‘mediation’, but these appear to be quite different.

Only one, the FSOB in Ireland, uses what we might call ‘true’ mediation: a process where an independent third party helps the parties in dispute to try to reach an agreement and in which the parties, not the mediator, decide the outcome.

Mediation is offered to both parties in all cases accepted by the FSOB. The scheme describes its mediation as a process where the parties to the complaint try to reach a solution through agreement with the assistance and support of a mediator rather than through an immediate investigation of the complaint and a decision from this Office on the complaint.” The mediator is one of three members of the FSOB staff who are trained and accredited in mediation. Mediations take place in person, with both parties attending, at the FSOB offices in Dublin. Parties are advised to set aside a full day to attend mediation in person, although in practice mediations are concluded within a few hours.

Mediation is voluntary for both parties, and the very small percentage of FSOB complaints going to mediation, even though it is the default offer of the scheme, suggests that buy-in by the parties is low.

We’d like to explore what these and other sector-specific schemes share, and how they differ.


Newsflash – Ombud admits lying to researchers

We had our first launch of the Informal Resolution report last night at the Nuffield Foundation’s offices in London. It was a great turn-out, including representatives from Belfast, Dublin and Cardiff and a mix of academic researchers, policy makers and ombudsfolk. It wasn’t surprising that such an audience generated a lively discussion about the problems of terminology, what’s the right balance between informality and consistency, and whether informal resolution poses risks to justice and to the ombudsman ‘brand’.

We set out our findings in terms of what informal processes are called by the ombuds and complaint handlers who use them, how frequently they are used, what criteria are used to assess suitability, whether informally resolved complaints are published, and what training case handlers have in informal resolution.

A high point was a comment by one participant whose scheme is one of the 12 we had identified as not using informal resolution. He stood up and said, “I lied to the researchers! Now that I know what we’re talking about, I realise I do that…I just never called it that.”

He hadn’t lied to us, of course – but his comment illustrates the difficulties we faced with this project in trying to clarify what it is that ombuds and complaint handlers actually do when they are resolving complaints without investigation. He also highlighted what he thinks are the risks of formalising approaches whose success to some extent relies on their informality.

It’s clear that we have only managed to scratch the surface and produce a snapshot ‘map’ of a moment in time in ombudsmanry. If our report provokes further discussion, consideration and research on the actual work of ombuds, it will have been a success.

Now looking forward to our launch next week in Edinburgh!