Bias and Credibility in Environmental Impact Assessment
Citation: Sharon Beder, 'Bias and Credibility in Environmental Impact Assessment', Chain Reaction, No. 68, February 1993, pp28-30.
This is a final version submitted for publication.
Can we expect environmental impact statements to be objective? If not, can the assumptions and value judgements in them be made more transparent? Can their biases be better aligned with the community interest? Sharon Beder attempts to answer these questions.
Environmental Impact Statements (EISs) have lost credibility with environmental and resident groups over recent years because they are being increasingly perceived as biased public relations documents. This arises in part because the community generally expects that an EIS should be an objective scientific report whilst many consultants and project proponents view an EIS as a supporting document prepared as part of the procedure for gaining approval for a project.
The goal of a completely objective document is illusory because science itself is socially constructed. This is exacerbated by the circumstances of EIS preparation where large investments, careers and the viability of businesses are at stake. It is therefore inevitable that the values and goals of those preparing an EIS will shape its contents and conclusions through the way scientific data is collected, analysed, interpreted and presented.
Because the EIS is done rather late in the planning process the project proponents will almost certainly have committed considerable financial resources to a particular option at a particular site. The EIS at this stage becomes another obstacle in a field of bureaucratic hurdles on the way to their end goal. Naturally, they will want that document to emphasise the advantages of the project to the community and to down play the disadvantages.
Occasionally there are gross abuses of the EIS system by project proponents who leave vital information out of an EIS or falsify results. For example, the Water Board omitted the findings of two studies of fish from its EISs for the Sydney deepwater outfalls. the studies were undertaken by the Fisheries Research Institute in the vicinity of the ocean outfall sites. In one study, seven out of eight blue groper sampled near the North Head outfall were above the National Health & Medical Research council (NH&MRC) maximum residue limits for mercury and one red morwong out of eight was also over. In the other study, red morwong and blue groper caught near the sewage outfalls were found to be accumulating dieldrin and DDT and of the 58 red morwong sampled, ten exceeded NH&MRC limits for dieldrin and five exceeded those limits for DDT. Several more were just under these limits for dieldrin and DDT. These omissions enabled the Board to claim that toxic waste coming through the outfalls would not be a problem when they were extended into deeper water.
Such blatant omissions, although sometimes difficult to detect, are probably rare nowadays. More often biases are subtle and arise from the many value judgements that are made at every stage of the preparation of an EIS. Some examples are given below.
Opponents to the Tunnel did not perceive congestion to be a problem at all. Ted Mack, Mayor of North Sydney at the time the EIS was displayed, argued that congestion shaped a city by encouraging the movement of people and businesses to other parts of the metropolitan area so that new centres of activity were established. Ross Blunden, emeritus professor of traffic engineering, argued that congestion encouraged people to change their journey times or take public transport. Both concluded that a second crossing, far from removing congestion, would merely attract more car traffic and that congestion on both crossings would be the eventual outcome.
Similarly, methods of analysing data can vary in the sorts of results they produce and data they require and those preparing an EIS will choose the methods using many criteria, apart from the `purely scientific'. Even where the method of analysis is uncontroversial, assumptions and judgements will need to be fed into the analysis. For example, a cost-benefit analysis for a road project will require estimates of the value of time saved and may require estimates of the value of bushland or open space lost to the community. Most EISs require some form of forecasting of population numbers or other human activities and this requires assumptions such as where people are likely to live and work and what their habits will be in the future.
It was agreed that, while the data only represented analyses of individual specimens, levels of heavy metals and pesticides detected in this small number of samples were such as to suggest that a potential public health threat or environmental hazard might exist within the study area...
Yet when the EIS for the Bondi outfall was published in 1979, the Water Board actually stated that
Whilst the statistical significance of the 1973 survey is not able to be clearly established the results are encouraging in that they indicate that no serious environmental problem existed even prior to the full implementation of source control of restricted substances...
There should be little, if any, impact from the development, upon the S.E.P.P. 14 wetland within the site... A less than satisfactory result in the performance of the works and associated artificial wetlands would result in a forced abandonment of the wetlands disposal option and cause Council to again pursue the ocean outfall option with its inherent high cost and public opposition.
These sentences were omitted from the final published version of the EIS and the following inserted in their place:
It is often argued by supporters of the system that the Environmental Impact Assessment process has built in checks against bias and distortion because the EIS is subject to public scrutiny when it is displayed and then it is assessed by government authorities. Those preparing the EIS, generally professional consultants, are aware of this and few would risk their reputations by preparing a shonky EIS. However, as I have been arguing, the bias in EISs is generally not of the type that can be pointed to as being incorrect or a lie or an omission. More generally, the consultants have merely made their choices and judgements at the more favourable end of a range that is scientifically credible.
Nevertheless there are ways in which the social shaping of an EIS can be made more transparent to the reader. Rather than attempting to appear objective an EIS should incorporate discussion of assumptions, choice of methods and different interpretations that can be made of the studies. Sub-consultants' unedited reports and raw data should also be made publicly available. The final EIS could be subject to peer review.
It has been suggested that peer review be anonymous because of the retribution that can be meted out to those criticising an EIS prepared for a powerful organisation or business interest. However, anonymity can also provide a cover for abuse since the reviewer cannot be held accountable for their comments. It is for these reasons, that whistle blowers and those that speak publicly against the work of their peers in the public interest should be encouraged and protected. Employees and sub-consultants should also feel free to speak out when they feel their work has been misrepresented or wrongly interpreted in the EIS .
The major factors preventing a more transparent and accessible EIS and an atmosphere conducive to free discussion of likely impacts arise from the way the Environmental Impact Assessment (EIA) process is itself structured. Those who prepare the EIS, or hire the consultants to do so, usually have much at stake, financially or politically. The consultants themselves can also have much to lose. Consultants are dependent on the judgement of clients and that judgement is based on whether they are perceived to be able to deliver what is required by the client. Consultants with overdeveloped consciences, who do not put the client's priorities first, are less likely to be given work in future. Professional integrity and codes of ethics don't always withstand such pressures.
Consultants could be more independent if they were not directly hired by project proponents. An independent panel with community representation could choose the consultants from tenders. Proponents would still pay the consultants. In this way a firm which compiled an EIS that led to the abandonment of a project would not be penalised for doing so by being denied EIS work in the future. Of course such a panel would have also to be independent from government because of the prevalence of government projects that would have to be assessed.
Biases would still remain since judgements would still be required but there would be a better chance that those biases would be aligned with the community interests rather than the project proponent's interests. Also there is more likelihood that consultants under such a system would be willing to make EISs more transparent to the public and to discuss uncertainties and unknowns. Nevertheless I have found both developers and EIS consultants opposed to such a scheme because it suits them and the cosy relationship they have with each other.
NB: A Guided Learning Course on EISs: Issues for Users by Sharon Beder is available from Engineering Education Australia. It contains 6 hours of video material, and several written booklets and uses the Sydney Harbour Tunnel as a case study.
Professor Sharon Beder is a visiting professorial fellow at the University of Wollongong.
Sharon Beder's Publications can be found at http://www.uow.edu.au/~sharonb