hi guys,if the auditor general`s report was anything to go by it`s no wonder that you did not pass. Here is a couple of pages of what he found. i urge you to download the report from pgdb.co.nz and print it out and examine it then ask for a resit or your money back.
The quality of the examination questions
5.24 The most serious allegation made to us was that some of the examination
questions contained incorrect data or incomplete information, making it difficult
to correctly answer the question. We were told that the alleged faults with the
questions had been drawn to the attention of the Board on several occasions but
had been ignored.
73
Part 5 The examination system
5.25 We decided to have some of these questions independently reviewed to confirm
whether the questions could be answered. Our reviewer was a qualified engineer,
who had no involvement in the Board examinations or in any other Board activity.
He was asked to review 13 questions in the registration examinations and the
craftsman registration examinations for 2007/08. He consulted with two other
members of his engineering team.
5.26 The reviewer and his colleagues found mistakes in 10 of the 13 questions. The
mistakes were such that it would have been difficult for candidates to correctly
answer the question. In our view, some of the mistakes were so serious that it
would be unreasonable to expect candidates to be able to correctly answer these
questions. The mistakes included:
• A question in a craftsman common examination asked candidates to calculate
the discharge power from two pipes of different sizes. There is no such term as
“discharge power” in fluid dynamics. Asking candidates to answer a question
about a term that does not exist means that the question would be very
difficult to answer.
• A question in a craftsman plumbing examination asked a series of questions
about pump performance. The vertical height between the pump and the
water supply was not provided. Without knowing the vertical height, the
question cannot be answered.
5.27 There were mistakes in several other questions that would make them
unnecessarily difficult to answer:
• A question in the craftsman gasfitting examination asked candidates to
calculate the gas input rate for a gas heater. There were several mistakes in
this question. The specific heat capacity of water had been incorrectly stated.
The heating value of gas had been incorrectly written. The formula given in the
examination to calculate the input rate was incomplete.
• A craftsman gasfitting examination asked candidates questions about
installing a gas supply for a motel. Candidates had to make a number of
calculations, including calculating the size of gas pipe work from the first
stage regulator to the second stage regulator. There were several errors in this
question. The data provided to answer the questions stated “pipe size m”, when
it should be “pipe size mm”. The unit rating for the water heater was incorrectly
stated. The gas pressure from the outlet was not specified. Another part to this
question asked about the sizing of LPG pipe work. Information in the form of a
chart was provided to enable candidates to answer the question. However, not
enough information was provided to use the chart accurately.
74
Part 5 The examination system
• Another question said that 1kg of LPG will deliver 250m3 of gas, when in fact
1kg of LPG will deliver 0.5m3 of gas. The review team stated that this was “out
by a factor of 500”.
5.28 We gave the Board a copy of the report from our reviewers. The Board did not
agree that in all cases the mistakes meant that it was difficult for people to
correctly answer the questions. In its view, there were two questions that could
not be answered (the two questions described in paragraph 5.26), and there were
technical shortcomings in four other questions.
5.29 Although we have different views on the extent of the problems with examination
questions, we and the Board agree that some questions that have been used are
fundamentally flawed, and that others have shortcomings.
5.30 These problems take on more significance when put in the context of an
examination that comprises 11 to 16 questions, with a 60% pass mark. Having
some faulty questions could materially reduce the candidate’s chances of passing
the examination.
5.31 As already noted, the examinations have a high failure rate. Figure 1 sets out
recent pass rates for the different registration and craftsman (now certifying)
plumbing, gasfitting, and drainlaying examinations.
Figure 1
Percentage of applicants who passed examinations, 2004-2008
2004 pass
rate
%
2005 pass
rate
%
2006 pass
rate
%
2007 pass
rate*
%
2008 pass
rate*
%
Plumbing registration 31 12 37 32 36
Gasfitting registration 65 58 49 72 36
Craftsman common 32 58 37 23 34
Craftsman plumbing 31 38 63 35 20
Craftsman gasfitting 49 62 47 41 30
Drainlaying registration N/A N/A 75 55 51
* Combines the June and November examination cycles.
Note: N/A means not applicable.
Source: Plumbers, Gasfitters and Drainlayers Board (2009) Annual Report Year ended 31 March 2009, Wellington.
Use of unrealistic scenarios in questions
5.32 Another issue raised with us by representatives from training providers was that
some of the examination questions describe situations that are unrealistic. For
example, a question in a craftsman plumbing examination described the design
75
Part 5 The examination system
of a hot water system to be installed in a sports club to feed a number of showers.
It then asked candidates to calculate the plumbing requirements for the system.
One part of this question asked candidates to calculate the volume of water
that had to be heated and stored. The calculations showed that the hot water
tank would need to hold 2500 litres of water. We were told by a tutor that most
plumbers would not have encountered a hot water tank of this size and would
assume that their calculations were wrong and would not attempt the rest of the
questions.
5.33 Another plumbing tutor, with extensive experience in the plumbing industry, was
more explicit in his criticisms of this question. He told us that a 2500 litre hot
water tank does not exist and that the scenario described in this question makes
no sense. In the situation described in the question, where the hot water is to be
used only twice a day, for 30 minutes, plumbers would install instantaneous water
heaters, which would be a cheaper and more efficient system.
5.34 The issue of presenting unrealistic scenarios in questions had been raised with
the Board but rejected. The Board took the view that the point of such questions
was for candidates to be able to demonstrate that they can work through the
calculations and that they should ignore the scenario presented in the question.