Method for first‐stage evaluation of complex man‐machine systems

Performance assessment is a valuable tool for determining whether or not a system is behaving satisfactorily and for isolating trouble areas if the performance is unsatisfactory. This type of evaluation is especially useful for systems that are in their initial stages of operation. If a new system represents a large‐order combination of men and machines, development of a satisfactory method for evaluating such a system is not an easy task. Experimental simulation involving actual (or laboratory) operation appears to furnish a feasible and realistic basis for such evaluations, By use of this approach, a model has been developed that seems to be acceptable for most evaluation purposes. This model is of a somewhat elementary mathematical form, being a linear sum of the contributions for important subdivisions with respect to system components and time; however, the model is elaborate in the sense that many inputs rely heavily on experience ‐ judgment considerations. Explicitly, a measure of effectiveness is developed which is based on a comparison of what the system did with what it should have done, as determined by the recorded results of the simulation exercise. An assessment of a system' s over‐all behavior can be obtained by performing an evaluation for each of a representative set of the important types of situations for this system.