Educational and methodical material on the topic: Method of observation. Stages of observational research

  • 10.10.2019

Each of us daily uses the method of observation in Everyday life. We're watching the game children, for patients of polyclinics while waiting for an appointment, etc. Sometimes we generalize observations and share them with other people, sometimes they are just glimpses. WITH professional approach We meet for observation when the commentator informs us about the events on the football field, the cameraman shoots with a hidden camera the participants in the observed events, the teacher, testing a new teaching method, observes the behavior of the class in the lesson, etc. Thus, in many areas of social practice, observation is successfully used to study reality. In science, the method of observation has also been used for many centuries, although in methodological terms it has become the object of close study, especially in recent years.

Observation can be defined as a method of collecting social information by directly studying a social phenomenon in its natural environment.

In sociological research, there are two varieties of the method of observation, depending on the degree of standardization of the observation technique. Standardized Observation Technique involves a detailed list of phenomena, events, characteristics, signs to be observed, the definition of conditions and situations of observation, instructions for observers, uniform cards for registering observed phenomena. This type of observation is called structured or standardized.

The second type of observation technique is unstructured or non-standardized observation. In this case, the researcher determines only the general directions of observations, and the form of data recording is the observer's diary, where the results are recorded in free form directly during the observation process or later from memory.

An example of a standardized method of observation is the method most often used by economists of momentary observations of the use of equipment and the cost of working time. The essence of this method, which sociologists can also use to solve their problems, is that a group of observers, using a standard method, fixes not the absolute time spent or equipment downtime (work, negotiations, downtime, etc.), but the fact itself, those. the number of observed cost types at the time of the survey. To register momentary observations, a special "Observation sheet" is developed, which is a table. The rows of the table contain serial numbers and surnames, first and middle names of workers and rows for summarizing data by columns. The columns contain data for the following sections.

Normalized time (work):

Preparatory and final;

operational work;

Workplace maintenance;

For rest and personal needs;

Total work.

Non-standardized time (losses):

1. For organizational reasons:

lack of material;

walking for materials, blanks;

waiting for vehicles;

2. For technical reasons:

lack of fixtures, tools, documentation;

waiting for repair and repair of equipment;

adjustment and readjustment of equipment;

lack of electricity;

3. For reasons dependent on workers:

late start and early end of work;

Without good reason;

other reasons;

total loss of working time.

4. Number of observations (bypasses per shift).

Bypass number.

Tour times:

ending.

The "observation list" also includes data from the place and time of observations (shop No.), site ____, date of observation, number of workers, number of observations, number of rounds ___, shift ____, purpose of observations.

The researcher develops and includes in the observation sheet a route around the observed objects.

The method of momentary observations can be used to study the work of enterprises in the service sector, health care, etc. The possibilities of this method are far from being fully used by sociologists.

Another example of standardized observation is the method of self-photography of time budgets (daily or weekly). In this case, the methodology is based on self-observation of the respondent and registration of time spent in a specially designed standard form containing a list of activities during the day (according to the rows of the table) and special columns (table columns) intended for recording time costs.

Unstructured observation is used most often in preparatory stage research, when the researcher needs to better understand the problem situation, “feel” the contours of the problem, clarify hypotheses, find out possible sources information on the problem under study and methods of working with them.

An example of such use of observation is the participatory observation conducted by a Belarusian sociologist at the stage of developing a research program. The subject of the study was the attitude of the workers of one of the Minsk factories to new system labor organization. The sociologist-observer worked at first in auxiliary jobs, which made it possible to contact many members of the primary team, observe various production situations, join the team, and adapt to intra-group norms. Then the sociologist-researcher began to work as a machine operator, joining the observed situation from the position of a professional worker. The results of the observation were recorded daily in a diary. It should be noted that after the initial adaptation in the team, the sociologist revealed his "incognito" and the observation became open. The results of observation were used not only for content, but also for methodological purposes for comparison with the results of a questionnaire survey. According to this study, information about the attitude of a worker to a foreman, shop manager, in cases where it is obtained by the method of questioning, is more subject to situational influences than when using the observation method. Another methodological result of participant observation was the formation of requirements for participant observation. Let's take a look at the most important of them. First, the sociologist-observer must work in the group under study in a specialty that is not very complex. Otherwise, there is no time for observation - all attention is focused on production operations. Secondly, the work that the sociologist-observer performs should make it possible to contact many members of the team in order to observe them in various production situations; thirdly, the sociologist must have initial professional industrial training to enter the observed team.

The collection of data in unstructured observation does not exclude systematization during their processing using formalized methods that involve obtaining some quantitative characteristics. Often the result of unstructured observation is the development of standard, formalized observation procedures.

Observation in sociological research can be used both as a stage of the research process and as an independent method of study. In the latter case, it is most effective for social phenomena whose development can only be understood within their natural environment. Surveys and experiments are focused on measuring social characteristics in some conditional situation. For example, in a public opinion poll, an individual may be interviewed at home, at the workplace. But not all phenomena can be studied in this way. Deviant behavior, socially disapproved actions, religious behavior, etc. requires active involvement of observation methods. One of the brightest studies in this respect was the study of the life of Chicago tramps by the tramp N. Anderson using the method of participant observation. History knows many other studies of this kind, carried out later: this is the work of Thrasher on the study of urban gangs (Chicago 1928), W. White on the study of gangs in Boston, etc.

The method of observation plays an independent role in the study of unique and fleeting phenomena. public life, and in the monographic study of individual local objects and phenomena.

Schematically, several types of social phenomena can be distinguished that can become objects of observation: these are individual actions of individuals and groups, activity as a whole, the meaning of actions, participants, dependencies between individuals and groups, environment (environment).

Let us give an example of the development of methodological tools for studying meetings as a channel for expressing public opinion. The standardized observation procedure provided for the division of the meeting into separate components. A separate registration card was developed for data collection and registration. V total The observation procedure includes nine documents (cards) for recording data for individual stages, periods of the meeting:

I. general characteristics meetings:

Date of the meeting.

Enterprise (institution, organization)

Subdivision.

Type of meeting (industrial, trade union, general);

Agenda.

Scheduled meeting time (hour, minute).

Location of the meeting.

Start time of observation.

Space for additional notes by the observer (if the meeting did not take place, indicate the reasons for the disruption or rescheduling, briefly describe the place where the meeting took place).

II. The situation just before the start of the meeting.table. The rows of the table record elements of behavior, reactions: conversations, including those related to agenda items and extraneous conversations. According to the columns of the tables, the shares of the meeting participants who have certain conversations are fixed (majority, about half, minority, several people, 1-2 people). This card has a place for recording topics of conversation, remarks and manifestations of attitude towards the meeting. Columns are allocated for notes on whether the presence of an observer violates (or does not violate) the natural ho events.

III. organizational period. This card, like the others, contains a coded list of variables, where the observer only circles the code corresponding to the observed situation.

1. The meeting started:

a) at the appointed time;

b) 10 minutes late;

c) with a delay of up to 20 minutes;

d) with a delay of up to 30 minutes or more.

The list consists of _____ people; it is announced that people are present; observation data, pers.

The meeting was attended by (observer estimate):

a) the vast majority;

b) the majority;

c) about half;

d) less than half.

4. The composition of the presidium was proposed:

a) the person who opened the meeting;

b) one person from the audience (list);

c) several persons from the audience (personally).

5. The composition of the presidium was approved by the meeting:

a) according to the list;

b) personally.

6. Situation during the elections of the Presidium, approval of the agenda and regulations. This situation is recorded in the table, where the rows contain descriptions of the elements of behavior for the following four groups.

First group:

a) showing interest in the composition of the presidium”;

b) lack of interest in the composition of the presidium;

c) the situation is unclear.

Second group:

a) showing interest in the subject under discussion,

b) lack of interest in the issue under discussion;

c) the situation is unclear.

Third group:

a) a proposal to increase the time for the report (speech);

b) a proposal to reduce the time for a report (speech);

c) there were no disputes under the regulations;

d) the regulations were not established. The fourth group:

a) the presidium proposed to be recorded in the debate;

b) the presidium did not propose to be recorded in the debate.

The columns of this table include the proportion of meeting participants for whom certain elements of behavior are observed, indicated in the rows of the table. Participants of the meeting: majority, about half, minority, several people. The table provides space for recording statements, remarks and visually observed reactions of meeting participants.

The following documents were developed to explore other elements of the collection.

Card of the speaker, speaker.

A card for registering the reactions of meeting participants to a speech, report.

VI. Card of observation of the general situation during the debate.

VII. Card of observations of the situation during the decision-making on the agenda item.

VIII. Card of observation of the situation during the adoption of amendments and additions to the draft decision.

IX. Post-meeting follow-up card.

Observation is a purposeful perception of a pedagogical phenomenon, during which the researcher receives specific factual material. At the same time, records (protocols) of observations are kept. Observation is usually carried out according to a predetermined plan with the allocation of specific objects of observation. This method involves purposeful, systematic and systematic perception and fixation of the manifestations of psychological and pedagogical phenomena and processes.

The features of observation as a scientific method are:

    focus on a clear, specific goal;

    planning and systematic;

    objectivity in the perception of the studied and its fixation;

    preservation of the natural course of psychological and pedagogical processes.

Observation is a very accessible method, but it has its drawbacks related to the fact that the results of observation are influenced by the personal characteristics (attitudes, interests, mental states) of the researcher.

Observation stages:

    definition of tasks and goals (for what, for what purpose the observation is being carried out);

    choice of object, subject and situation (what to observe);

    choosing the method of observation that has the least effect on the object under study and provides the most necessary information (how to observe);

    the choice of methods for recording the observed (how to keep records);

    processing and interpretation of the received information (what is the result).

Question No. 19 The subject of pedagogical observation and types of observations. Means of observation.

Observation can be:

    purposeful and random;

    continuous and selective;

    direct and indirect;

    long and short term;

    open and hidden ("incognito");

    ascertaining and evaluating;

    uncontrolled and controlled (registration of observed events according to a previously worked out procedure);

    causal and experimental;

    field (observation in natural conditions) and laboratory (in an experimental situation).

Distinguish observation included, when the researcher becomes a member of the group in which the observation is conducted, and non-included observation - "from outside"; open and hidden (incognito); complete and selective.

Observation as a research method requires the researcher to follow the following rules:

    clearly define the objectives of observation;

    draw up an observation program depending on the goal;

    record the observational data in detail;

Observation is a complex process: you can look, but not see; or look together, but see different things; look at what many have seen and see, but, unlike them, see something new, etc. In psychology and pedagogy, observation turns into a real art: the timbre of the voice, eye movement, dilation or contraction of the pupils, slightly noticeable changes in communication with others and other reactions of the individual, the team can serve as the basis for psychological and pedagogical conclusions.

The means of observation are different: observation schemes, its duration, recording technique, data collection methods, observation protocols, systems of categories and scales. All these tools increase the accuracy of observation, the possibility of recording and monitoring its results. Serious attention should be paid to the form of record keeping, which depends on the subject, objectives and research hypothesis that determine the observation criterion.

Like any method, observation has its own strengths and weaknesses. TO strengths should include the possibility of studying the subject in its integrity, natural functioning, living multifaceted connections and manifestations. At the same time, this method does not allow one to actively intervene in the process being studied, change it, or deliberately create certain situations, or make accurate measurements. Consequently, the results of observation must necessarily be supported by data obtained using other methods of psychological and pedagogical research.

The observation program must accurately determine the sequence of work, highlight the most important objects of observation, methods for fixing the results (protocol notes, diaries of observations, etc.).

Observation method- one of the main empirical methods of psychological research, consisting in a deliberate, systematic and purposeful perception of mental phenomena in order to study their specific changes in certain conditions. Method of observation in zoopsychology It is used both to observe the natural behavior of animals in their habitats, and in artificially created conditions.

As G.G. Filippova notes, the essence of the method of observation is the careful and consistent recording of all behavioral manifestations of the activity of the object of study. The advantage of the observation method is that it is carried out in natural conditions for animals. Researchers study and track the changes that occur in the behavior of an animal with certain changes in the environment. This information makes it possible to draw conclusions both about the external causes of mental activity and about adaptive forms and functions of behavior. The result of observations is a qualitative assessment of the activity and forms of manifestation of the animal (for example, the interest for zoopsychologists is the observation and analysis of the usual, unsupported manipulation of animals with certain objects).

Despite the seeming elementary nature (to look and fix what you see), the method of observation is very complex. Its effectiveness depends entirely on the experience, research skills of the observer, the accuracy and quality of his work.

As a scientific method, observation has its own principles of organization and conduct, rules, as well as methods of implementation (specific methods), which are disclosed by G.G. Filippova. So, to the main principles The author makes the following observations:

1. Objectivity. According to G.G. Filippova, this essential principle observation, closely related to the very essence of the scientific approach to the study of the psyche of animals. The researcher cannot directly penetrate into the subjective world of another living being (this is especially true for the animals with which we interact) and evaluates it only by behavioral manifestations. Objectivity in observation means that the researcher describes only those behavioral manifestations that he directly sees. Compliance this principle is directly related to the qualifications of the observer, his skill and ability to impartially and accurately record the observed facts.

2. Systematic. In order to avoid errors in the interpretation of the obtained data associated with the situational state of the animal (which, in particular, may be due to the situational state environment), it is expedient to carry out observation repeatedly and systematically. Thus, atmospheric pressure has a different effect on the activity of warm-blooded animals with different individual characteristics. nervous system and in order to draw an objective conclusion, it is necessary to carry out an analysis of very a large number factual data on the features of behavioral manifestations not only of different representatives of the same animal species, but also of their different species. Multiple, systematic observations will help provide this evidence.

3. Data capture accuracy. The complexity of observation is also due to the fact that the researcher needs to simultaneously observe the behavioral manifestations of the animal, its activity, and record these data. Solving these two problems at the same time will help high level professionalism, qualifications of the researcher.

4. Ensuring the natural behavior of the subject in an observation situation. It has already been noted above that the advantage of observation lies in the fact that it is carried out in natural habitat conditions for the animal. The researcher must not influence the behavioral manifestations of the animal being observed. This means that the animal should not be aware of the presence of the observer or perceive it as a natural component of the environment, which is possible only if the animal is used to the researcher and does not change its behavior in his presence.

Observation Rules :

1. Setting the goal of observation. According to G.G. Filippova, there can be two such goals: 1) obtaining a general picture of the behavioral manifestations of the animal (as a rule, given task is decided at the preliminary stage of observation, when all the behavioral manifestations of the animal are recorded, a general idea of ​​its species and (or) individual features); 2) a specific goal, involving the observation of a certain form of behavior, certain life cycles, etc.

2. Choice of observation technique. The method of observation is determined, first of all, by its purpose. The conditions under which the observation is carried out will be no less significant for the choice of observation methodology. The means used for fixing data, as well as the characteristics of the animal under study, are also important.

3. Repeated observation. As noted above, this will ensure that the principles of objectivity and systematicity are respected. At the same time, it should be noted that the frequency of observations is determined by the goals and features of the observed form of behavior. The results of a single observation can only be interpreted as hypothetical assumptions and should be further verified.

Observation technique – methods and techniques for organizing observation and fixing the observed data. Choice specific methodology observation, as noted by GG Filippova, is due to its purpose, the degree of knowledge of the observed animal, the form of its behavior, as well as the conditions of the observation.

In zoopsychology, the following types of observations:

1. Continuous observation when all the behavioral manifestations of the observed animal are recorded accurately and in detail. As a result, the researcher receives data on the general picture of behavior, its dynamics, as well as the most striking individual features of the object of observation. As a rule, continuous observation is the basis for the implementation of other types of observation. In addition, it is on the basis of the data obtained as a result of continuous observation that general hypotheses and specific goals for further research are formulated. Continuous observation can also be used as an independent type of observation if the goal of the researcher is to study the daily dynamics of the animal's behavior (for example, when studying ontogenesis or cyclic changes in animal activity).

2. Selective observation. It involves setting a specific goal of observation - a detailed and detailed description of certain forms of animal behavior (for example, manipulative activity, play activity, forms of interaction of animals with each other, etc.). To conduct selective observation, the phases of the daily activity of the animal are distinguished, when the studied form of activity is most pronounced. Observation is carried out repeatedly, which ensures the accuracy, detail and detail of the description of all the features of the behavior of the animal.

3. Included Surveillance. This type of observation implies the involvement of the observer in interaction with the observed animal (for example, observation is carried out during the training of the animal or caring for it). Participant observation provides very accurate information about the characteristics of the animal's behavioral manifestations, since it allows you to identify the goals and motives of behavior with great certainty. At the same time, participant observation requires great skill from the researcher. In addition, involvement in the observed process complicates the procedure for fixing the data obtained (much has to be recorded only in memory and reproduced only at the end of the study).

As noted above, the effectiveness and efficiency of using the observation method is largely related to the methods of fixing the data obtained. It should be noted that in zoopsychology, as methods of fixing the results of observation, either manual fixation(recording what is observed on paper with a pencil or pen), or fixation with technical means(video and audio recording). At the same time, the use of the second method of fixation (technical means) in the observation of animals is very limited (such a limiter can be the mobility of the animal, the presence of any devices, strangers, etc.).

Fixing (recording) the observed is called the "observation protocol". The following types of logging of observed data are used:

continuous recording - involves the most detailed fixation of all behavioral manifestations of the animal. Can be used in all types of observation, but most often used in the process of continuous observation;

Selective logging - involves recording only those data that meet the purpose of observation. This method fixation is applied in the appropriate type of observation;

Time-based protocol - used if it is necessary to identify the dynamics of behavioral manifestations. The observation protocol is divided into time intervals (for example, several minutes or hours). In each such time interval, all behavioral manifestations of the animal are carefully recorded. The time-based protocol allows you to quickly and accurately identify the temporal features of the behavior of the animal. Compulsory technical means, which is used in this form of data recording, is a stopwatch;

· Behavioral Protocol - involves partial processing of the received data already in the process of observation. According to GG Filippova, this form of recording is the most difficult. A series of continuous and selective observations is preliminarily carried out, which makes it possible to identify the forms of animal behavior that are of interest to the researcher (for example, manipulations, acts of communication, etc.). The protocol, in addition to time intervals, is divided into vertical columns, each of which describes a specific form of animal behavior. Maintaining such a protocol requires a high qualification of the researcher;

The use of graphic diagrams. When maintaining such a protocol, all movements and behavioral manifestations of the animal are recorded in parallel and sketched on the diagram. This is an even more complex and time-consuming form of logging. In addition to time-based and behavioral forms, it uses graphic diagrams illustrating the movement of an animal in space. Such graphic schemes are prepared in advance, and all the objects necessary for keeping the protocol are marked on them. The number of graphic schemes, as a rule, corresponds to the number of time intervals. Using graphic schemes, one can not only accurately describe the dynamics of behavior, but also the speed of movement, the frequency and intensity of the interaction of the animal with surrounding objects, etc.;

information coding. This form of logging is mainly used when observing complex and dynamic forms of behavior (for example, manipulating objects, communicating with relatives, etc.). A series of observations is preliminarily carried out. All forms of observed behavior are described in detail and divided into separate components (acts). In addition, each act is indicated by a conditional icon. As a result, the fixation of the observed is carried out by means of these conventional icons (rather than words).

Like all scientific methods, the method of observation has both positive aspects and disadvantages.

According to G. Filippova, the advantages of the observation method are its objectivity, obtaining data on the integral and natural behavior of the animal, the complexity of the data obtained and the high degree of their reliability, the correspondence of the animal's behavior to its actual motivation.

The disadvantages (or, according to G.G. Filippova, limitations) of the observation method are the need for a high qualification of the observer, the impossibility of repeated observation of the same fact under the same conditions, the difficulty of fixing data during field and participant observation, as well as the complexity and ambiguity in the interpretation of the observation protocol, since descriptive data recording is most often used.

Also, giving a description of the method of observation, it should be noted that in the study of the psyche of animals, observation can be used not only as an independent method (when carrying out longitudinal studies aimed at studying the development of the psyche of an animal in ontogenesis), but also as a component of the experimental research procedure (observation data allow us to analyze the behavioral act and identify how the animal achieved certain results, to characterize the process of solving the problem itself).

Methods of observation and experiment are used to test the hypothesis.
Observation as a method of cognition is one of the most used in science. The term "surveillance" has several meanings. In the ordinary sense, observation provides an opportunity to orient oneself in the environment, to bring one's actions into a system in accordance with changing conditions. Educational observation gives the student an idea of ​​the objects, processes, dependencies, quantitative, qualitative, and spatial characteristics of what is being studied. Since the method of observation appears among the epistemological tools of scientists, there is also general definition: observation - intentional and purposeful perception outside world in order to find meaning in phenomena. In order to conduct observation, it is necessary to develop such a quality as observation, which can be described as an activity aimed at analyzing the fact under study, the event in order to identify a certain pattern. In science exploratory observation is presented as one of the universal tools of the scientist. Observation can be done with the help of the senses and instruments.
According to psychologists, the more sense organs are involved, the higher the productivity of observation. A person can cover various aspects of observation: visual, auditory, olfactory, tactile, tactile sensations.
Despite its apparent simplicity, exploratory observation is quite complex, has its own stages of improvement and productivity conditions. Difficulty this method lies in the fact that the researcher needs to distinguish the observed phenomenon from the general picture of those phenomena and processes against which it occurs. The main function of observation is the selective selection of information about the process under study in
direct and feedback researcher with the object of observation.
Observation gives science new facts that cannot be explained within the framework of theory. Attempts to explain the results of observation stimulate the development of cognitive and creative activity, contribute to the development of the personality of the researcher.
The essence of observation is that the state and change of the object under study, its quantitative, qualitative, structural, indicative, vector, dynamic changes are consistently displayed and fixed in the mind of the researcher. In this case, the observation method can be used as independent way research problem solving, as well as component other methods.
To understand the content research method observation, its grouping is necessary. It is possible, for example, to combine observation according to the type of connection of the researcher with the object of study and to single out such varieties of it as direct, indirect, open, hidden. The grouping is based on signs of time and space: continuous, discrete, monographic, special, etc. observation. .

More on the topic OBSERVATION AS A RESEARCH METHOD:

  1. Experimental method - as a central method among the empirical methods of psychological research.
  2. Chapter 2. GENERAL CHARACTERISTICS OF CLINICAL OBSERVATIONS AND RESEARCH METHODS
  3. OBSERVATION AS A METHOD OF STUDYING A CHILD WITH DEVELOPMENTAL DEVELOPMENTS. CONVERSATION WITH THE CHILD AND PARENTS AS PART OF THE DIAGNOSTIC PROCESS.
  4. Methods of psychogenetic research. genealogical method. Family studies. Foster child method.
  5. Question 23 Tests as a method of diagnostic research in clinical psychology.

Main characteristics

Observation as a research method is a purposeful, developed according to a prepared plan, fixing the phenomena under study for the purpose of their subsequent analysis and use in practical activities. What is observed, how, using what tools, the sociologist displays in the research program. In addition, it substantiates hypotheses, basic concepts, tactics in general.

Observation as a method of sociological research

The famous Russian sociologist Yadov V.A. by this concept means the direct registration of facts, phenomena, events by an eyewitness. Scientific observation differs from everyday life. It is one of the most common methods in sociology, psychology and other sciences. As a matter of fact, the creation of any work begins with it.

Classification

Observation as a research method according to the degree of formalization is divided into:

  • Uncontrollable. This is a non-standard structureless process in which the researcher uses only the general principal plan.
  • Controlled. The researcher develops the entire procedure in detail and follows the initially prepared plan.

Other varieties of the method

In addition, there are differences depending on the position of the researcher who conducts the observation. As a method of research in theory, it is proposed to distinguish between still participatory and simple observation.

Contributory

It is included, it implies the adaptation and entry of the author into the environment that is to be analyzed and studied.

Simple

The researcher captures events or phenomena from the outside. This and the previous cases allow open way observation. As a research method, you can use the hidden option and disguise yourself.

Stimulating observation

This species is a variant of the included. Its difference lies in the creation of an experimental environment in order to better reveal the characteristics of the object under study.

Observation as a research method: primary requirements

1. Formulation of a clear goal and clear research objectives.

2. Planning. The procedure for carrying out the method is considered in advance.

3. Recording data for the purpose of objectivity and accuracy. The presence of diaries and protocols.

4. The ability to control information for stability and validity.

Observation as a method of psychological research

In psychology, it can exist in two forms:

  • self-observation (introspection);
  • objective.

Useful advice

Often self-observation is a component of the objective, then it is important for the researcher to direct the questions of the individual not to communicate his emotions and feelings, but to coordinate his actions himself and thus determine the patterns unconscious by the recipient, which would be the basis of the corresponding processes.

Advantages of the method of observation in psychology

  • the possibility of studying mental processes in life conditions;
  • display of events in their course;
  • obtaining information about the actions of individuals, regardless of their attitudes towards the appropriate behavior model.

Expert opinion

Experts say that observation is still better used in combination with other scientific methods research for greater reliability and objectivity of data.