The (ADDIE) Analysis - Data Collection Methods

What I found interesting regarding the different types of data analysis methods available was the fact that I either liked using that method or I preferred not to use that method. So, I thought to myself, why don’t I like that other method? What I found was that my managerial personality and business experience has impacted my thought process and now I have to overcome the urge to resist change. Kind of like this method agrees with how I would naturally think and process data. It’s a natural tendency for me, whereas the dislike comes from its not something I would normally want to do.

For example, I liked the Criticality Analysis because it is based on 4 task factors. The processed data and information are analyzed with the task’s frequency, difficulty, level of importance and lack of training. My brain says Bing, Bing, Bing, your training needs are THIS!

I also like the Observation method. The data collected is very useful as long as the observer is well trained in what the correct procedure performed should look like. It can also be used to indicate other issues that the client or stakeholder may not be aware of. This can be an added benefit and something that may need further attention.

Analysis (ADDIE model): I have used the following two methods to gather and analyze data with varying effectiveness.

Interviews:

I have conducted an analysis using the one-on-one interview process to collect data from the maintenance department technicians that perform DOT inspections on licensed vehicles and equipment. For your general understanding, every licensed vehicle or piece of equipment that is driven on the road has to annually pass a list of federal safety standards. Any vehicle or piece of equipment that is found in violation must then be immediately removed from operation, tagged and parked in an established downed area. The keys are to be removed and the unit must be locked and tagged out of service until the safety issue has been corrected.

The interview process was extremely useful, when used properly with a DOT safety inspection guide or form. A properly trained and experienced technician should not have any problem answering the required questions and or demonstrating the inspections. The data is then processed and quickly identifies individuals requiring additional training in respective areas. Companies that fail to conduct these inspections accordingly, or their vehicles and or equipment are found in violation of these standards are subject to penalties and possibly business closure.

Surveys or Questionnaires:

While working for a large freight corporation, I was asked to conduct an employee analysis using a survey pole that they liked using. The one in particular was the Gallup survey. The survey was easy to produce and distribute on-line via email. The response time was quick, usually within 2-3 business days and the results were immediately following the survey end date. These surveys were used to openly ask employees questions with regard to company practices, procedures, attitude, safety, …etc. All answered questions were said to be anonymous, but the questionnaire was returned via email from the employee.

I felt that the data results were not truthful and therefore ineffective. The reason that I say this is because previous history had indicated that if the results from the scores came back low, it had an immediate effect on the department manager. So, if an employee had an issue or was dissatisfied with an upper manager or corporate concern, the issue never went any further because the department manager was not to have any negative review towards their immediate management. Therefore, the negative attitude for upper management was never addressed.

We see it all of the time, companies are using surveys for everyday purchases, at fast food restaurants, dentist visits, doctors offices, and even with our utilities. It's to the point that people just don't care anymore and write in anything or whatever it takes just to make it go away!

In conclusion, I believe that data processing and analysis is a necessary step in all aspects of both business and in education. Therefore, we must do our best to understand the need and to do our part in the process.

Thank you, Mr. G