Data & Data Analysis/ Statistics & Statistics

Generation of good quality data is very crucial. But once the data has been generated with lots of patience and perseverance, it has to be analyzed. There are some crucial questions that have to be addressed here.

1.   Should we be satisfied with just pie chart, bar charts?

2.  Should we leave everything to the software to handle?

3.   Should we hire a statistician to do all the work?

We analyze sample data for extraction of information. This information is drawn from the sample. But results obtained from this extraction are not only true for that sample it should hold true for the entire population. This process is the core of Statistics. We get data from a sample but the results are generalized for the entire population. Some uncertainty is involved in this generalization process. This is quantified by probability or level of confidence.

This process can be linked to squeezing of a lemon. Here lemon is a metaphor for data.

1.       Extraction of information by Statistics/ Data Analysis is like squeezing of a lemon for the lemon juice.

2.       Right amount of pressure is to be applied for extraction of right amount of juice.

Correct statistical tools have to be applied to the data.

3.       If we apply less pressure we have less lemon juice. The lemon is wasted as much of the juice within the lemon is not extracted.

If we just use simple graphical representations, we are not realizing the potential of data. Our patience and perseverance used in data generation goes to waste as we have not utilized the data to its full extent.

4.       If we apply more pressure than required the lemon juice become bitter.

If we don’t use correct statistical methodology or overuse various methodologies then the information inferred might not be correct.

So appropriateness of the methodology should be questioned at every step.

5.       Should we let the device decide (How much of lemon should be squeezed)? Should we leave everything to the statistical software?

The Statistical Software works under our instructions. We decide which methodology will be suitable for the data and give instructions accordingly.  The software simply obeys our order with the commands (in a programming language) that we give. Our knowledge is very important and software is just obeying our commands. If we give wrong instructions due to inadequate knowledge the software cannot tell us that we are applying wrong methodology.

6.       Should we let somebody else squeeze the lemon? Should we hire a statistician?

A statistician can do the analyses suitable for the data. But we should have enough knowledge.  We can monitor his/her progress and see whether the analyses are being steered in the right direction. Our knowledge is also very crucial and it will complement the work of a statistician. It can also crosscheck his work in many situations.