What Makes Research Scientific?

• In Event: Mixed-Methods Education Research: Is It Science?

Abstract

The purpose of the symposium is to discuss the question: “Is mixed methods research scientific?” To begin to answer that question I move back to the question I pose above: “What makes research scientific?” This question requires an argument that includes the following assurances: the conceptual framework must be transparent; there must be consistency between the purpose, the problem, and the method; there must be estimates of replicability; and, finally, beyond these criteria is the quality of usefulness. A fundamental requirement is this: the researcher must understand what question he/she is asking in a study and why; in other words, clarity in the question and the purpose. The research question must be understood in the context of the purpose.
Using this conceptual framework in designing a research study, mixed methods should be more consistent with scientific methods than either qualitative or quantitative methods alone. Ridenour and Newman (2008) suggest 5 criteria a research endeavor must meet in order to be labeled scientific: (1). Systematic (formal, organized) in its processes and thinking; (2), Verifiable; (3), Replicable; (4), Self-correcting; and (5), Explanatory
These five criteria imbue a research study with scientific qualities (“heuristic purposes in building a scientific knowledge base” (Ridenour & Newman, 2008, p. 13). While quantitative research has traditionally been accepted as the scientific method, it is not whether a researcher uses qualitative or quantitative methods that make a study scientific. Rather, it is the consistency between purpose, research question, and method. Do these connections have trustworthiness? Secondly, there is a problem with relinquishing the label “scientific” to only quantitative studies. If the purpose of the study is consistent with quantitative methods, there is no problem. But, if the purpose is better met with multiple methods or mixed methods, then mixed methods would better fit the scientific criterion. Returning once again to the five criteria for science: one could argue that a researcher could meet these criteria with qualitative research, or quantitative research or with mixed methods research. If the purpose requires (i.e., is consistent with) mixed methods, then mixed methods would be scientific in that situation.

Author

• Isadore Newman, Florida International University