Research methods: How to find answers

2010 July 22

By Nicholas Covington
Article ID: 1412

Here’s how you can research the answer to (almost) any question you can think of, and how you can be reasonably certain that the answer is correct.

All research begins with questions. Researching a topic means you need to know more about it, which means that there is something you don’t know about it. What you don’t know forms your questions. The goal of your research is to answer these questions.

For example, here are some classics: What happened before the Big Bang? What is the meaning of life? How widespread is the H1N1 flu virus? What are the implications of Einstein’s work?

Next research the topic. Once you understand the field of study, you can likely figure out what resources you need to answer the question. For example, if you want to understand how to write well, you will be better informed if you consult an English teacher or a style manual rather than digging through peer-reviewed journal articles. So, is your question of a medical, scientific, philosophical, historical nature? Can it be properly researched?

Another question to ask: what knowledge do you need in order to answer your question? Is your question the kind of thing that you probably learned in middle school but just can’t remember? Or is it something known only by an accomplished expert? A little common sense can usually help here, and of course the answers can determine what sort of resource you should use. For example, if you want to know something about Newton’s Laws, you could probably find a good and easy-to-understand book at your local library (perhaps even in the children’s section). But if you have a question about String Theory it would probably be best to go to the adult section and find a book about modern physics written by an expert physicist.

How to find quality resources

Once you’ve gotten past those common-sense questions, the next thing you need to do is to obtain resource material (stuff that might answer your research question) and to become aware of the methods you can use to obtain these resources. These include:

  1. Books: Available at the library (of course!), bookstores, and Google Books
  2. Peer-reviewed articles, available by:
    1. Finding physical copies of the journals (which will be available in many libraries, especially in universities).
    2. Through an electronic database (which universities and colleges usually have, but which are sometimes funded by the state and available for public use. My home state hosts a “virtual library” which all can access for free).
    3. Through Google Scholar and other websites that act as databases for a single subject. For example, PhilPapers has an extensive collection of papers on philosophy. PubMed has a vast collection of medical and scientific literature.
    4. The author(s) of the paper. Many times I have found that I cannot access the full version of a paper that I want to read online. So what do I do? I Google the author’s name. Sometimes I add the subject that the author studies (For example, if the author of the paper I need is named John Doe and he works as a Mathematician, I google “John Doe Mathematics”). That can help you to find the author’s webpage (if she has one) and possibly some contact information. You can then get in touch with the author and write to her requesting a copy of the material. More often than not, the person is happy for someone to be interested in their work, and will gladly send you a copy.
  3. Websites: These are very easily found through search engines like ask.com and google.com. If you cannot find what you are looking for in your first search, try phrasing it a bit differently.
  4. Magazines: These are found, of course, in bookstores and libraries, although you can sometimes obtain certain articles by visiting the website of the magazine.
  5. Encyclopedias: Primarily found in libraries.
  6. Personal correspondence: On a number of occasions, I have looked up contact information of an author or well-known professor and have been able to obtain answers simply by emailing and asking. You could also write these people letters, or talk to a professor at your local university.
  7. Wikipedia: Yes, folks, I’m serious! Wikipedia is a treasure trove of resources because most articles have very detailed citations with links to more reputable resources. I’m not telling you to trust Wikipedia’s word on the subject alone. Instead, also look at the references Wikipedia provides (this is what makes Wikipedia useful; it can point you in the right direction). Read the references for yourself, critically analyze them and use any relevant information.

How to identify quality resources

One question remains: how do you tell a good resource from a bad one? How do you know that the resources you are using are feeding you accurate information? After all, there are all kinds of cranks and quacks lurking around the Internet, and the standards of print publishers are rarely better. Google may offer some good tools for research, but good research doesn’t come from Google alone: it comes from a cautious user. I’ve devised a set of criteria to find out which sources are good and which are not:

  1. The author of your resource should be someone well-credentialed in the field about which they are writing (or should frequently cite those who are well-credentialed). Being able to think through the problems of a complex and vast subject like, for example, Ancient History requires years of training in an academic setting. Reading the writings of historians or scientists will help you to see this for yourself: there are often certain problems within a field which an amateur thinks he can easily answer, but in reality he cannot because he has not learned enough to be aware of all the information about this problem or all the complications that may arise within it. Occasionally someone with lesser credentials is able to write something that receives high acclaim from true experts. An example is Kris Komarnitsky, an airplane pilot who wrote a book called “Doubting Jesus’ Resurrection” which was highly acclaimed by several historians and New Testament scholars. Kris’ book is easily recognizable as an exception to the rule of using mainly expert writing as resources, since his book cites a vast amount of scholarly literature, and, moreover, has been approved by many who do have the proper credentials.
  2. How do the majority of scholars react to the author’s writings/opinion? This may sound like the old argument from authority, but it isn’t. Most people’s minds work reliably enough to be able to draw sound conclusions, especially concerning data they’ve worked with for decades. The majority of experts is right far more often than not, and those dissenting from the majority should not be believed by those outside the field unless the dissenter convinces the majority of his opinion, or at least proves beyond reasonable doubt that the position of the majority is hopelessly fallacious.
  3. Through what venue does the author publish? Is it a venue where truth matters and there is high standard for critical thinking? This is why peer-reviewed journal articles are considered of greater worth than almost anything else. Medical doctors have no other reason to create journals except to improve their practice – there is no ulterior motive. Likewise, a publication may be seen as more trustworthy if it’s from Oxford University Press, because such institutions have strong incentive to maintain high standards of evidence and critical thinking. If they did not, confidence placed in them by the academic community would wither into nothing. On the other hand, many non-academic publishers have a primary goal to sell what makes money, whether the topic is true or not. These publications must be regarded with a higher degree of skepticism.
  4. Do the author’s statements stand up to critical scrutiny? If you find a source which contradicts itself, engages in fallacious reasoning, cites poor or unreliable evidence, et cetera, you have a right to be extremely suspicious of everything this author writes. On the other hand, writers who show amazing consistency, sharp reasoning abilities, and only appeal to good evidence should be trusted quite a bit more. (A word of caution: if you ever believe you have found a contradiction in a peer-reviewed paper or book, it might be best to read the material a few times and consider alternative interpretations of the text before concluding that it is contradictory. If all else fails, contacting the author about the problem and asking for an explanation might help clear things up. Nevertheless, the point still stands that logical contradictions and obviously bad reasoning can never be accepted, no matter how esteemed the source.)

Conclusion

We all have questions that we want to answer. And we want the right answers. The best way to do this is to use this variety of research methods. This will help you find as much information as possible, and helps “filter” the good information from the bad through critical scrutiny and by asking the right questions.



Other articles related to this topic:

9 Comments
2010 August 9
brad tittle permalink

I am torn. I completely agree with just about everything, yet, in our current age, there is a hick up. There are large amounts of bogus research and science going on.
Ex.
BPA — Bisphenol A — a substance that has done wonders for our food productions yet is now under attack because a minority opinion feels it is unsafe.
Breast Milk — Is being tauted as the second coming and anyone not feeding their child direct is causing that child harm.
and Finally.
Global Warming/Climate Change/Etc — A bunch of chicken littles running around saying the sky is falling and anyone pointing out problems with the “research” is a “denier”.
There are more, but on each of these you will find research supporting the wacky side of the equation. The results keep getting less relevant but keep getting published and keep making nonsense appear to be sense.
 

2010 August 10

Brad,

Good points! Researchers have to be careful that after they find what they’re looking for, it’s actually legitimate science. There’s another article addressing this:

What it means to be “Scientifically Proven”

2010 August 29
Tony Hollick permalink

 
Jest the best, that’s all.
 
http://en.wikipedia.org/wiki/Imre_Lakatos
 
Tony Hollick
 
 
 
 
 

2010 September 1

Well done Nicholas! And I am glad Andy made the comment that he did.  People take in and remember information that is consistent with what they already know and believe.  We are intuitively driven beings inclined to make lots of errors based on Confirmation Bias and Spinoza’s Conjecture.  The latter suggesting that we are likely to accept as true that which makes immediate sense to us.  We are inclined to reject as fallacious, information that confuses us.  And further, we are disinclined to put in the extra mental effort necessary to question our beliefs or to develop a better understanding of unfamiliar material.  I mention this because there is no reason to believe that these proclivities are exclusive to the uninformed.  Even learned folks make these errors.  One must make an extra effort to look at all legitimate sides of an issue.  This can be very difficult – but nonetheless, it is important.

2010 September 12
William Bean permalink

EBSCO Host
CINAHL
MEDLINE (full text)
Cochrane Library
Oxford Reference Online
STATREF evidence alerts
Google Alerts to keyword/topic/etc.
Ovid fulltext
I recommend getting into a college system, if you can find a way to stick around with an open student account, maybe schooling, maybe graduated but keeping your hand in the game taking minimester courses, having access to these resources is simply amazing. The POWER! Take a research course, or two, or three, take stats, learn about power, statistical significance, validity, reliability, and on and on. A few simple concepts well explained will allow you to shoot to the heart of a study and determine how worthwhile or worthless it may be. Also, instead of getting your research/science news as a trickle from large media outlets, set up alerts in Google or StatREF to get new articles all along. While everyone is freaking out about BiPA, HRT, or the latest cancer scare you’ll be on top of the overall trending on those topics and be a source of non-panic info for your friends and family.
Thanks, Sincerely, William Bean

2010 November 10

I just listened to my first DBS podcast “How to find answers” and really enjoyed it. I have recently read Massimo Pigliucci’s Nonsence on Stilts where the autor basically scrawled a 300+ page volume to make the same points you did in 15 minutes. I did enjoy the indepth treatment but there is a lot to be said succinct prose. Great job, you have a new subscriber.

2010 November 21

Thank you, Chris!

Andy

2010 November 26

While most of the things Nicholas said are true there are some stuff he didn’t underline and some stuff that are wrong:
Most notably, search engines should be your primary tool. Hunting books in the library etc is not in the spirit of current civilization progress – its very slow, its manual – no automation is possible – and it usually requires money. Furthermore, finding something on the internet is science per se – learn to use search engines language. This is probably easier said then done and one must devote high amount of time on various search engines to be able to find things correctly. Great place to learn is @ Fravia .
The other most important thing is that science can be dogmatic in nature. So even if the thing is published in most reputable science magazine or endorsed as official theory it might not be true, in some cases it can be even worst then knowing nothing (i.e. cholesterol myth). For instance, when Irwan Stone, Linus Pauling and Mathias Rath discovered that there is big probability that human beings suffer from genetic disease they named hypoascorbia (the lack of Vitamin C in the body – contrary to almost all other multicellular species humans can’t produce this vitamin) and proposed a solution for many cardiovascular diseases, medical community totally ignored their findings (later confirmed in many studies by alternative medicine pathway – orthomoleculary medicine), basically faked some experiments to prove they are wrong and continued to force toxic and patented stuff developed by pharmaceutical companies. Otherwise, entire section of medicine might be shut down (or reduced) and people and scientist practicing those disciplines would lost their jobs.
This is something that is proven to repeat over and over again during human history – new stuff, that contradict currently accepted theories are rejected and scientists finding different theories are disproved, mocked and ridiculed – happend to Linus Pauling for Vitamin C research, Lobachevsky for discovery of another geometry (even Gaus didn’t admit his research is valid), to Semmelweis who discovered that washing hands can prevent illness and death (thats why we call this phenomena today Semmelweis sindrome) and so on…
Databases like PubMed can also not be used as guide mark for what is right. For instance search for
Placebo fraud rocks the very foundation of modern medical science; thousands of clinical trials invalidated.
 
So, it gets little more complicated then described in the article :D
(and yes, BPA is poison)

2010 November 29
majkinetor permalink

 
Ok, lets see here clear example of bad research by first poster, brad title
 
There are large amounts of bogus research and science going on.
Ex.
BPA — Bisphenol A — a substance that has done wonders for our food productions yet is now under attack because a minority opinion feels it is unsafe.
Beginning in March 2011, the European Union (EU) will outlaw the manufacture and sale of baby bottles and containers made with bisphenol-A (BPA), a plastics chemical linked to endocrine disruption, developmental disorders, and other illnesses. The decision came after a series of new studies were released that highlight the dangers of the chemical, especially in babies.
 
Breast Milk — Is being tauted as the second coming and anyone not feeding their child direct is causing that child harm.
You can’t seriously question breat milk? This is not just bad research, but hole new level of ignorance. Its well known fact that babies not fed breast milk during the first year suffer health consequences. They even isolated what is missing in infant formulas – transfer factor. Those species independant proteins are “uploaded” from mother to baby via colostrum and are used within baby to ‘train’ new immune system. Infant formulas also contain less appropriate milk (cow’s) and many industrial toxins (BPA and friends).
 
 
 
 

Comments are closed for this entry.