Showing posts with label qualitative research archiving. Show all posts
Showing posts with label qualitative research archiving. Show all posts

Thursday, August 9, 2012

das Steinkind von Leinzell, Philosophical Tran...
das Steinkind von Leinzell, Philosophical Transactions of the Royal Society of London 31, 1720-23 (Photo credit: Wikipedia)



In the July 2012 newsletter from FQS, there is a wealth of information about the Open Access issue.

The url below will get you to the latest issue of the journal, but that's not the newsletter--sorry, but this is a start. 

http://www.qualitative-research.net/index.php/fqs/issue/current

Three policy statements that have powerful implications for qualitative researchers are:

The Royal Society of London's Report:   http://royalsociety.org/policy/projects/science-public-enterprise/report

Research Council of the UK's Report:  http://www.rcuk.ac.uk/media/news/2012news/Pages/120716.aspx

European Commission in Brussel's Report: http://europa.eu/rapid/pressReleasesAction.do?reference=IP/12/790&format=HTML&aged=0&language=EN&guiLanguage=en

A country and a collection of countries have come to the decision to archive publicly funded data.  The open access is not just about publication, but about the data that was collected--the project has now become a product--a thing of value. 

In the US, the response has been slower, but agency by agency we are coming around to the same place.

There are policies now in place for the National Science Foundation and the National Institutes of Justice...and more are coming in line.

Qualitative researchers need to wake up, smell the coffee, and start discussing this issue.  I think it is one of those things with great opportunity and significant dangers.  
Enhanced by Zemanta

Questions about archiving qualitative research data

English: Integration of Quanitative Data for Q...
English: Integration of Quanitative Data for Qualitative Analysis and Mixed Methods Research in a Web Based Computer Aided Qualitative Data Analysis Software (CAQDAS) (Photo credit: Wikipedia)
A friend who has been following the blog posts on qualitative research archiving, sent me an email with some great questions.  I am going to post them here and use them as musing points. 


A couple questions...

1. Perhaps I've missed it along the way (it's entirely possible!)... WHY is it important to and why should we archive qualitative data? For many studies, do the field notes and recordings of interviews/interactions and images and elicitations have meaning outside the context of the researcher/participant relationship?
 This is a very intriguing question...I would actually split it into two parts:
1.  WHY should we archive qualitative data?

For years, I personally have been baffled by the fact that qualitative researchers in many fields are tossing out all their data as if it would produce a deadly virus 5 years after collection.  This was not the case in anthropology where they were trying to salvage dying cultures...it was OK for them to go back again and again and save everything.  Whether or not their collections are archived kind of depends upon the fame of the scholar and the importance of the area they studied...to someone.

But, and I think it was in the more sociologically dominated area of qualitative research we began to  think with the medical model created for taking human samples.  You have a short amount of time to work with the material, and then it is gone.  So,it does emphasize, I guess the ephemeral notion of what led to the data...that moment has passed; it will never come again?   Maybe this is a part of why qualitative researchers seem resistent to the notion of thinking about databases? 

However, the people that pay for these studies--policymakers and government institutions have finally figured out that this is very costly.  I'll post some materials later related to recently policy decisions in the EU and UK and have changed the tide.  The US is also following suit.  

From the point of view of teaching QR, we have never had good databases of mature projects that we could use with students.  So, essentially we seldom get beyond teaching data collection 101...we lack examples of full projects to examine.  (And then what is a full project...the raw data?  Material organized in a software program?)

2.  and then...why should the data collected in the interaction of researcher/participant relationship have meaning beyond that point?

This is a fascinating point to raise.  There is a strong bias among many qualitative researchers in this direction--if you weren't there; you just don't know.   But if we agree to that point, then what can we ever know about the events where we weren't there and were not a direct party to the interaction?  I think there are different kinds of knowing:  primary experience is great, but secondary analysis has value too.  You shouldn't confuse the two; you would need to have some caveats about what one can ascertain from archived data vs data you collected yourself.  

Where would historians be if they didn't agree that secondary analysis of data can be useful?  As we try to make sense of Greek culture, for instance, we review the reviews of the reviews of the reviews every generation, persistently reanalyzing our interpretations.  No, we were not there, but we still have a lot to say about the time and place that has value. 

2. If it is important to archive our data (presumably to make it available to others???) how do we approach this at the time of seeking ethics/IRB approval, especially given that most expect you to destroy "data" after 3-5 years? What are the ethical implications of preserving and archiving qualitative data that in many cases could be tied back to the participant, possibly identifying them?
Well, this is the 1 million $$ question, isn't it--how do we do this ethically?  What does it mean to create a data management plan with intent to archive not destroy?  I think this is why we need to get in right now and start adding our 2 cents to the discussion.  I don't think there is going to be any going backwards on this one--the horse has left the barn--but we can participate in discussions about useage.  

Standards we might have to create include:
1.  How do we develop an informed consent process that includes the aim to archive?
2.  How do you scrub data so that it meets the standard of privacy you established with your participants?  What does that mean if you are archiving just the raw data?  the software embedded version? or distributed data collection that included various net-based tools?
3.  How might levels of permission be structured?


Is this mostly about "open data" formats or it is about access to source data by researchers 5, 10, 20, 200 years down the road?
[I had just written a great response to this and my connection timed out and I lost it...here goes again]

One of the very important underlying questions here is the quality of your archive?  What standards are they following?  Are they recognized?  Where is the data housed?  If you are an American and your data is housed in servers in another country--do they recognize the same standards you must abide by?  or visa-versa?

More to come on policies that are already changing our world on this topic.  



:)
Enhanced by Zemanta

Friday, July 13, 2012

QR Eras and the Implications for Archiving

I have been meaning to post this for a couple of days...This is a table I made to help me see the eras of Qualitative Research and its technology and the ways these eras raise implications for archiving. 

Eras of Qualitative Research Technologies and Implications for Data Archiving

I am building here on the three terms I defined in earlier entries: 

1) Disassociated (meaning before computers or the use of computers similar to off-line use).  This era is associated with the term "data"; technologies like file cabinets, notebooks, stand alone computers.  Archiving focuses on raw sources, handwritten, typed, kodak photos, film. 

; 2) Associated (QDAS and related ways of thinking); This era is associated with the term "database"; technologies like QDAS and word processing uses like QDAS, and early Internet experiments.  QDAS here seeks to be a comprehensive answer to qualitative computing.  Archiving focuses on text, rtf, word documents and jpeg, etc for photos.  Is QDAS going to be a useful tool for archiving? 

 3) Distributed (what lies beyond the first two).  This era is associated with "collection" or "curation".  Researchers are working in distributed manner and their tools are also often distributed around the internet.  Items get made into various kinds of collections--but there is a fluidity that characterizes the mixing and matching.  Archiving raises many questions...that have yet to be answered.

So I am still trying to get it right.  I may be repeating myself, but that seems to happen as I work on condensing an idea. 


Tuesday, July 3, 2012

QR Archiving yes? But Qualitative Software no? What gives?

I have become obccesed with interest in the new wave of work regarding the archiving of qualitative research data.  Once, a UK/Euro issue, it has now crossed the pond and is coming to be a US matter of interest. With many major federal groups now requiring that this material be archived, it is only a matter of time before it becomes a necessity for everyone--like the development of the Institutional Review Board.

 I am working on this concern with Joseph Fisher, digital archivist at UMass Lowell.  We have been a great time talking to many people in many places about this issue.  We will be discussing some of our findings at the upcoming QSR trainers conference in Boston in early August. 

Archivists are concerned with the overall notion of qualitative research data, but as a qualitative researcher with interest in qualitative research software--I am concerned with the issues that this software raises for archiving, in particular.  I have been surprised to find that many of the same prejudices researchers hold about qualitative research software sans archiving seem to be translating into the archiving issue.  In other words, the archiving issue is yet another place where these prejudices can be voiced.

Louise Corti illustrates this concern (she is reporting the concern) in her fantastic article about digital archiving and qualitative research in FQS  http://www.qualitative-research.net/index.php/fqs/article/view/498/1072, the 2011special issue on secondary use of qualitative research data.  Some qualitative researchers, she found, have concerns about using qualitative research resources that are in the form of an e-project, the neat little digital package that qualitative research software creates for the user.

I have been thinking hard about this.  It seems that such qualitative researchers are concerned that they need to approach the data afresh, look at it with clear eyes, and avoid being contaminated by the views of others.  Some worry, I suppose, that the technical shaping of the software package will itself skew their understanding of the data.  They seek freedom from the shackles of externally imposed standards of organization.

Here are some responses I would make to these arguments.

1.  Qualitative research software does not force the researcher to look at the data in the manner that it was formatted by a previous researcher.  You can simply choose to look at the sources themselves, and ignore the codes.  You have the flexibility, if you wish (and have knowledge of how to read that software) to look at the codes, to study the memos, and hyperlinks, but that is up to you.

2.  It is a fallacy to think that if you are using qualitative data sources outside of qualitative research software that you are free of standards and technical specifications.  When you read an interview transcript, we expect it to have the question and the answer...right?  Well, that's a technical specification.  You are never free of those specifications--we need them because they help us make efficient senses of text.  It is also true that these specifications are always evolving based upon new concerns re: genre and standards.  It is the same in qualitative research as in other forms of literate endeavor. 

3.  If you were studying an English novel or novelist (as a specialist in the field), wouldn't you read the novel AND everything you could find related to its analysis and production?  Why is it different in qualitative research?  For some reason when it comes to our qualitative research data, it appears that it has to be in pristine condition--a fresh site.  It's kind of like a perversion of the prime directive--now instead of leaving the field untouched, the people in their original state, now we have to enter the field in our own pristine mental condition. 

BUT, it is not only the user side that has got to examine assumptions--there is a desperate need for software developers to step up to the plate.  By that, I mean that they must accept standards for a meta-language that will allow flexible use of their packages across platforms and into the future.  I know this implies added expenses.  But if this is not done, they are adding yet another nail to the coffin.  Stand alone software developers know that their days are numbered, and they must jump to the mother ship of the Internet at some time in the future.  As they make this transition, it will add to their usefulness if they can also demonstrate their attentiveness to the needs of archiving qualitative research data for future generations.
Enhanced by Zemanta