Review of our Book

Image by See-ming Lee 李思明 SML via Flickr

Ann Lewins' review of diGregorio and Davidson's Qualitative Research Design for Software Users has been published in Qualitative Research at http://qrj.sagepub.com.  Thank you Ann for your thoughtful and informative review. 

Book Review: The Collaborative Turn

Image by crackedmoon via Flickr

My book review of W. Gerson's recent collection (2009):  The collaborative turn: Working together in qualitative research (Amsterdam: Sense Publication) has just been published in the International Journal of Education and the arts.

http://www.ijea.org/v11r3/

Read and enjoy--it's a fascinating collection! 

Review of our Book

I am pleased to announce that a review of the diGregorio and Davidson book--Qualitative Research Design for Software Users--has just been published in FQS or Forum: Qualitative Social Research, on an online journal.

Thanks to Alice Mattoni from the European University Institute for her careful read and thoughtful comments. 

Alice--  I look forward to meeting you at some point!

Mattoni Review

FQS Book Review

Intuitiveness...Thomas Muhr...and ATLAS.ti

Image via Wikipedia

This is a 'reprint' from the Qual-Software Mailing List.  It is a message on the 'notion of intuitiveness' in qualitative data analysis software.  It was written by Thomas Muhr, developer of ATLAS.ti.  I reprint it here with his permission.  To contact him or to learn more about his work, please go to  www.atlasti.com

I felt that his comments on intuitiveness in qualitative data analysis software bore repeating and disseminating. This issue has long been a matter of contention in comparing quantitative and qualitative software packages AND more recently in the discussion new Web 2.0 tools in comparison to the more robust stand-alone packages.  As a developer with long experience in the field, Muhr's comments are particularly important for those of us who are advocates for QDAS software to hear.  


qual-software [QUAL-SOFTWARE@JISCMAIL.AC.UK]


Dear readers of qual-software,
this post was intended as a reply to a discussion that emerged in early
February. However, when thinking about a specific issue I decided to make
this a separate thread.

The notion of "intuitiveness" is intriguing but has its limitations.  If it
is used as a lense to evaluate tools such as software systems, the inherent
complexity of the domain augmented by the tool must be taken into account.
Intuitiveness has its obvious benefits; for one, it is associated with a
shallow learning curve, and as a corrollary, efficient and economical.
Nevertheless, I would like to raise a few points with regard to this
increasingly popular standard and expectation, and in particular question
its universal applicability.

For starters, assuming that the addressed domain (to be analyzed) is
adequately understood by the potential user (no matter if the methodology
was or was not sufficiently intuitive to abandon any manuals or courses),
the steepness of the learning curve does in fact depend on how well,
completely and congruently (emulating natural workflows) the concepts and
methods of the domain are represented in the tool. However, in reality, and
not only in the QDA field, learning a tool and learning a methodology are
often intertwined.
This can often lead to a bias and making it difficult to isolate the
learning curve for the software. Ultimately, discussions about the relative
ease of learning QDA tools often overlook that fact that essentially two
things are part of the curriculum. In some cases, users expect that a
software program might even replace proper training in methods.

Intuitiveness is not neccessarily bound to how well a given software system
intended for one domain resembles a standard in a completely different
domain such as one used for writing and reading emails. It may come as a
surprise how many users of standard email/calendar tools experience
difficulties regarding the accessibility or "user-friendliness" of important
functions.
And the functions provided by such tools, e.g. Outlook, are far less complex
than what tools in the QDA area may need to offer. The situation is even
becoming a bit more complicated with tools like Outlook. While receiving and
responding to an email is quite intuitive, changing the style of your
responses, adding or modifying mail accounts or creating a meaningful series
of calendar events is already another thing. While we expect and require a
broader range of functions, expectations of ease-in-use also continue to
grow, prompting the question of whether there is indeed a budding paradox in
the software field.

Even if all engineering efforts have been invested in making a tool as
"intuitive" as possible, there will still be a difference dictated by the
complexity of the modeled reality. t is relatively easy to create
anintuitive tool for calling a taxi with an iPhone (which I recently
installed: activate big yellow button; enter number of passengers; make
payment and voila, the taxi is on its way). Such tools obviously do not
require a manual or a two-day workshop. By the way, good examples for
intuitive interfaces are some adaptations of web sites to the limitations of
mobile devices. Modelling more complex relations obviously requires a
broader spectrum of commands, all of which the user must be at least vaguely
aware in order to benefit from them. 

And if users plan to use a tool that allows them to work on text, images,
audio, video, GIS data, (native) PDFs, as well as one that can create and
manage selected segments in each of these media types; a program that
enables the user to create and define links between codes and segments,
codes and codes, segments and segments (hyperlinks), create and manage memos
that can be associated to any kind of concept available, group concepts,
synchronize media data and transcripts, create queries & hypotheses, decide
and/or create relational prototypes modeling the methodology used, offer a
vast array of analytical tools, offer standards for importing and exporting
project data (-> 1)... and so on and so forth... comparing this type of
broad-spectrum functionality - with regard to intuitiveness - to a tool
primarily dedicated to the analysis of video and the display of an
associated transcript (i.e. Transana) is questionable, at very least.
Without a doubt, the latter tool will suffice for any task or phase
constrained to the ingredients just described.

A tool's intuitiveness can be taken to impressive heights, but if a variety
of methodologies and styles are to be supported, the increasing number of
tool functions and workflows may conflict with this effort. And of course,
personal styles and intellectual habits are also involved in the process of
getting acquainted with a tool. ATLAS.ti has always tried to be as open as
possible with regard to exploring, navigating the emerging "context of
discovery" while concurrently remaining systematical when it comes to
representation and analysis.

Human reasoning and creativity does not often fit well in a tiled
hierarchical windowing scheme, even if it is sometimes comfortable and
tidier. (-> 2) The task we have solved (and are steadily improving) is to
provide a workspace for the user in which all ingredients of a research
endeavor, including the primary data, the concepts that arise in the
process, the memos to be recorded, the linkages between the data and the
"theory", the short cuts between the conceptual level and the indicators in
the data in their original context, can be easily queried and navigated. It
would be an interesting research question itself to find out which
methodologies and which tools match which intellectual and emotional
preconditions - while of course using ATLAS.ti for the analysis!-) While I
agree completely that our system would and should benefit from certain
improvements - and we are constantly working on improvements, which by the
way, we return to our users not only in (costly) major releases but in a
constant evolutionary process, I disagree that adapting to a more standard
(i.e. "Outlook"-type) interface would make things much easier.  Our current
efforts are focussed on the different roles and levels of expertise of users
working with our tools and how different needs can be modeled in the user
interface. And in this process of change we include our users as well as our
engineers.

Thanks for your patience - comments welcome!
- Thomas Muhr (CEO ATLAS.ti GmbH)

---- end notes ---

(1) By the way, it is only the fact that ATLAS.ti exports project data in a
standard format (XML) that makes the feature "we are able to import ATLAS.ti
projects" possible. It would be much better - at least for the scientific
community - if ALL (!) makers of QDA software would finally agree to support
an open standard or at least an XML based export/import technology. Our XML
compatibility means we allow our users to "leave" us, which may not make
much sense business-wise. But with only proprietary data structures,  the
migration path to alternative and/or future tools will be long and bumpy,
not to mention the chances for smooth longitudinal designs. My advice is to
check your current system if it also gives you the freedom to say "goodbye".
If not, ask for it.

(2) When I look at my desk and desktop, I personally get the impression that
a messy environment can be quite inspiring at times!-
"Convolutedness" at first sight may indeed turn into familarity once the
main concepts and procedures are understood. Instant intuiveness on the
other hand is great, but if you need to drop important properties of your
research requirements it isn't really helpful, i.e. conducive to complex
research.

------------------------------------------------------
"Computers, like every technology, are a vehicle for the transformation of
tradition" (Winograd & Flores, 1987) ATLAS.ti Scientific Software
Development GmbH - Berlin - www.atlasti.com

Dissertations vs the IPad

Image via Wikipedia

Recently my program has taken up a discussion of the dissertation--what can we agree upon about the form, contents, style, etc.  In other words, what are our standards for this culminating piece of work in the doctoral program.  We are looking at a rubric that another institution developed, and I have to say that it makes the dissertation look pretty darn BORING. 

[Ironically even this ancient manuscript to the right from about 1200 has more color and design interest  than today's dissertation.]

I have nothing against the notion of a strong literature review, compelling question, thoughtful theoretical intersections, excellent methodological description and well described findings and discussions of implications.  Although, I am not sure that we can agree on what this means cross paradigm.  I think what will be even more difficult is how to figure out what this means in light of new digital forms.  I have already run into a variety of difficulties with issues related to discussions of qualitative data analysis software (QDAS), and this is only the tip of the iceberg when it comes to addressing new forms. 

I think one of the most important challenges to the standard black and white dissertation, though, are the new visual formats.  For the last few weeks, my Google Reader has been bringing me video advertisements of the new Apple IPad and the kinds of content news media are developing for it.  The New York Times and Sports Illustrated are two I've seen, which are dazzling in their color and flexibility.  It's like a newspaper or magazine and a website combined.  But what is even more interesting is that it feels like it has jumped out of the old computer monitor and into a new kinesthetic mode with the ability to touch the screen and make things happen. 

This is not anything like the way the old dissertation looks even in digital form. Take a look at it.

Apple IPad

You'll probably notice as I did that there is not a single woman in the ad...all male speakers. That aside, (and I am sure they studied their demographic carefully before the release) this is how print of the future will look.  The dissertation looks dingy and sad beside it. Visual images are at a minimum.  Indeed, the height of visual orientation in the standard dissertation is the robust use of APA headings! 

Interestingly, though,  the Apple IPad  is loaded with skeumorphs--references to earlier times and technologies.  You turn pages, select a photo from a pile of photos, select books from bookshelves.  You feel like you are in the world of print and furniture of the late 20th century.  Things work in the same way, but they are all virtual--opening, closing, sliding forwards and backwards with the touch of a finger. 

In such a world it appears on the surface that the standard dissertation can find a place, but my question is why?  By this, I don't mean that we should give up and go on as we have for so many years, creating these five chapter documents that get shelved for eternity.  Rather, why, go on with the old form?  What's stopping us from jumping ship? Trying new forms? 

At the University of British Columbia (UBC) College of Education they have been doing experimentation with arts-based dissertations.  This may be the direction to consider.  

Three Cases of Visual Memos

Image via Wikipedia

I have blogged thrice about visual memos I have created:

Visual Memos in Qualitative Research
This is an example of a visual memo developed from writing in my journal about the journal project.  I was thinking about the ways the journal project and its writing was different from formal social science writing.

Visual Memos in Qualitative Research: Part II
 This memo describes the way an image or art approach (prayer ropes) developed through a series of experiences related to the death of a dear friend. 

Visual Memos in Qualitative Research: Part IV
 This memo (a handmade book) developed as a reflection on the experience of teaching a qualitative research class in which visual memos were integrated with every component of the course experience. 

As I think across the visual memos themselves, some of the patterns I see in this work are:

• They are narrative.  They tell a story, reflect on a chain of events, connect diverse strands of thought.  
• They are combinatory.  They bring together diverse elements or thoughts in a single location. 
• They lead to strong juxtapositions.  Bringing together the different pieces leads to new positioning of ideas in relationship to each other.  
• They are sensual.  I react to the nuances of color, texture, shape, line.  Text, too, is sensual for the dedicated reader, but in a different way. 
• They reveal things to me that were hidden from me when I operated solely in my textual mode. 

I've mused about visual memos in this blog also:

Visual Memos in Qualitative Research: Part III

I've also given thought to the visual qualities of different forms of qualitative research analysis--manual modes vs. computer modes. 

Getting Visual With Qualitative Research Analysis

This week I started to think about the literature of memos in qualitative research:

Memos and Qualitative Research: Kathy Charmaz

This is a beginning for me.  There are others to examine.  What I want to bring forward from Charmaz regarding memos is how they exist in the space between data and fixed/mature interpretations.  They are the thing waiting to be heard, to take form. 

Memos...it's a juicy topic. 

Walter Gerson and "The Collaborative Turn"

Run.  Don't Walk.  To get your copy of

The Collaborative Turn

edited by Walter Gershon. 

I've been reading this book over the spring break in anticipation of reviewing it for the

International Journal of Education and the Arts

I don't want to give away the show, but truly--take a good look at this book!