Reflections From Three Decades of QDA Systems: An Interview with Dedoose Co-Founder, Dr. Tom Weisner  

.

.

Featuring Tom Weisner, Ph.D., Co-Founder of Dedoose 

Interviewed and Written by Kris Castner, M.A., M.A., A.B.D. 

December 2021 

.

Reflecting on the development of data analysis platforms over the past three decades provides a holistic understanding of Dedoose not only as a company, but also as a growing team and evolving product.  

.

It is easy to see the reasons why our team of researchers first started, and continues, to provide a data analysis experience uniquely created by researchers and data professionals, for researchers and data professionals.  

.

That’s also one reason we asked Dr. Tom Weisner, Co-Founder of Dedoose and Professor Emeritus at the Departments of Anthropology and Psychiatry at UCLA, to reflect about what he perceives as some of the pros, cons and areas for opportunities when it comes to qualitative data analysis software (QDAS) and related development technology of the 1990’s, 2000’s, and today.  

.

We also asked about how these realities helped to shape Dedoose as an early company and product between the 1990’s and 2020’s. Read on to learn more about these topics, as well as advice Dr. Weisner has for budding and seasoned researchers alike moving into 2022 and beyond. 

.

Development Technology and Qualitative Research - Early Days of QDAS 

.

When asked to identify a few early setbacks and objections to using QDAS, Dr. Weisner said that “typically, people who would be an audience for this type of analysis back then, wanted the statistical significance of data and coding reliability, more than necessarily also including the interpretive significance and the surrounding context.”  

.

Add to this reality the addition of early pitfalls at the time - such as cost, relative difficulty of use, licensing and renewal processes - and one can easily understand how such barriers were enough to keep many research programs from using such options in the first place, or not using them to fully use the richness of qualitative methods.  

.

Another problem for early QDAS adopters was an inability to teach team members or classroom students how to effectively use such platforms. Steep learning curves were themselves conducive to raising questions of reliability, and whether individual coders could be trusted to use the system uniformly to analyze, interpret and publish their findings. 

.

Dr. Weisner points to a tendency for researchers at the time to downplay the emphasis on “interpretive significance,” which only results from a “deep understanding of the meanings, experiences, and intentions of those whom we study, and perhaps overemphasize reliability and statistical analysis.”.  

.

When reflecting on some of the most oft-cited complaints of early data analysis systems, Dr. Weisner recalls the following: 

.

• Extreme costs associated with development technology 
• Cumbersome licensing and renewal procedures for users and teams 
• Little to no one-on-one-support
• Inability to train other users with ease 
• Inability to collaborate as a team if not working in the same building/University 
• Project data access issues (i.e., when you upload data, it remains in the platform format and can’t be readily exported) 
• Inability to easily export and analyze information from the platform using other software. 
• General lack of visualization components (i.e., charting data, formatting directly for use in publications)   
• Unable to use one system with another (i.e., colleagues need to use the same option) 
• Longer term commitments and training in order to be proficient  
• Inability to view the codes or progress from other users in the same platform in real time. 
• People tended to use whatever system they were trained in, and never changed it 

.

Regarding the last item on his list, Dr. Weisner elaborates, “in the case of large data analysis platforms failing to be used or adopted early on over another brand - it could almost always be attributed to the fact that there were already individuals using a default data system ‘because it had always been used.’  

.

You can see how over time, this process made it easy for what might otherwise be an ineffective research tool, to essentially become ‘the norm’ when it comes to conducting research and analysis.” 

.

Dedoose the Company- How a Founding Trifecta Became a Global Team

.

Being a longtime user of data banks such as the Human Relations Area Files as well as other statistical and mixed methods tools, Dr. Weisner knew early on that any development technology investment would not only have to fill the gaps left by other options but exceed users’ expectations as well.  Dr. Weisner was leading research teams at UCLA and around the country on mixed methods studies of families with children with disabilities, supports for working poor families, and an international collaborative study of families with children with autism in India - and all these studies would very much benefit from the kind of collaborative research tool that led to the development of Dedoose. 

.

Enter the first iteration and founding force behind Dedoose as a company: Dr. Tom Weisner, Dr. Eli Lieber and Jason Taylor. Dr. Lieber was working at UCLA in a mixed methods data lab that Dr. Weisner had himself opened and established.

.

At the time, Dr. Weisner was working on a grant from the National Institute of Health to develop ways to integrate quantitative and qualitative data in the area of developmental disability and cultural studies. Dr. Weisner went on to appoint Dr. Lieber to be the Director of the Laboratory within the overall research center. His personal background and interests in quantitative, qualitative, and mixed methods analysis, and technology, were ideal for partnering with Dr. Weisner.  Their substantive work together and shared drive to improve the processes we were using led to their development of FileMaker Pro as a platform to build the EthnoNotes solution (Weisner, Gallimore, Barbara Keogh, Lucinda Bernheimer, Kazuo Nihira, 1984–2005). 

.

Jason Taylor, on the other hand, was employed elsewhere as a developer. But it became clear to Drs. Weisner and Lieber that Jason possessed the know-how required when it came to launching an entirely new mixed methods data analysis solution and, from the very beginning, ‘in the cloud’ and with the features that Weisner’s and others’ research programs would benefit from.  

.

Once united, the team got to work developing and launching the new research and evaluation data analysis App: Dedoose.    

.

Dedoose the Product - An App Made for Researchers, by Researchers 

.

By 2010 or so, the team sat down to develop a list of what they wanted Dedoose the product to “do.” They asked each other, “what should we be able to do as a collaborative, virtual research team?”  

.

This launched the writing of a list of features that were perhaps basic, but important, nevertheless.  

.

Which features made their original Dedoose “hot list”? Try the following: 

.

• Code on screen with ease 
• Be able to work as a team comfortably 
• Learn quickly and easily, using video training online, how to use the tool 
• Ability to work remotely / in different organizations 
• Gain access to video analysis tools 
• Be capable of uploading/downloading data 
• Be capable of exporting / sharing data 
• Use the platform to create charts and figures 
• Format visuals and text and quantitative coding data for inclusion in published articles and studies 

.

Perhaps more important than the above was the pain point reflected by pricing models of competing products at the time. Typically, one could expect to cough up (then or now) upwards of $500 per year, per user, year after year.  

.

Add to this the fact that most platforms will change your access to key features according to your subscription level, and you can add perhaps a hundred more dollars to that estimate. 

.

Dedoose knew that colleges and companies alike were paying for costly licenses and opted to begin their first subscription plan at just $10.95 per month for as long as you wanted to remain subscribed (whether for one month or one year - even now, it is still only $14.95 for an individual subscription and less for groups). The best part? You were then, as you are now, always connected to the best, most recent version of Dedoose with “all the bells and whistles” minus needing “the right subscription plan.”.  Further, if as often happens, you and your research team did not use Dedoose for a month - that month rolls over, adding a month to your subscription. 

.

Also imperative was that anyone with a browser needed to be able to gain access to their project in Dedoose (as long as they had a password and access permissions set at the appropriate level by the project leader, of course). Dr. Weisner adds, “This is a little different today, with iPad apps and the like. We didn’t really think too much about those in the 1990’s. Many didn’t think it would be possible to have an iPhone app version, for example, but now we can say ‘there is - we’ve done that, too.’” 

.

Thanks in large part to the prowess of Dedoose Chief Engineer Jason Taylor, no matter which advances in technology arise over the years, our team can rest assured that we’ll find a way to overcome the potential challenges they present.  

.

From this initial union of talent and generated list of “must haves,”, Dedoose the company was forged. Additional members, including Dominic Perren, Dr. Michelle Salmona, Jose Gamez, and Kurt Lautenbach, have since joined the team, bringing with them decades of expertise and experience across a range of industries.  

.

In 2016, for one, Dr. Michelle Salmona joined Dedoose after a decade of experience guiding users in qualitative data analysis software (QDAS) including NVivo. The President of the Institute for Mixed Methods Research (IMMR) and an Adjunct Professor at the University of Canberra, Australia, Michelle’s background is in qualitative and mixed methods research design and analysis. Specifically, her studies try to understand how to support doctoral student success and strengthen the research process through the successful application of technology and data-driven decision making.    

.

Diversity in Application and User Base - Dedoose Across Industries 

.

.

Research that illustrates the range of industries Dedoose serves is evidenced in its use, for starters, by Dr. Matt Rafalow. With a background including working as a social scientist for Google, Matt’s work also shows how our app can be useful for analysis in industries such as market research, big tech and user experience. In his 2020 publication, “Digital Divides,” he found that teachers were more likely to rely on organizational culture and perceptions of race and class to identify students as “risky” or “having potential.” You can learn more about his current focus on YouTubers and their audiences on his website.    

.

The emergence of the pandemic also inspired Dedoose-based research during 2021, with researchers taking note of the uptick in rates of Internet based psychotherapy. The National Library of Medicine through the National Center for Biotechnology Information, for example, recently added Xiaoling Xiang et al’s (2021) analysis of 21 qualitative interviews conducted with older homebound adults receiving cognitive behavioral therapy in a virtual environment.  

.

Using our cloud-based app, they were able to identify three key themes to categorize participants’ experiences. Specifically, these categories included: intervention impact, perceived impact by participants and barriers to treatment. In sum, the treatment was found to be promising among those interviewed, due in part to home care workers reporting improved relations with their clients.  

.

Both recent studies from vastly different areas of research are but timely examples of how Dedoose is being used to understand social issues. Important to note is how the unfolding of (among other events) COVID-19 continues to change the way that researchers conduct their analyses.  

.

To learn more about the research being conducted around Internet-based psychotherapy, read the research summary on the NIH website.   

.

Advice From Dr. Weisner for Researchers - Budding and Seasoned  

.

Having reflected on the early days of Dedoose the product and company, what tips might Dr. Weisner have for qualitative and mixed methods researchers moving into 2022? 

.

“If you haven’t dealt with or taken account of method effects and variation in your data, you are at risk of confounded the particular method you are using with the behaviors, intentions, and mechanisms in the world that you are trying to understand,” says Dr. Weisner, referring to advice he would bequeath to budding and seasoned researchers alike. “You need to have multiple methods in order to account for that. I would ask, have you gotten as close as possible to a holistic understanding of the topic you want to explore?  Focused studies can bracket context out and be highly specialized and this approach is valuable.  But then, it is important to bracket that social and cultural context back in. Have you included the experiences, intentions, perspectives and beliefs of those you are studying and the institutions they are embedded in?  If you aren’t using mixed methods, you haven’t gotten as close as you should or could have.”  

.

One of Dr. Weisner’s favorite mottos remains “Get out of your [disciplinary, methods, familiar] silo!” which is more than a mere saying, as it is for him, a way of life.  

.

A pro tip Dr. Weisner can provide is to seek out those who are experts in subjects you are interested in, but do not understand yourself. Much as the initial team of Dr. Weisner, Dr. Lieber, and Jason Taylor demonstrates, success can be gleaned from a union of kindred spirits with a myriad of skill sets.  

.

A final word of caution and encouragement: “Understand that the methods that you use matter for your theory, science, and for those whom you study.  You should always ask yourself, ‘do these methods really make sense for this topic, and can I use other methods to add value? For the theory and for the audience that I am studying and trying to connect with, or for the policy I am trying to develop, are there method tools and analytic techniques to make this study stronger?”  

.

 

.

If you’re curious which book, if any, Dr. Weisner would recommend you add to your research bookshelf in 2022, he will tell you it’s “Methods That Matter” edited by M. Cameron Hay (University of Chicago Press).  

.

Future-Proof Your Data and Research Process with a Free 30-Day Trial 

.

.

More than a decade has gone by since the early days of Dedoose. But there is one thing about us as a product -and a team- that certainly hasn’t changed: 

.

Our dedication to listening to, and serving, our user community.  

.

Without all of your support and feedback, we wouldn’t be able to provide you with the caliber of data analysis options and features that you need to get your research done efficiently (and get it done well). 

.

We want to thank you for the year 2021, and especially for your support, research and collaboration within the Dedoose user community. We want to welcome you to a new year, where we pledge to bring you the best we have to offer, as quickly and budget friendly as we can. 

.

As you can see from our history as researchers ourselves, we understand the constant challenges presented by development technology, and what this can mean for research collaboration and advancement tools.  

.

By providing you with a whole customer experience from Day One of your service, and all the way through your last subscription bill (if it must be that way), it’s our aim to keep you “in the know” about bugs, fixes, updates, new features, and the like, every step of the way. 

.

Whatever level of support your team may require, we are confident that we can exceed your expectations with one of our custom subscription plans.  

.

Large groups can stay tuned for more details about our Enterprise Program (coming early 2022)!  

.

When you’re ready to compare Dedoose to your experience with “those other QDAS options,” gift yourself a 30-Day free trial to get started.  

.

 Thanks for taking the time to learn more about the people, motivations, and goals that helped shape Dedoose into the company and app that it is today! 

.

Learn More About Dr. Tom Weisner, Co-Founder of Dedoose 

.

.

Dr. Weisner is an Anthropologist and internationally recognized leader in the systematic application of mixed methods in the social sciences. His research interests focus on culture and human development, medical, psychological and cultural studies of families and children at risk, mixed methods research, and evidence-based policy studies.  

.

Working for decades with multi-disciplinary groups, Dr. Weisner has made major contributions to the development of methods for the study of families and children in context. Key to this work was his contribution to the development of the Ecocultural Family Interview for understanding the everyday routine of family life – a mixed methods approach. 

.

Dr. Weisner’s research includes studies conducted in Kenya, India, and the U.S. He has studied sibling caregiving of children, families with children with disabilities, countercultural families and children, working poor families and children, early literacy in Head Start programs, and support for families with children with autism in India, among his key areas of interest.  

.

He is co-author of Higher Ground: New Hope for the Working Poor and Their Children (2007), with Greg Duncan and Aletha Huston; co-editor of Making it work: Low-wage employment, family life and child development (2006), with Hiro Yoshikawa & Edward Lowe; editor of Discovering successful pathways in children's development: New methods in the study of childhood and family life (2005); and co-editor of African families and the crisis of social change (1997), with Candice Bradley and Phil Kilbridge.

.

 In addition, Dr. Weisner has published some 150 research papers, chapters, and reviews during his academic career. He received his B.A. in Anthropology from Reed College (1965) and Ph.D. from Harvard University (1973).  

.

He is currently Professor Emeritus, Departments of Anthropology and Psychiatry at UCLA. While none of us expect he’ll fully ‘retire’ anytime soon, Tom is finding great joy away from work with his wife Susan, traveling and spending time with their four grandchildren. ;