In a recent blog, I focussed on a presentation by Mike Page (Blueocean) at September’s ASC conference. Page discussed the reasons why market research data remains outside corporate data warehouses. One key point he mentioned was the lack of consistency in definitions used within questionnaires, for example in recording standard demographics.

I’ve now discovered the Data Documentation Initiative, which has very recently issued a call for action to develop metadata standards for questionnaire and data description – ‘Survey Metadata Reusability and Exchange: A Call for Action for Questionnaire Documentation’ (05-11-14): 

‘This collaborative statement calls upon the survey design, production and archiving communities to take leadership in facilitating survey metadata exchange through adoption of shared metadata standards for questionnaire and data description’.

In fact, this statement follows on from a meeting held at the RSS in London on June 28th, ‘Survey Metadata: Barriers and Opportunities’, that brought together survey owners, producers, computer assisted interviewing suppliers and archives to discuss the challenges of working in a more harmonised way to avoid the high cost of manually producing high quality data documentation.

I’m sure that some readers are already aware of the DDI, as their standards are already used internationally for survey data archives. However, I suspect that social researchers, and those working in the public sector, might be more aware of this than many commercial market researchers – especially those in client organisations.

The recent statement also includes three key recommendations for the stakeholder organisations in the research process invited to the initial meeting: 

Questionnaire design and CAI systems that embody a commitment to survey metadata re-use:

  • Can accommodate description of variables in full context, including information such as full question text, universe and routing, showing information, and so on
  • Offer import and export of metadata in the recommended DD13.2 Questionnaire profile in XML format
  • Agree to keep exchange mechanisms up to date with future upgrades to the DD13.2 Questionnaire profile

My main concern is whether client-side researchers will be taking any interest in DDI, maybe discussing this with their external agencies, and internal IT department, to see if this helps address the issues raised by Mike Page, thereby making survey data eligible for an invite to the big data party.

For more details see the ‘Survey Metadata Reusability and Exchange: A Call to Action for Questionnaire Documentation’ 

How to access the International Journal of Market Research (IJMR)

Published by SAGE, MRS Certified Members can access the journal on the SAGE website via this link.

Go to the IJMR website A white arrowA black arrow
1 comment

Jon Johnson12 May 2015

Thanks for the mention (which I have just come across), as one of the organisers, very pleased to see the issue being discussed more widely. One of the outcomes of the workshop is that some data collection agencies are now using this subset of the DDI to automatically generate the CAI implementation of some UK cohort studies and is proving to be useful in capturing the detail of these complex studies for further processing by clients to document both the data and CAI itself. It is still early days and is not yet perfect, but it a start and has started the discussion about how we would use this to get questions that are better provenanced and specified in a more consistent manner.

Get the latest MRS news

Our newsletters cover the latest MRS events, policy updates and research news.