Our website publishes news, press releases, opinion and advertorials on various financial organizations, products and services which are commissioned from various Companies, Organizations, PR agencies, Bloggers etc. These commissioned articles are commercial in nature. This is not to be considered as financial advice and should be considered only for information purposes. It does not reflect the views or opinion of our website and is not to be considered an endorsement or a recommendation. We cannot guarantee the accuracy or applicability of any information provided with respect to your individual or personal circumstances. Please seek Professional advice from a qualified professional before making any financial decisions. We link to various third-party websites, affiliate sales networks, and to our advertising partners websites. When you view or click on certain links available on our articles, our partners may compensate us for displaying the content to you or make a purchase or fill a form. This will not incur any additional charges to you. To make things simpler for you to identity or distinguish advertised or sponsored articles or links, you may consider all articles or links hosted on our site as a commercial article placement. We will not be responsible for any loss you may suffer as a result of any omission or inaccuracy on the website.
Home Technology New way to collect web data to ensure valid academic research
Technology

New way to collect web data to ensure valid academic research

by Uma

In developing a new framework, researchers from Rotterdam School of Management (RSM) Erasmus University Rotterdam, have unearthed new and underexploited ‘fields of gold’ associated with web data.

The RSM researcher along with colleagues from Tilburg University, INSEAD, and Oxford University, sought to demystify the use of web scraping and application programming interfaces (APIs) and thereby facilitate broader adoption of web data in academic research.

According to Dr. Johannes Boegershausen:

“Our framework covers the broad spectrum of validity concerns that arise along the three stages of the automatic collection of web data for academic use: selecting data sources, designing the data collection, and extracting the data. In discussing the methodological framework, we offer a stylized marketing example for illustration. We also provide recommendations for addressing challenges researchers encounter during the collection of web data via web scraping and APIs.”

While marketing researchers increasingly employ web data, the particular and sometimes treacherous challenges in its collection have received limited attention. For example, how can researchers ensure that the datasets generated via web scraping and APIs are valid? This research team addresses highlights how addressing validity concerns requires the joint consideration of unique technical and legal/ethical challenges.

The article, published in the ‘Journal of Marketing’, further provides a systematic review of more than 300 articles using web data published in the top five marketing journals. Using this review, the researchers identify how web data has advanced marketing thought. Understanding the richness and versatility of web data is invaluable for scholars curious about integrating it into their research programs.

Recent Post