Dynamic Population Segmentation in Online Market Monitoring

The objective of the SEMAMO (Semantic Market Monitoring) project is to make use of the increasingly growing information available at Web-based sales and marketing channels for market research, using semi-automatic analysis driven by application domain models. The assumptions are that (i) the Web may serve as a representative “picture” of reality, (ii) the respective online channels map salient market developments, and (iii) all of this accurately and in a timely manner. Limited server requests and market specific access structures of Web portals inhibit both full scans of sampling populations and random selection of sampled offers. Further, product feature categories entail multiple classifications within offer clusters (e.g., geography in tourism). Therefore, SEMAMO proposes an adaptive sampling strategy dealing simultaneously with (i) the dynamics of the population frame, (ii) price dynamics, and (iii) multiple (fuzzy) classifications of offered products. The paper discusses a heuristic method of dynamically segmenting monitored offer populations to stratify online data harvesting depending on both observed price changes and information relevance, and outlines the mechanics of harvest schedule derivation.

[1]  Carrie Grimes,et al.  Estimation of Web Page Change Rates , 2008 .

[2]  Hannes Werthner,et al.  Semamo: An Approach to Semantic Market Monitoring , 2009, J. Inf. Technol. Tour..

[3]  Oren Etzioni,et al.  A scalable comparison-shopping agent for the World-Wide Web , 1997, AGENTS '97.

[4]  Hector Garcia-Molina,et al.  Estimating frequency of change , 2003, TOIT.

[5]  Douglas E. Appelt,et al.  Introduction to Information Extraction , 1999, AI Commun..

[6]  Hannes Werthner,et al.  Information Technology and Tourism — A Challenging Relationship , 1999 .

[7]  Norman Matloff Estimation of internet file-access/modification rates from indirect data , 2005, TOMC.

[8]  Hector Garcia-Molina,et al.  Extracting Semistructured Information from the Web. , 1997 .

[9]  Georg Gottlob,et al.  The Lixto Systems Applications in Business Intelligence and Semantic Web , 2007, ESWC.

[10]  Ching-Chih Wen,et al.  The Use of Modern Online Techniques and Mechanisms in Market Research , 2006, 2006 International Conference on Computational Inteligence for Modelling Control and Automation and International Conference on Intelligent Agents Web Technologies and International Commerce (CIMCA'06).

[11]  Gio Wiederhold,et al.  Mediators in the architecture of future information systems , 1992, Computer.

[12]  Georg Gottlob,et al.  Web Data Extraction for Business Intelligence: The Lixto Approach , 2005, BTW.

[13]  Stanley Lemeshow,et al.  Sampling of Populations: Methods and Applications , 1991 .