Jul 8, 2017 - Binny Samuel. University of ... Some S1 Papers: Burton-Jones & Meso, 2008; Parsons,. 2011 ... Burton-Jones and Meso 2006; Soffer et al. 2015 ...
Conceptual Modeling Research in Information Systems: Impact of Wand and Weber's 2002 Framework Jan Recker Queensland University of Technology Arturo Castellanos Baruch College (CUNY)
Mohammad Ali Jabbari Sabegh Queensland University of Technology
Roman Lukyanenko* University of Saskatchewan Binny Samuel University of Cincinnati
A Workshop in Honour of the Retirement of Professor Izak Benbasat and Professor Yair Wand July 7 -8, 2017 UBC Sauder School of Business Vancouver BC
*Presenter
Synopsis In 2002 Wand and Weber proposed a framework and agenda for future conceptual modeling research, which identified twenty-two research opportunities. ▪ We assess the impact of the Framework on research ▪ Explore whether research provided sufficient answers to the questions posed by Wand and Weber in 2002 •
15 years later
Wand and Weber 2002 ISR
G2: Evaluating grammars for ontological expressiveness
Impact of the framework ▪
Literature review •
▪
Text mining of pre- and post- publications •
▪
How much of the Framework agenda have been addressed? Has there been a shift in focus since 2002:
Survey among 2017 SIG SAND attendees
Literature review WW2002 cited 800+ times ▪ AIS Basket of Eight Journals and JDM since 2002 ▪
• •
105 papers on conceptual modeling (out of 3,546) 56 papers in SSB, 49 in JDM
Coding ▪
Applying agenda items of the Framework to 105 publications
▪
Inter-coder agreement •
▪
First round: 62%; Third round: 100%
Example • •
S1: Evaluating competing scripts generated via the same grammar to describe some phenomenon Some S1 Papers: Burton-Jones & Meso, 2008; Parsons, 2011; Masri et al., 2008; Shanks et al., 2010; Allen & March, 2012
Literature review highlights ▪
Of 105 papers, 84 addressed items in the Framework •
•
37% of the research effort has concentrated on more than one element of conceptual modeling (e.g. grammar and script or method and script). UML and ER grammars were the most popular grammars investigated.
Results: Most Popular Topics Code
Topic
Evaluating competing scripts generated via the same grammar to S1 describe some phenomenon M2 CI2 G7 M1
Developing procedures to assist users of a grammar in identifying and classifying phenomena according to the grammar's constructs Predicting which cognitive and personality variables bear on a user's ability to undertake conceptual- modeling work Empirically testing the predicted implications of construct deficit and overload in grammars Evaluating how well different methods allow users to elicit and model critical domain knowledge
No
21 19 15 10 9
Burton-Jones & Meso, 2008; Parsons, 2011; Ågerfalk & Eriksson, 2004; Soffer and Hadar 2007; Bera et et al. al. Khatri et al. 2006; Browne and Parsons 2012; Shanks MasriShanks et al., 2008; et al.and 2010; Allen & March, 2012 et 2010; al. Shanks 2010; Allen March 2012; Recker et al. & Wand, 2008 Burton-Jones andParsons Meso2010 2006; Soffer et al. 2015; Siau and 2011; Bowen et al. 2006 Rossi 2011
Results: Areas Covered Addressed Areas
Unaddressed Areas
Grammars ● Ontological evaluation ● Assigning ontological meaning to grammatical constructs ● Testing the implications of construct deficit and overload
● Evaluation of ontologies ● Evaluation of combination of grammars ● Testing the strengths and weaknesses in new and existing grammars
Methods ● Evaluation of methods ● Developing procedures to assists users of a grammar ● Determining the beliefs and values that underlie different methods
Results: Areas Covered Cont’d Addressed Areas
Unaddressed Areas
Scripts ● Evaluation of scripts (developed via the same or different grammars) ● Developing theory to explain the use of scripts
● Evaluation of combinations of scripts
Context ● Developing Knowledge-based tools ● Evaluating cognitive and personality variables ● Evaluating capabilities of grammars, methods, and scripts in different tasks
● The role of different values and beliefs in conceptual modeling
Text Analysis ▪
Source: Web of Science Core Collection •
•
▪
1,605 articles from 1986 to 2015 Variants of keywords about conceptual model(ing).
We analyzed authors, keywords, outlet, and cited articles.
Pre- and Post Framework ▪
▪
Number of articles about conceptual modeling by year WWF coincides with growth in CM papers
Topical analysis PreWWF
PostWWF
Topic ID 1
Topic schema,meta,perspective,requirement,architecture
2
oo,oo,cognitive,problem,concept
3
language,conceptual model,specification,modeling,conceptual
4
metrics,software,quality,quality,maintainability
5
web,service,information service,mechanism,source
6
query,user,database,task,performance
7
relationship,entity,attribute,grammar,real-world
8
research,methodology,approach,assumption,process
9
diagram,representation,cognitive,problem,knowledge
10
data,schema,model,data model,category
Topic ID 1
Topic data,query,database,data model,relational
2
quality,,metrics,evaluation,framework
3
cognitive,task,knowledge,experiment,understanding
4
data,knowledge,service,decision,technology
5
ontology,domain,language,ontological,knowledge
6
software,requirement,diagram,artifact,development
7
process,bpmn,language,modeling,process model
8
supply,chain,supply chain,grammar,enterprise
9
research,theory,science,reference,discipline
10
schema,conceptual schema,conceptual,conceptual model,method
Survey of IS academics ▪
2017 SIG SAND Attendees • •
12 Respondents 10 Professors (full, associate, assistant) “Brought order (systematicity) to prior disparate work on CM”
“It helped move the field forward”
“Informed broader IS community of the scope of CM research”
Summary ▪
Much of conceptual modeling research guided by Wand and Weber (2002) • • •
▪
84 top IS papers explored topics covered by the Framework Most - 80% - of the agenda topics have been addressed by the papers 56 papers on CM in top IS journals
Wand and Weber (2002) brought the niche topic of conceptual modeling into mainstream of IS •
Most cited research commentary at ISR (2002-2017)!
THANK YOU!
Journals Journals
Number of relevant papers
MIS Quarterly
6
Information Systems Research
9
Journal of the association for information systems
17
European journal of Information Systems
15
Journal of Management Information Systems
1
Information Systems Journal
5
Journal of Information Technology
1
Journal of Strategic Information Systems
2
Journal of Database Management
49
Total
105
