Experiences with a Case Study on Pair Programming
|
|
- Anabel Banks
- 5 years ago
- Views:
Transcription
1 Experiences with a Case Study on Pair Programming Marcus Ciolkowski, Michael Schlemmer Universität Kaiserslautern ciolkows@informatik.uni-kl.de Abstract. Agile methods are becoming more and more popular. Most well known among them is probably Extreme Programming (XP) [2]. One key practice of XP is Pair Programming (PP), where two developers work simultaneously on a programming task. However, despite their popularity, few is known about limitations of these methods in terms of empirical knowledge. Some empirical studies exist on Pair Programming [5][8]. These studies compared PP to solo programming and were conducted for small, isolated tasks. In this paper, we describe a case study conducted in the context of a more realistic task within a university practical course, conducted in teams of six students and comprising about 700 person-hours of total effort. Within our case study setting, we were able to find weak support for the results achieved in earlier studies. More importantly, we describe experiences we made in conducting the case study and suggest improvements for future investigations. 1. Introduction A few years ago, agile processes or methods have been introduced into the software engineering world. These processes are characterized by a combination of methods, focused on few documentation and high flexibility, or, in other words, simplicity and speed [1]. One prominent example, and probably the best known one, is Extreme Programming (XP) [2]. One important element of XP is Pair Programming (PP). Thereby, two developers always work together, especially during implementation. One of them takes the role of the driver, which means that he types code and has control over keyboard and mouse. Meanwhile, the other role, the observer, watches the driver s actions, tries to find errors and plans ahead [3]. These roles are changed frequently. This practice represents a kind of continuous informal inspection of the code and is expected to detect defects in the code as early as possible. However, even though PP is growing in popularity, we do still not know much about its benefits and weaknesses. When starting our case study, we only knew of few empirical studies; for example, by Nosek [5], and by Cockburn, Williams and Kessler [3][8]. Basically, their results were that, for their type of programming task, PP needed ca. 15% more effort than solo programming but produced better quality code. However, it is not clear whether their results hold also for larger projects and teams consisting of more than two programmers. In this paper, we present a case study on PP in a university environment. In this case study, students had to work in teams of six, and they had to implement changes for an already existing software system written in Java. Further, we present
2 2 Marcus Ciolkowski, Michael Schlemmer experiences and lessons we learned during execution of the case study. Thereby, we hope to facilitate replication and suggest improvements for future investigations. This paper is structured as follows: Section 2 briefly describes empirical studies on PP. Section 3 describes the case study we conducted, and section 4 contains our results. Finally, we summarize and discuss our findings in section Studies on Pair Programming When we planned our case study, we only knew of two documented empirical studies examining PP: One by Nosek [5], and one by Williams, Kessler and Cockburn [3][8]. In the study conducted by John Nosek, he took 15 full-time programmers, split them into 5 pairs and 5 individuals, and gave them a task to solve; the allotted time for the task was 45 minutes. Thereby, he compared teams using PP against solo programmers, using subjective criteria and programming effort to compare the techniques. His results were that pairs needed about 70% of the time compared to individuals, which means that pairs needed 40% more effort. In the study conducted by Laurie Williams, the researchers split 42 students into 14 pairs and 14 individuals. The students then had to write four programming assignments in six weeks. They report that pairs needed 50-60% of the time, which means the same or 20% more effort than individuals. However, it is unclear exactly what kind of task the students had to solve, but it seems that the assignments were independent of each other; that is, they were not connected to creating or changing a larger software system. Further, they claim that pairs produced better quality code, measured through the percentage of failed system tests and through lines of code of the solution. In both studies, the participants had to complete small, isolated programming assignments. Although it is important to study the effect of technique for isolated tasks to increase control over the study, this is not realistic: Usually, programmers work on a large software system, they make changes (e.g., add functionality) to it, and interact with each other. 3. Description of the case study One motivation for this study was to verify the results of previous studies in a more realistic setting, which means: (a) working on a larger system, and (b) working in larger teams than in the previous studies on PP. In this situation, we had the opportunity to use an undergraduate practical course on Java programming, the so-called Software-Praktikum (SWP). Every student in computer science at the university of Kaiserslautern has to take this course in his second year. Students work in teams of six on a project that lasts over 13 weeks (i.e., a total effort of about 700 person hours). During this time, the students have to work on a larger project that basically requires to extend and modify an existing system. Thus, this practical course gave us the opportunity to test Pair Programming in a more realistic environment. We decided to evaluate the benefits of PP by the following three criteria: (1) The quality of produced code, (2) the effort used for implementation, and (3) subjective impressions of the students.
3 Experiences with a Case Study on Pair Programming 3 However, it was clear that we would not be able to get many data points for evaluation, so we did not expect to achieve statistically significant results, only trends or tendencies in the data. Thus, one main objective we had with this study was to gather experiences, to lean how we could use this kind of practical course for such studies, and where the pitholes in evaluating PP are. With the experiences gained, we plan to do more rigorous case studies on PP in future runs of this practical course. This rest of this section is structured as follows: Section 3.1 details the project the students had to work on during the course and describes the design of our case study, and section 3.2 presents hypotheses and metrics we used in our study The Project The system we used in the practical course is called web-based quiz system or WBQS. It is implemented in Java and documented through its API (using JavaDoc), and additionally through a UML-based requirements and design document. The purpose of the WBQS is to process multiple-choice quizzes. Thereby, a user starts a Java application. The WBQS then loads (via http) and displays a table of existing quizzes, and the user chooses one them. Next, the system loads (again, via http) an XML-specification of the quiz as well as necessary pictures through the internet and displays the first question. After answering the questions, the user can request an evaluation of her answers and review the incorrectly answered questions. In its initial state, the system had about 4000 lines of Java code (including comments) and consisted of 21 classes. During the practical course, the students had to do inspect and modify the requirements and design documents. Further, they had to do two iterations, during which they had to implement changes and test cases, as well as test the system and generate a documentation. For our case study, only the programming tasks (including writing test cases) for the two iterations are relevant. In total, they covered 5 out of 13 weeks of the practical course. The first iteration dealt with enhancing the existing system functionality. The iteration was divided into three separate subtasks. This iteration was very well suited for PP, as the six-person teams could easily split themselves into three PP teams. The goal of the second iteration was to move the whole system to a client-server architecture (using Java RMI). For this task, it was not obvious how the work could be split. The interesting question was here, how the PP-teams would react to this challenge: Would they continue working as PP-teams or switch to a different mode? Altogether, we had 55 students in nine teams in the course. We had to remove three teams from analysis, as some students dropped out of the course, and these teams were reduced to four students. In the end, we had three teams working with PP, and three teams working in their usual (unsystematic) collaboration mode. It can be argued that the level of control we had in this study is higher than for a typical case study, as we were able to compare two treatments (PP and usual collaboration). However, considering the low process control (for details, see section 4.3) and the long span of time we covered, we cannot speak of a controlled experiment. If at all, we could consider our study a quasi-experiment, taking into account that the level of control is somewhere between a case study and an experiment. However, because of the low level of control we had, we decided to refer to our study as case study, not as quasi-experiment.
4 4 Marcus Ciolkowski, Michael Schlemmer 3.2. Hypotheses and Metrics We used two hypotheses to evaluate Pair Programming against the usual collaboration mode. Hypothesis 1: The quality of code produced with PP is better than with the usual collaboration. One quality metric that is usually used in such case studies is the number of defects in the resulting code. However, in our case, this metric turned out to be useless (for details see section 4.3). Instead, we tried to measure quality of the code through several other metrics. Some of the most important are: o Lines of Code: LOC (PP) This is the traditional measure of size. It counts the number of code lines (without comments). We decided to include this metric to be able to trace our result to earlier studies which also used LOC as quality indicator. The argument often used is that shorter code for the same task means that it is better planned. However, we are well aware that lower LOC does not necessarily imply better code quality. o Comment Ratio: CR (PP) Counts the ratio between comment lines and to total lines of code including comments. The underlying assumption is that a higher comment ratio means better documented code, and thus higher quality. o Coupling Factor: CF (PP) CF is calculated as the fraction between the number of non-inheritance couplings and the maximum possible number of couplings in the system. The underlying assumption is that a lower CF means a less complex system architecture. Hypothesis 2: The effort necessary for PP is 20% higher than with the usual collaboration mode. We measured effort through effort per person in hours. We chose this hypothesis in accordance with the results of previous studies. However, it can be argued that unsystematic collaboration can result in higher overhead than the systematic collaboration enforced by PP. The assumption behind hypothesis 2 is that the unsystematic teams split their work and then work individually on their tasks; that is, they still work as solo programmers. 4. Results In this section, we describe results and experiences we gained in our case study. In sections 4.1 and 4.2, we present results concerning the quality of the code and the effort used for the implementation tasks. Section 4.3 describes experiences and lessons learned during our case study Results concerning the Quality of produced code Lines of Code: The following table shows the LOC for teams using PP and teams using the usual collaboration. As you can see, the mean LOC is slightly lower for PP teams, in both
5 Experiences with a Case Study on Pair Programming 5 iterations. Although the difference is not statistically different, the result can be seen as a weak support for our hypothesis. Iteration Mean LOC Mean LOC Usual Collab. Standard deviation Standard deviation Usual Collab. It ,3 3411,7 385,9 107,9 It ,0 4028,7 111,5 230,8 Comment Ratio: The following table presents the comment ratio for teams using PP and teams using the usual collaboration for both iterations. Teams using PP had a slightly lower comment ratio than teams using the usual collaboration. This metric is an example of a (weak) contradiction of our hypothesis. Iteration Mean CR Mean CR Standard deviation Standard deviation Usual Collab. Usual Collab. It.1 22,0 24,3 7,0 15,0 It.2 20,7 20,7 6,7 2,3 Coupling Factor: The following table shows the coupling factor for the first iteration. The coupling factor is, of course, dominated by the existing system. Therefore, we decided to exclude the second iteration, because it is even stronger dominated by the clientserver architecture of the system, which reduces the influence of PP on the system quality. As you can see, teams using PP produce code with a slightly lower coupling factor. However, the difference is not statistically significant. Iteration Mean CF Mean CF Usual Collab. Standard deviation It.1 17,3 17,7 0,6 0, Results concerning effort Standard deviation Usual Collab The following table shows the mean effort per person in hours for the two iterations. As we be expected, the effort for teams using PP is slightly higher than for teams using the usual collaboration (ca. 10%). For this analysis, we were able to use 16 data points. However, we could not observe any statistically significant differences. Iteration Mean effort Mean effort Standard deviation Standard deviation Usual Collab Usual Collab It.1 15,1 13,8 3,4 4,2 It.2 26,4 24,3 16,0 9, Experiences and Lessons Learned In this section, we present our main experiences gathered during the case study. Treatment Assignment: Our initial idea was to randomly select some teams and train them in Pair Programming. However, this would have meant that we had to teach some students in PP, and others not. One very important restriction was that all students had to be taught the same topics, so we could not use this type of assignment. Our solution was to provide PP material to all students, so everybody had access to the same information. Then, we tried to motivate some teams to use PP. However, the disadvantage is that the performance of teams using PP may be suboptimal, because
6 6 Marcus Ciolkowski, Michael Schlemmer they are not trained. Alternatively, we could have asked for volunteers, but that would also have biased the results, as volunteers are usually more motivated than the rest. It turned out that this motivation worked well enough for our purposes; all students we motivated applied PP later during the course. Process control: Another challenge we had to deal with was that students could work at home. This means that we could not supervise what process they followed. To find out whether the students applied Pair Programming, we used several questionnaires and interviews. We found that this kind of process control has to be improved. The questionnaires we used turned out to be obvious in that students could easily answer what they thought we wanted to hear. One possible solution could be to develop a better questionnaire to measure the process they followed, or to require certain presence times during which we can observe the teams. Measurement: Effort and defect measurement depend highly on the reliability or discipline of the students, which we could not control. To get more reliable measurement data, we made turning in effort and defect measurement sheets part of the grading. Although this guarantees that the students report data on a regular (thus more reliable) basis, they may not deliver clear reports about the effort they used, or defects in their system, as they probably fear that the data will be used against them. We tried to control this by emphasizing that only turning in the measurement sheets, not the content of the sheets, was part of the grading. Additionally, we had a student collecting and analyzing the measurement data, making it clear that no tutor could use the data during the course. However, it turned out that this approach was not sufficient. For example, we did not receive clear reports about defects or problems with the code. We have to find a better way to motivate students to report their defects. Another possible reason for not receiving clear reports is that the discipline in recording effort and defects may not be very high. This is a common problem to all measurement, of course. One solution could be to further facilitate the measurement, either by automatic support (e.g., tools like HackyStat [4]), or using a simpler collection method (web-based or simpler). Quality measurement: The system itself was GUI intensive. This means that, unlike in the previous studies on PP [3][8], we could not use automatic test cases to test the system for defects to evaluate the quality of the code. We tried to use test cases based on scenarios, but they turned out to be useless, as every system passed all tests. Thus, we had to rely on different metrics, such as complexity, to evaluate the quality of the code. Our experience was that this approach is basically feasible, but that we need to refine our quality metrics. For example, we used a tool that computed the worst-case complexity for the system. Although we computed complexity only for the part of the system the students modified, some very complex classes that already existed still dominated the measurement. Further, we need to focus the metrics more to measure only the modifications done by the students. 5. Conclusions Regarding the first hypothesis, that teams using PP would produce higher quality code than teams using the usual collaboration mode, we were not able to find strong
7 Experiences with a Case Study on Pair Programming 7 support. However, we were able to find tendencies for most of the metrics we used that confirm the hypothesis. In previous studies, researchers found a decrease in LOC of about 20% [3], and they concluded that this indicated better code quality. We were not able to show this large difference in our case study. One reason may be that our teams modified an existing system (not a small, isolated task), so the measure was dominated by the system, and the students creativity was restricted by it. Regarding our second hypothesis, that teams using PP would need slightly more effort, we were able to find weak support. In our study, teams using PP needed slightly more effort (ca. 10%) than teams using the usual collaboration. However, PP supporters often claim that, through its collaborative nature, PP helps people to learn to use a new technique. In our case study, the students had to adopt to many new techniques, among them XML and Java RMI (remote method invocation). We could not observe any positive effect for PP teams in terms of adopting to the new techniques. One reason for this could be that this improved learning effect does not exist, or that the students only programmed in pairs but did not make use of pairs when learning about the new techniques. Additional to collecting metrics, we conducted interviews with the students to ask them about their impressions on PP. The students described PP as creating a very constructive working atmosphere. They also claimed they would use PP again. We observed that they used PP for the second iteration even though the task was not very well suited for splitting work, because they had a good impression of PP. All in all, we were able to find tendencies for weak support of the results achieved in earlier studies on PP. Moreover, we were able to find them for a more realistic setting (i.e., larger teams and for a larger project). However, our experiences show that we need to improve and repeat our study in the future. We also hope that others will conduct case studies on PP to increase our knowledge about the applicability of this technique. References [1] Abrahamsson, P., Salo, O., Ronkainen, J., and Warsta, J.: Agile software development methods Review and analysis. VTT Publications 478, Online at [2] Beck: Extreme Programming Explained: Embrace Change. Addison Wesley 1999 [3] Cockburn, William: The Costs and Benefits of Pair Programming. Online at [4] Johnson, P.: You can t even ask them to push a button: Toward ubiquitous, developer-centric, empirical software engineering. The NSF Workshop for New Visions for Software Design and Productivity, December, Online at: Hackystat.html [5] J.T. Nosek: The Case for Collaborative Programming. Comm. ACM, Vol. 41, No. 3, 1998, pp [6] Schlemmer, Michael: Eine Fallstudie zum Vergleich von mit herkömmlicher Programmierung. Project Thesis (in German), Universität Kaiserslautern, 2002 [7] Williams, L. and Kessler, R.: All I Really Need to Know about Pair Programming I Learned In Kindergarten, Communications of the ACM, May [8] Williams, Kessler: The Effects of Pair-Pressure and Pair-Learning on Software Engineering Education, CSEET Online at
Deploying Agile Practices in Organizations: A Case Study
Copyright: EuroSPI 2005, Will be presented at 9-11 November, Budapest, Hungary Deploying Agile Practices in Organizations: A Case Study Minna Pikkarainen 1, Outi Salo 1, and Jari Still 2 1 VTT Technical
More informationPair Programming: When and Why it Works
Pair Programming: When and Why it Works Jan Chong 1, Robert Plummer 2, Larry Leifer 3, Scott R. Klemmer 2, Ozgur Eris 3, and George Toye 3 1 Stanford University, Department of Management Science and Engineering,
More informationA cognitive perspective on pair programming
Association for Information Systems AIS Electronic Library (AISeL) AMCIS 2006 Proceedings Americas Conference on Information Systems (AMCIS) December 2006 A cognitive perspective on pair programming Radhika
More informationTU-E2090 Research Assignment in Operations Management and Services
Aalto University School of Science Operations and Service Management TU-E2090 Research Assignment in Operations Management and Services Version 2016-08-29 COURSE INSTRUCTOR: OFFICE HOURS: CONTACT: Saara
More informationPair Programming. Spring 2015
CS4 Introduction to Scientific Computing Potter Pair Programming Spring 2015 1 What is Pair Programming? Simply put, pair programming is two people working together at a single computer [1]. The practice
More informationImproving software testing course experience with pair testing pattern. Iyad Alazzam* and Mohammed Akour
244 Int. J. Teaching and Case Studies, Vol. 6, No. 3, 2015 Improving software testing course experience with pair testing pattern Iyad lazzam* and Mohammed kour Department of Computer Information Systems,
More informationPair Programming in Introductory Programming Labs
Session 2230 Pair Programming in Introductory Programming Labs Eric N. Wiebe, Laurie Williams, Julie Petlick, Nachiappan Nagappan, Suzanne Balik, Carol Miller and Miriam Ferzli NC State University, Raleigh,
More informationOn the Combined Behavior of Autonomous Resource Management Agents
On the Combined Behavior of Autonomous Resource Management Agents Siri Fagernes 1 and Alva L. Couch 2 1 Faculty of Engineering Oslo University College Oslo, Norway siri.fagernes@iu.hio.no 2 Computer Science
More informationAn ICT environment to assess and support students mathematical problem-solving performance in non-routine puzzle-like word problems
An ICT environment to assess and support students mathematical problem-solving performance in non-routine puzzle-like word problems Angeliki Kolovou* Marja van den Heuvel-Panhuizen*# Arthur Bakker* Iliada
More informationNotes on The Sciences of the Artificial Adapted from a shorter document written for course (Deciding What to Design) 1
Notes on The Sciences of the Artificial Adapted from a shorter document written for course 17-652 (Deciding What to Design) 1 Ali Almossawi December 29, 2005 1 Introduction The Sciences of the Artificial
More informationBENCHMARK TREND COMPARISON REPORT:
National Survey of Student Engagement (NSSE) BENCHMARK TREND COMPARISON REPORT: CARNEGIE PEER INSTITUTIONS, 2003-2011 PREPARED BY: ANGEL A. SANCHEZ, DIRECTOR KELLI PAYNE, ADMINISTRATIVE ANALYST/ SPECIALIST
More informationThe Role of Architecture in a Scaled Agile Organization - A Case Study in the Insurance Industry
Master s Thesis for the Attainment of the Degree Master of Science at the TUM School of Management of the Technische Universität München The Role of Architecture in a Scaled Agile Organization - A Case
More informationIT4305: Rapid Software Development Part 2: Structured Question Paper
UNIVERSITY OF COLOMBO, SRI LANKA UNIVERSITY OF COLOMBO SCHOOL OF COMPUTING DEGREE OF BACHELOR OF INFORMATION TECHNOLOGY (EXTERNAL) Academic Year 2014/2015 2 nd Year Examination Semester 4 IT4305: Rapid
More informationA Context-Driven Use Case Creation Process for Specifying Automotive Driver Assistance Systems
A Context-Driven Use Case Creation Process for Specifying Automotive Driver Assistance Systems Hannes Omasreiter, Eduard Metzker DaimlerChrysler AG Research Information and Communication Postfach 23 60
More informationOnline Marking of Essay-type Assignments
Online Marking of Essay-type Assignments Eva Heinrich, Yuanzhi Wang Institute of Information Sciences and Technology Massey University Palmerston North, New Zealand E.Heinrich@massey.ac.nz, yuanzhi_wang@yahoo.com
More informationEntrepreneurial Discovery and the Demmert/Klein Experiment: Additional Evidence from Germany
Entrepreneurial Discovery and the Demmert/Klein Experiment: Additional Evidence from Germany Jana Kitzmann and Dirk Schiereck, Endowed Chair for Banking and Finance, EUROPEAN BUSINESS SCHOOL, International
More informationAlgebra 1, Quarter 3, Unit 3.1. Line of Best Fit. Overview
Algebra 1, Quarter 3, Unit 3.1 Line of Best Fit Overview Number of instructional days 6 (1 day assessment) (1 day = 45 minutes) Content to be learned Analyze scatter plots and construct the line of best
More informationPair Programming: A Contingency Approach
Pair Programming: A Contingency Approach Pair Programming: A Contingency Approach Abstract Carolina Salge University of Georgia csalge@uga.edu Research-in-Progress Nicholas Berente University of Georgia
More informationSchool Inspection in Hesse/Germany
Hessisches Kultusministerium School Inspection in Hesse/Germany Contents 1. Introduction...2 2. School inspection as a Procedure for Quality Assurance and Quality Enhancement...2 3. The Hessian framework
More informationCONCEPT MAPS AS A DEVICE FOR LEARNING DATABASE CONCEPTS
CONCEPT MAPS AS A DEVICE FOR LEARNING DATABASE CONCEPTS Pirjo Moen Department of Computer Science P.O. Box 68 FI-00014 University of Helsinki pirjo.moen@cs.helsinki.fi http://www.cs.helsinki.fi/pirjo.moen
More informationHIGH SCHOOL SPECIAL NEEDS STUDENTS ATTITUDES ABOUT INCLUSION. By LaRue A. Pierce. A Research Paper
HIGH SCHOOL SPECIAL NEEDS STUDENTS ATTITUDES ABOUT INCLUSION By LaRue A. Pierce A Research Paper Submitted in Partial Fulfillment of the Requirements for the Master of Education Degree Approved: 2 Semester
More informationHow to Judge the Quality of an Objective Classroom Test
How to Judge the Quality of an Objective Classroom Test Technical Bulletin #6 Evaluation and Examination Service The University of Iowa (319) 335-0356 HOW TO JUDGE THE QUALITY OF AN OBJECTIVE CLASSROOM
More informationCSC200: Lecture 4. Allan Borodin
CSC200: Lecture 4 Allan Borodin 1 / 22 Announcements My apologies for the tutorial room mixup on Wednesday. The room SS 1088 is only reserved for Fridays and I forgot that. My office hours: Tuesdays 2-4
More informationOn-Line Data Analytics
International Journal of Computer Applications in Engineering Sciences [VOL I, ISSUE III, SEPTEMBER 2011] [ISSN: 2231-4946] On-Line Data Analytics Yugandhar Vemulapalli #, Devarapalli Raghu *, Raja Jacob
More informationSoftware Maintenance
1 What is Software Maintenance? Software Maintenance is a very broad activity that includes error corrections, enhancements of capabilities, deletion of obsolete capabilities, and optimization. 2 Categories
More informationAlpha provides an overall measure of the internal reliability of the test. The Coefficient Alphas for the STEP are:
Every individual is unique. From the way we look to how we behave, speak, and act, we all do it differently. We also have our own unique methods of learning. Once those methods are identified, it can make
More informationSuccessfully Flipping a Mathematics Classroom
2014 Hawaii University International Conferences Science, Technology, Engineering, Math & Education June 16, 17, & 18 2014 Ala Moana Hotel, Honolulu, Hawaii Successfully Flipping a Mathematics Classroom
More informationEvidence-based Practice: A Workshop for Training Adult Basic Education, TANF and One Stop Practitioners and Program Administrators
Evidence-based Practice: A Workshop for Training Adult Basic Education, TANF and One Stop Practitioners and Program Administrators May 2007 Developed by Cristine Smith, Beth Bingman, Lennox McLendon and
More informationProbability estimates in a scenario tree
101 Chapter 11 Probability estimates in a scenario tree An expert is a person who has made all the mistakes that can be made in a very narrow field. Niels Bohr (1885 1962) Scenario trees require many numbers.
More informationEvaluation of Usage Patterns for Web-based Educational Systems using Web Mining
Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Dave Donnellan, School of Computer Applications Dublin City University Dublin 9 Ireland daviddonnellan@eircom.net Claus Pahl
More informationEvaluation of Usage Patterns for Web-based Educational Systems using Web Mining
Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Dave Donnellan, School of Computer Applications Dublin City University Dublin 9 Ireland daviddonnellan@eircom.net Claus Pahl
More informationEvaluating Collaboration and Core Competence in a Virtual Enterprise
PsychNology Journal, 2003 Volume 1, Number 4, 391-399 Evaluating Collaboration and Core Competence in a Virtual Enterprise Rainer Breite and Hannu Vanharanta Tampere University of Technology, Pori, Finland
More informationBy Laurence Capron and Will Mitchell, Boston, MA: Harvard Business Review Press, 2012.
Copyright Academy of Management Learning and Education Reviews Build, Borrow, or Buy: Solving the Growth Dilemma By Laurence Capron and Will Mitchell, Boston, MA: Harvard Business Review Press, 2012. 256
More informationTHE PENNSYLVANIA STATE UNIVERSITY SCHREYER HONORS COLLEGE DEPARTMENT OF MATHEMATICS ASSESSING THE EFFECTIVENESS OF MULTIPLE CHOICE MATH TESTS
THE PENNSYLVANIA STATE UNIVERSITY SCHREYER HONORS COLLEGE DEPARTMENT OF MATHEMATICS ASSESSING THE EFFECTIVENESS OF MULTIPLE CHOICE MATH TESTS ELIZABETH ANNE SOMERS Spring 2011 A thesis submitted in partial
More informationStudy Group Handbook
Study Group Handbook Table of Contents Starting out... 2 Publicizing the benefits of collaborative work.... 2 Planning ahead... 4 Creating a comfortable, cohesive, and trusting environment.... 4 Setting
More informationIncluding the Microsoft Solution Framework as an agile method into the V-Modell XT
Including the Microsoft Solution Framework as an agile method into the V-Modell XT Marco Kuhrmann 1 and Thomas Ternité 2 1 Technische Universität München, Boltzmann-Str. 3, 85748 Garching, Germany kuhrmann@in.tum.de
More informationSimple Random Sample (SRS) & Voluntary Response Sample: Examples: A Voluntary Response Sample: Examples: Systematic Sample Best Used When
Simple Random Sample (SRS) & Voluntary Response Sample: In statistics, a simple random sample is a group of people who have been chosen at random from the general population. A simple random sample is
More informationImplementing a tool to Support KAOS-Beta Process Model Using EPF
Implementing a tool to Support KAOS-Beta Process Model Using EPF Malihe Tabatabaie Malihe.Tabatabaie@cs.york.ac.uk Department of Computer Science The University of York United Kingdom Eclipse Process Framework
More informationPredicting Students Performance with SimStudent: Learning Cognitive Skills from Observation
School of Computer Science Human-Computer Interaction Institute Carnegie Mellon University Year 2007 Predicting Students Performance with SimStudent: Learning Cognitive Skills from Observation Noboru Matsuda
More informationRunning Head: STUDENT CENTRIC INTEGRATED TECHNOLOGY
SCIT Model 1 Running Head: STUDENT CENTRIC INTEGRATED TECHNOLOGY Instructional Design Based on Student Centric Integrated Technology Model Robert Newbury, MS December, 2008 SCIT Model 2 Abstract The ADDIE
More informationSouth Carolina English Language Arts
South Carolina English Language Arts A S O F J U N E 2 0, 2 0 1 0, T H I S S TAT E H A D A D O P T E D T H E CO M M O N CO R E S TAT E S TA N DA R D S. DOCUMENTS REVIEWED South Carolina Academic Content
More informationStudent Perceptions of Reflective Learning Activities
Student Perceptions of Reflective Learning Activities Rosalind Wynne Electrical and Computer Engineering Department Villanova University, PA rosalind.wynne@villanova.edu Abstract It is widely accepted
More informationCWIS 23,3. Nikolaos Avouris Human Computer Interaction Group, University of Patras, Patras, Greece
The current issue and full text archive of this journal is available at wwwemeraldinsightcom/1065-0741htm CWIS 138 Synchronous support and monitoring in web-based educational systems Christos Fidas, Vasilios
More informationA Study of Metacognitive Awareness of Non-English Majors in L2 Listening
ISSN 1798-4769 Journal of Language Teaching and Research, Vol. 4, No. 3, pp. 504-510, May 2013 Manufactured in Finland. doi:10.4304/jltr.4.3.504-510 A Study of Metacognitive Awareness of Non-English Majors
More informationObserving Teachers: The Mathematics Pedagogy of Quebec Francophone and Anglophone Teachers
Observing Teachers: The Mathematics Pedagogy of Quebec Francophone and Anglophone Teachers Dominic Manuel, McGill University, Canada Annie Savard, McGill University, Canada David Reid, Acadia University,
More informationInterdisciplinary Research - Challenges and Opportunities for Actuarial Profession. Aldona Skučaitė, lecturer Vilnius university
Interdisciplinary Research - Challenges and Opportunities for Actuarial Profession Aldona Skučaitė, lecturer Vilnius university Presentation outline Introduction Concept of Interdisciplinary research IDR
More informationConceptual and Procedural Knowledge of a Mathematics Problem: Their Measurement and Their Causal Interrelations
Conceptual and Procedural Knowledge of a Mathematics Problem: Their Measurement and Their Causal Interrelations Michael Schneider (mschneider@mpib-berlin.mpg.de) Elsbeth Stern (stern@mpib-berlin.mpg.de)
More informationSuccessful Studio-Based Real-World Projects in IT Education
Successful Studio-Based Real-World Projects in IT Education Matthew Simpson, Jay Burmeister, Alan Boykiw and Jihan Zhu Information Environments Program, School of Information Technology & Electrical Engineering
More informationDeveloping creativity in a company whose business is creativity By Andy Wilkins
Developing creativity in a company whose business is creativity By Andy Wilkins Background and Purpose of this Article The primary purpose of this article is to outline an intervention made in one of the
More informationHAZOP-based identification of events in use cases
Empir Software Eng (2015) 20: 82 DOI 10.1007/s10664-013-9277-5 HAZOP-based identification of events in use cases An empirical study Jakub Jurkiewicz Jerzy Nawrocki Mirosław Ochodek Tomasz Głowacki Published
More informationIdentifying Novice Difficulties in Object Oriented Design
Identifying Novice Difficulties in Object Oriented Design Benjy Thomasson, Mark Ratcliffe, Lynda Thomas University of Wales, Aberystwyth Penglais Hill Aberystwyth, SY23 1BJ +44 (1970) 622424 {mbr, ltt}
More informationWhat Different Kinds of Stratification Can Reveal about the Generalizability of Data-Mined Skill Assessment Models
What Different Kinds of Stratification Can Reveal about the Generalizability of Data-Mined Skill Assessment Models Michael A. Sao Pedro Worcester Polytechnic Institute 100 Institute Rd. Worcester, MA 01609
More informationLife and career planning
Paper 30-1 PAPER 30 Life and career planning Bob Dick (1983) Life and career planning: a workbook exercise. Brisbane: Department of Psychology, University of Queensland. A workbook for class use. Introduction
More informationEarly Warning System Implementation Guide
Linking Research and Resources for Better High Schools betterhighschools.org September 2010 Early Warning System Implementation Guide For use with the National High School Center s Early Warning System
More informationCalculators in a Middle School Mathematics Classroom: Helpful or Harmful?
University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Action Research Projects Math in the Middle Institute Partnership 7-2008 Calculators in a Middle School Mathematics Classroom:
More informationLearning Lesson Study Course
Learning Lesson Study Course Developed originally in Japan and adapted by Developmental Studies Center for use in schools across the United States, lesson study is a model of professional development in
More informationDyslexia and Dyscalculia Screeners Digital. Guidance and Information for Teachers
Dyslexia and Dyscalculia Screeners Digital Guidance and Information for Teachers Digital Tests from GL Assessment For fully comprehensive information about using digital tests from GL Assessment, please
More informationSuccess Factors for Creativity Workshops in RE
Success Factors for Creativity s in RE Sebastian Adam, Marcus Trapp Fraunhofer IESE Fraunhofer-Platz 1, 67663 Kaiserslautern, Germany {sebastian.adam, marcus.trapp}@iese.fraunhofer.de Abstract. In today
More informationSpecification of the Verity Learning Companion and Self-Assessment Tool
Specification of the Verity Learning Companion and Self-Assessment Tool Sergiu Dascalu* Daniela Saru** Ryan Simpson* Justin Bradley* Eva Sarwar* Joohoon Oh* * Department of Computer Science ** Dept. of
More informationMASTER S THESIS GUIDE MASTER S PROGRAMME IN COMMUNICATION SCIENCE
MASTER S THESIS GUIDE MASTER S PROGRAMME IN COMMUNICATION SCIENCE University of Amsterdam Graduate School of Communication Kloveniersburgwal 48 1012 CX Amsterdam The Netherlands E-mail address: scripties-cw-fmg@uva.nl
More informationCORE CURRICULUM FOR REIKI
CORE CURRICULUM FOR REIKI Published July 2017 by The Complementary and Natural Healthcare Council (CNHC) copyright CNHC Contents Introduction... page 3 Overall aims of the course... page 3 Learning outcomes
More informationMGT/MGP/MGB 261: Investment Analysis
UNIVERSITY OF CALIFORNIA, DAVIS GRADUATE SCHOOL OF MANAGEMENT SYLLABUS for Fall 2014 MGT/MGP/MGB 261: Investment Analysis Daytime MBA: Tu 12:00p.m. - 3:00 p.m. Location: 1302 Gallagher (CRN: 51489) Sacramento
More informationAn Introduction to Simio for Beginners
An Introduction to Simio for Beginners C. Dennis Pegden, Ph.D. This white paper is intended to introduce Simio to a user new to simulation. It is intended for the manufacturing engineer, hospital quality
More informationMARKETING FOR THE BOP WORKSHOP
MARKETING FOR THE BOP WORKSHOP Concept Note This note presents our methodology to help refine the marketing and sales practices of organizations that sell innovative devices (such as water filters or improved
More informationTeaching Algorithm Development Skills
International Journal of Advanced Computer Science, Vol. 3, No. 9, Pp. 466-474, Sep., 2013. Teaching Algorithm Development Skills Jungsoon Yoo, Sung Yoo, Suk Seo, Zhijiang Dong, & Chrisila Pettey Manuscript
More informationSummary results (year 1-3)
Summary results (year 1-3) Evaluation and accountability are key issues in ensuring quality provision for all (Eurydice, 2004). In Europe, the dominant arrangement for educational accountability is school
More informationCommunication Studies 151 & LAB Class # & Fall 2014 Thursdays 4:00-6:45
Communication Studies 151 & LAB Class # 10941 & 10942 Fall 2014 Thursdays 4:00-6:45 Instructor: Bridget Sampson Websites: BridgetSampson.com / SampsonCommunicationConsulting.com Classroom: MZ111 Box for
More informationGROUP COMPOSITION IN THE NAVIGATION SIMULATOR A PILOT STUDY Magnus Boström (Kalmar Maritime Academy, Sweden)
GROUP COMPOSITION IN THE NAVIGATION SIMULATOR A PILOT STUDY Magnus Boström (Kalmar Maritime Academy, Sweden) magnus.bostrom@lnu.se ABSTRACT: At Kalmar Maritime Academy (KMA) the first-year students at
More informationBuild on students informal understanding of sharing and proportionality to develop initial fraction concepts.
Recommendation 1 Build on students informal understanding of sharing and proportionality to develop initial fraction concepts. Students come to kindergarten with a rudimentary understanding of basic fraction
More informationExperiences Using Defect Checklists in Software Engineering Education
Experiences Using Defect Checklists in Software Engineering Education Kendra Cooper 1, Sheila Liddle 1, Sergiu Dascalu 2 1 Department of Computer Science The University of Texas at Dallas Richardson, TX,
More informationDYNAMIC ADAPTIVE HYPERMEDIA SYSTEMS FOR E-LEARNING
University of Craiova, Romania Université de Technologie de Compiègne, France Ph.D. Thesis - Abstract - DYNAMIC ADAPTIVE HYPERMEDIA SYSTEMS FOR E-LEARNING Elvira POPESCU Advisors: Prof. Vladimir RĂSVAN
More informationLEGO MINDSTORMS Education EV3 Coding Activities
LEGO MINDSTORMS Education EV3 Coding Activities s t e e h s k r o W t n e d Stu LEGOeducation.com/MINDSTORMS Contents ACTIVITY 1 Performing a Three Point Turn 3-6 ACTIVITY 2 Written Instructions for a
More informationReinforcement Learning by Comparing Immediate Reward
Reinforcement Learning by Comparing Immediate Reward Punit Pandey DeepshikhaPandey Dr. Shishir Kumar Abstract This paper introduces an approach to Reinforcement Learning Algorithm by comparing their immediate
More informationDevelopment of an IT Curriculum. Dr. Jochen Koubek Humboldt-Universität zu Berlin Technische Universität Berlin 2008
Development of an IT Curriculum Dr. Jochen Koubek Humboldt-Universität zu Berlin Technische Universität Berlin 2008 Curriculum A curriculum consists of everything that promotes learners intellectual, personal,
More informationBluetooth mlearning Applications for the Classroom of the Future
Bluetooth mlearning Applications for the Classroom of the Future Tracey J. Mehigan, Daniel C. Doolan, Sabin Tabirca Department of Computer Science, University College Cork, College Road, Cork, Ireland
More informationMathematics Program Assessment Plan
Mathematics Program Assessment Plan Introduction This assessment plan is tentative and will continue to be refined as needed to best fit the requirements of the Board of Regent s and UAS Program Review
More informationWhat is beautiful is useful visual appeal and expected information quality
What is beautiful is useful visual appeal and expected information quality Thea van der Geest University of Twente T.m.vandergeest@utwente.nl Raymond van Dongelen Noordelijke Hogeschool Leeuwarden Dongelen@nhl.nl
More informationPSYCHOLOGY 353: SOCIAL AND PERSONALITY DEVELOPMENT IN CHILDREN SPRING 2006
PSYCHOLOGY 353: SOCIAL AND PERSONALITY DEVELOPMENT IN CHILDREN SPRING 2006 INSTRUCTOR: OFFICE: Dr. Elaine Blakemore Neff 388A TELEPHONE: 481-6400 E-MAIL: OFFICE HOURS: TEXTBOOK: READINGS: WEB PAGE: blakemor@ipfw.edu
More informationAGENDA LEARNING THEORIES LEARNING THEORIES. Advanced Learning Theories 2/22/2016
AGENDA Advanced Learning Theories Alejandra J. Magana, Ph.D. admagana@purdue.edu Introduction to Learning Theories Role of Learning Theories and Frameworks Learning Design Research Design Dual Coding Theory
More informationTeachers Guide Chair Study
Certificate of Initial Mastery Task Booklet 2006-2007 School Year Teachers Guide Chair Study Dance Modified On-Demand Task Revised 4-19-07 Central Falls Johnston Middletown West Warwick Coventry Lincoln
More informationA Game-based Assessment of Children s Choices to Seek Feedback and to Revise
A Game-based Assessment of Children s Choices to Seek Feedback and to Revise Maria Cutumisu, Kristen P. Blair, Daniel L. Schwartz, Doris B. Chin Stanford Graduate School of Education Please address all
More informationThe Effect of Close Reading on Reading Comprehension. Scores of Fifth Grade Students with Specific Learning Disabilities.
The Effect of Close Reading on Reading Comprehension Scores of Fifth Grade Students with Specific Learning Disabilities By Erica Blouin Submitted in Partial Fulfillment of the Requirements for the Degree
More informationOPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS
OPTIMIZATINON OF TRAINING SETS FOR HEBBIAN-LEARNING- BASED CLASSIFIERS Václav Kocian, Eva Volná, Michal Janošek, Martin Kotyrba University of Ostrava Department of Informatics and Computers Dvořákova 7,
More informationHEROIC IMAGINATION PROJECT. A new way of looking at heroism
HEROIC IMAGINATION PROJECT A new way of looking at heroism CONTENTS --------------------------------------------------------------------------------------------------------- Introduction 3 Programme 1:
More informationIMPROVING SPEAKING SKILL OF THE TENTH GRADE STUDENTS OF SMK 17 AGUSTUS 1945 MUNCAR THROUGH DIRECT PRACTICE WITH THE NATIVE SPEAKER
IMPROVING SPEAKING SKILL OF THE TENTH GRADE STUDENTS OF SMK 17 AGUSTUS 1945 MUNCAR THROUGH DIRECT PRACTICE WITH THE NATIVE SPEAKER Mohamad Nor Shodiq Institut Agama Islam Darussalam (IAIDA) Banyuwangi
More informationProcess Evaluations for a Multisite Nutrition Education Program
Process Evaluations for a Multisite Nutrition Education Program Paul Branscum 1 and Gail Kaye 2 1 The University of Oklahoma 2 The Ohio State University Abstract Process evaluations are an often-overlooked
More informationSpecification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments
Specification and Evaluation of Machine Translation Toy Systems - Criteria for laboratory assignments Cristina Vertan, Walther v. Hahn University of Hamburg, Natural Language Systems Division Hamburg,
More informationEffective practices of peer mentors in an undergraduate writing intensive course
Effective practices of peer mentors in an undergraduate writing intensive course April G. Douglass and Dennie L. Smith * Department of Teaching, Learning, and Culture, Texas A&M University This article
More informationDOES RETELLING TECHNIQUE IMPROVE SPEAKING FLUENCY?
DOES RETELLING TECHNIQUE IMPROVE SPEAKING FLUENCY? Noor Rachmawaty (itaw75123@yahoo.com) Istanti Hermagustiana (dulcemaria_81@yahoo.com) Universitas Mulawarman, Indonesia Abstract: This paper is based
More informationCreating Meaningful Assessments for Professional Development Education in Software Architecture
Creating Meaningful Assessments for Professional Development Education in Software Architecture Elspeth Golden Human-Computer Interaction Institute Carnegie Mellon University Pittsburgh, PA egolden@cs.cmu.edu
More informationFaculty Schedule Preference Survey Results
Faculty Schedule Preference Survey Results Surveys were distributed to all 199 faculty mailboxes with information about moving to a 16 week calendar followed by asking their calendar schedule. Objective
More informationBeyond Classroom Solutions: New Design Perspectives for Online Learning Excellence
Educational Technology & Society 5(2) 2002 ISSN 1436-4522 Beyond Classroom Solutions: New Design Perspectives for Online Learning Excellence Moderator & Sumamrizer: Maggie Martinez CEO, The Training Place,
More informationNumber of students enrolled in the program in Fall, 2011: 20. Faculty member completing template: Molly Dugan (Date: 1/26/2012)
Program: Journalism Minor Department: Communication Studies Number of students enrolled in the program in Fall, 2011: 20 Faculty member completing template: Molly Dugan (Date: 1/26/2012) Period of reference
More informationStrategic Practice: Career Practitioner Case Study
Strategic Practice: Career Practitioner Case Study heidi Lund 1 Interpersonal conflict has one of the most negative impacts on today s workplaces. It reduces productivity, increases gossip, and I believe
More informationMath 96: Intermediate Algebra in Context
: Intermediate Algebra in Context Syllabus Spring Quarter 2016 Daily, 9:20 10:30am Instructor: Lauri Lindberg Office Hours@ tutoring: Tutoring Center (CAS-504) 8 9am & 1 2pm daily STEM (Math) Center (RAI-338)
More informationPractical Research. Planning and Design. Paul D. Leedy. Jeanne Ellis Ormrod. Upper Saddle River, New Jersey Columbus, Ohio
SUB Gfittingen 213 789 981 2001 B 865 Practical Research Planning and Design Paul D. Leedy The American University, Emeritus Jeanne Ellis Ormrod University of New Hampshire Upper Saddle River, New Jersey
More informationRunning head: DELAY AND PROSPECTIVE MEMORY 1
Running head: DELAY AND PROSPECTIVE MEMORY 1 In Press at Memory & Cognition Effects of Delay of Prospective Memory Cues in an Ongoing Task on Prospective Memory Task Performance Dawn M. McBride, Jaclyn
More informationAbstractions and the Brain
Abstractions and the Brain Brian D. Josephson Department of Physics, University of Cambridge Cavendish Lab. Madingley Road Cambridge, UK. CB3 OHE bdj10@cam.ac.uk http://www.tcm.phy.cam.ac.uk/~bdj10 ABSTRACT
More informationBittinger, M. L., Ellenbogen, D. J., & Johnson, B. L. (2012). Prealgebra (6th ed.). Boston, MA: Addison-Wesley.
Course Syllabus Course Description Explores the basic fundamentals of college-level mathematics. (Note: This course is for institutional credit only and will not be used in meeting degree requirements.
More informationTHE EFFECTS OF CREATIVE TEACHING METHOD ON MOTIVATION AND ACADEMIC ACHIEVEMENT OF ELEMENTARY SCHOOL STUDENTS IN ACADEMIC YEAR
THE EFFECTS OF CREATIVE TEACHING METHOD ON MOTIVATION AND ACADEMIC ACHIEVEMENT OF ELEMENTARY SCHOOL STUDENTS IN ACADEMIC YEAR 2014-2015 Javad Soleymanpour Department of Curriculum Planning, Islamic Azad
More information