TITLE: COMMUNICATION-MINDED VISUALIZATION: A CALL TO ACTION. AUTHOR(S): F. B. Viégas, and M. Wattenberg

Size: px
Start display at page:

Download "TITLE: COMMUNICATION-MINDED VISUALIZATION: A CALL TO ACTION. AUTHOR(S): F. B. Viégas, and M. Wattenberg"

Transcription

1 TITLE: COMMUNICATION-MINDED VISUALIZATION: A CALL TO ACTION AUTHOR(S): F. B. Viégas, and M. Wattenberg ABSTRACT: Visualization is traditionally viewed as an efficient way of transferring a large amount of information from a database into an individual's head. As a result, researchers have largely focused on techniques that improve the display of datasets for a single user. This paper proposes a new perspective, communication-minded visualization (CMV), which recognizes that data analysis is often a process involving intense communication among various stakeholders. These communication processes may occur synchronously or asynchronously, in collocated or remote settings. Drawing upon examples of existing ad hoc communication around visualization as well as theory from the field of computer-supported cooperative work, we lay out a series of a research questions and design hypotheses for CMV. 1

2 I) INTRODUCTION In 2003, the first author created a a software tool to visualize individuals archives (Viégas et al., 2004). The visualization was directed at the owners of the archives and, given the personal nature of the data, it was assumed users would only view them alone. Indeed, when running a study on the system, the experimenters carefully explained to participants that no other person would have access to the visualizations. Yet as soon as users were given the applications they began finding ways to share the images. Users mailed screen shots to friends and family and called friends to sit with them to look at the visualizations together. This sharing prompted deep reminiscing and long conversations about events in users lives, which they considered an important benefit of the system. In 2005, the second author created the NameVoyager, a web-based visualization of historical data on baby name popularity (Wattenberg, 2005). The NameVoyager was designed to help expectant parents find names as well as to encourage individual exploration of the data. As it turned out, the data was explored but not just by individuals. Visitors to the site started engaging in deep conversation about their findings in discussion forums and blog comments, collectively identifying trends and anomalies and forming conjectures about the data. Communication-Minded Visualization Both of these accounts point to an unexpectedly powerful role for data visualization: that of communication enabler. While not specifically designed for communication, the applications above created rich opportunities for users to engage of discussions about the data being displayed. Inspired by these experiences, this paper introduces the concept of communication-minded visualization (CMV), meaning visualizations designed to support communication and collaborative analysis. Our emphasis is on the design of the user experience rather than technical implementation challenges. Design for communication is essential because users do not interact with visualizations solely to gain personal insights. An insight that matters will generally have to be communicated to others. As (Johnson et al., 2006) points out, visualization exists in connection with many other disciplines. To harness the power of visualization as a working tool for interdisciplinary teams, designers need to pay close attention to how visualization affects and enables the communication of discoveries and the discussion of ideas within multiple contexts. As in the examples above, communication of visualization findings usually happens through a series of ad-hoc practices, ranging from the all-pervasive screen shot to elaborate narrated videos. Also ubiquitous is the practice of leaning over someone s shoulder to see what is happening on their monitor. It is not uncommon to have up to six viewers looking at the same visualization screen as one person interacts with the data (L. Bauerle, personal communication, January 10, 2006). In presentation settings, users will project screen shots or even videos of a visualization. In certain settings, such as conference presentations for instance, video sequences have become more common as a way of making interaction and transition techniques easily understandable to viewers. Finally, printouts are used to share analysis and findings. The Need for New Ideas Unfortunately, ad hoc sharing practices all suffer from serious drawbacks. Most visualizations rely on interaction and are far less effective in screenshot or printed form. For example many popular visualizations, such as the SmartMoney Map of the Market (Wattenberg, 1999), use tooltips to label small items and so become partially illegible in screenshot form. For applications that use three dimensions, removing the possibility of motion means that the viewer has lost one 2

3 of the strongest depth cues (Ware, 2000). Videos can be disorienting and difficult to understand, since it can be hard to follow what actions the user is taking or know where to look onscreen. Aside from basic legibility considerations, an inability to drill down into details (whether because the user is watching a canned video or a screenshot) may reduce the credibility of an analysis. As a result, ad hoc sharing of non-interactive versions of a visualization is an unsatisfactory solution. Even though communication about and around visualization programs abounds in the real world, the ability to easily capture and communicate visualization interaction and discovery processes has received little attention from the research community. Although some commercial products have started to explore CMV-style interaction, a theoretical framework with which to think about CMV would help ground enquiry in this area as well as encourage the emergence of a community of interest. Such a framework would lay out the range of issues in the area, associate this topic to related research areas, and provide initial guidelines for CMV design and evaluation. This paper attempts to provide a preliminary version of this framework. First, we describe existing systems a research prototype and commercially available products that address different communication needs in visualization. Second, we highlight established research areas whose concerns are related to the ones in CMV. We point out the relevant topics in these areas and how these issues emerge in CMV. Finally, we outline proposals for the design and evaluation of applications. II) EXISTING SYSTEMS Designers have not completely ignored the role of communication and group usage in visualizations. It is worthwhile discussing some systems that to some extent already embody CMV. Existing applications range from large projects focused on collaborative activity to small research prototypes where CMV is just once concern of many. The PhotoMesa project (Bederson, 2001) is an image browser whose interface was designed for multiple collocated viewers. Inspired by the desire to have his two-year-old daughter watch him browse without getting lost, Bederson set a design goal that all viewers should be able to easily follow what the person interacting with the tool was doing. To ensure that sequences of navigational inputs and outputs were obvious to audience members, the PhotoMesa employs zooming and highlighting to call attention to mouse actions and make transitions comprehensible. A much larger system is CoMotion, from Maya Viz ( a commercially available product that allows users to synchronously and remotely share visual data analysis tasks. In CoMotion a user opens a shared window that provides a shared view of the visualization tools in the application. Users can take turns interacting with the data in the shared view, chatting via instant messaging The CoMotion architecture led to an application for the US military called Command Post of the Future, allows the members of a command unit to share information through a collaborative visualization application [Figure 1]. In addition to a large visualization screen that is the focal point of the command room, every user their own computer running a copy of the visualization. Individual users can manipulate and annotate maps with the annotations immediately showing up on all other users screens and speeding up the spread of information. The general who deployed the system in Iraq in 2004 credits the application with providing him and subordinate commanders with the best level of insight and situational awareness in his 30-year career (Roth, 2004). 3

4 Since the mid-1990s (Anupam et al, 1994), several research projects have explored synchronous networked usage of scientific visualization under the rubric of collaborative visualization. Collaborative visualization systems have become important data exploration tools in a range of scientific fields from medical diagnosis (Chui & Heng, 2001) to archaeological excavations (Benko, 2004). The concerns of this field have primarily been related to the technical problem of faithfully replicating one user s experience for another at different network location. (Brodlie et al., 2004) provides an excellent survey of the state of the art. Visualization sharing can also happen asynchronously. DiscussionSite Posters by Spotfire, Inc. ( is the only system the authors of this paper could find which has been designed specifically to support asynchronous communication about and around visualizations. The application is a thin, Web-based client that allows users to capture interactive snapshots of data analyses. All analytic parameters can be shared, allowing a user to pass a saved poster to a co-worker, who in turn can refine the analysis [Figure 2]. Users can make notes and set visualization bookmarks (pointers to a specific state of the visualization). The notes are similar to message threads and allow any researcher to see comments made by others who have looked at the results. DecisionSite Posters can also be sent using regular ; a recipient of a poster may then view and interact with the poster via a web browser and even can follow the steps the original researcher took. DiscussionSite Posters was launched in January of 2002 and has seen a slow but steady rate of adoption. In an interview with the authors of this paper (L. Bauerle, personal communication, January 10, 2006), the company said the product was created in response to customer interest in support for sharing and collaboration. So far users have been utilizing the communication capabilities in DiscussionSite Posters in an unexpected way. Instead of engaging in deeply nested threaded conversations in the conversation panel, as envisioned by the designers of the system, users have largely been building presentations of findings to share with others. The ability to create pointers into the visualization that are accompanied by commentary provides an easy way to choreograph a step-by-step presentation. Having such paths coupled with the fullfledged visualization makes it easy for viewers to take advantage of the directed view of the data but, when desired, break off to freely explore the visualization. The three systems discussed above illustrate fairly different communication scenarios around visualization applications. Whereas DecisionSite Posters is designed for asynchronous, remote communication of visualization findings, PhotoMesa is intended for live, collocated sharing of visual materials. CoMotion, on the other hand, is an application for synchronous communication of users who are not collocated. Though far from exhaustive, these examples begin to illustrate a variety of CMV scenarios The next section attempts to situate this diversity of communication settings under a unifying theoretical framework. III) THEORY CMV poses fundamentally new problems for visualization designers. An application that supports communication and collaboration has all the legibility, perceptual, and layout challenges of regular visualizations, supplemented by a host of new difficulties arising from their direct involvement in group communication practices. Of course these communication challenges are not limited to visualization programs alone. Group communication difficulties have been investigated at length in established research areas such as Computer Supported Cooperative 4

5 Work (CSCW). This section discusses a set of principles that are relevant to the topic of visualization as communication artifact. Time and Place One simple application of existing theory from CSCW is in finding the structure of the CMV design space. A good structure should ideally produce an organized view of existing systems while highlighting areas which have been underexplored. We believe Johansen s well-known time/space matrix (Johansen, 1988; see also Brodlie et al., 2004) does both [Figure 3]. The matrix posits two independent dimensions on which systems may differ, related to space and time. In some cases people use the system synchronously (same time) and in other cases they communicate asynchronously (interacting at different times). Orthogonal to time is space: usage can take place at a single location (same place) or at several different places. The second time/space matrix in Figure 4 lists research projects and commercial products that populate the four different quadrants produced by the two dimension [Figure 4]. The matrix is a helpful way to organize a diverse set of systems. Perhaps more important, Figure 4 makes clear that there is a neglected area. Synchronous collaborative scenarios have been much more widely explored than asynchronous communication around visualizations. Except for DecisionSite Posters, there has been virtually no work done in this area; neither in research nor in industry. We believe that asynchronous communication of visualization-driven insights is a key aspect of CMV and an important research topic. As global usage of attests, lightweight, asynchronous communication is a ubiquitous and, therefore, powerful flavor of computer mediated communication. By disregarding asynchronous communication of visualization discoveries and processes, the research community is missing an opportunity to make important contributions to visualization research. Obstacles to Adoption There is extensive literature in the field of CSCW addressing the adoption of new groupware applications in organizations and the obstacles usually faced by this kind of software. Such work raises practical concerns for technology in real-world scenarios, ranging from social processes of communication to the political agendas that different actors might have in a group. An excellent survey of these concerns is laid out in (Grudin, 1994). We draw on Grudin s contribution to draft guidelines for CMV: 1 1) Balance of work and benefit: communication-minded visualization should strive not to significantly increase the level of additional work for individuals who do not perceive a direct benefit from the use of the application. Example: There are likely to be different kinds of users that interact with a CMV program. For instance, some users may take full advantage of the visual analysis and communication capabilities of the application whereas others may use the program simply for information viewing (which is a task that could easily be accomplished using some other program with which the user is already familiars). It is important that there is 1 Whereas Grudin listed eight challenges for developers of groupware, we have chosen four of these items to establish guidelines for CMV. The other four challenges were either integrated in the guidelines we created or did not seem relevant to our discussion here. These challenges are: - exception handling - difficulty of evaluation (covered in the section entitled proposals for evaluation ) - failure of intuition - the adoption process (included in the critical mass guideline) 5

6 no additional work for the viewer type user to utilize the CMV application. The Spotfire DecisionSite Posters provide a good example of this principle, since a particular visualization may be shared with a viewer who can see it without installing any special software. 2) Critical mass: the advantage of using communication-minded visualization has to be clear to individuals in order to enlist critical mass adoption. Note that since Grudin s survey the World Wide Web has exploded in popularity, providing an important avenue for amplifying usage once critical mass has been reached. Example: The NameVoyager provided a clear benefit to expectant parents. It has been suggested (Wattenberg, 2005) that other types of users saw benefits as well: a chance to socialize, explore, or just cause trouble. Once an initial core of people the critical mass began discussing the web site on their blogs, usage soared. The experience with the NameVoyager suggests that it is worth taking different roles into account, and that the Web can be a powerful force for pushing adoption by a sufficiently large group of people. Note that in The Social Life of Information, John Seely Brown and Paul Duguid argue that much of the value of real-world processes and tools is derived from the social context that surrounds them (Brown & Duguid, 2000). As the examples of the NameVoyager and Social Network Fragments suggest, data visualization has the potential to generate contextual social activity. True to the hypothesis of (Wattenberg, 2005), the discussions surrounding the NameVoyager contain a huge amount of detailed statistical analysis that greatly enhances the value of the data contained in the visualization itself. 3) Support of social processes: CMV should attempt to complement established social processes as much as possible so as not to disrupt existing practices and demotivate users crucial to its success. A classic cautionary tale is of a company that installed a new voice mail system. When the CEO called his assistant only to receive a canned message with confusing instructions, he decided on the spot to uninstall the entire system, arguing that This is not the way to treat people (Sproull & Kiesler, 91; p. 1). Example: For instance, if is the main way through which a group of people communicates, it makes sense for the visualization application to be integrated with at some level the entire application need not work within , but should be part of how users communicate about the visualization without having to switch contexts. Few visualization applications work well in the context of , for example, despite the vast amount of collaboration that occurs in that medium. Users of visualization tools are often reduced to sending screenshots or even elaborate textual directions for what to look at. An elegant exception is current web-based mapping programs, such as Google Maps ( or MapQuest ( A combination of location and zoom level can be bookmarked through an ordinary URL, which is easily sent via or instant messaging. 4) Unobtrusive accessibility: Features that support group processes may be used relatively infrequently, so CMV should be seamlessly integrated with heavily used features. Example: The emergence of CMV does not meant that users will stop conducting visual analysis on their own and start exploring visualizations in groups all the time. Instead, CMV should be seen as an additional option for doing data analysis. As such, it is crucial that these applications be well integrated to the environments where users already carry out most of their data exploration individually, namely, single-user applications. 6

7 At a technological level, the rigidity of many data visualization applications makes the transition to shared use highly obtrusive. Visualization environments are often carefully tuned for a specific, highly structured type of data. A treemap program, such as the University of Maryland s Treemap 4.0 ( is beautifully optimized for a certain type of hierarchical data, but does not allow users to place annotations on the display. It is impossible, for example, to draw an arrow between two rectangles and add a label saying, compare these two items. This problem is not specific to visualizations, but is found in many data-centric applications. (Consider the rigidity of a relational database.) An important exception can be found in spreadsheet programs such as Microsoft Excel ( Spreadsheets can easily handle notes as well as raw data since the user may simply write text into any cell. It is common to see users adding notes in the cells surrounding raw data, perhaps explaining their methodology in computing certain cells or pointing out the existence of strange data points. A similar technique is to use color to guide the reader s attention to important sections (Nardi, 1993). This type of marginal note-taking encourages the informal exchange of information that Brown & Duguid assert is critical for a well-functioning organization. Achieving the communicative flexibility of a spreadsheet may therefore be a helpful goal for designing CMV tools. Social Visualization A third potential source of theoretical insight is the field of social visualization. This line of investigation concerns the visualization of social information for social purposes (Donath et al., 1999), and is exemplified by such systems as Visual Who (Donath, 1995), Chat Circles (Viégas & Donath 1999) and Babble (Erickson et al., 1999). While communication is central to both social visualization and CMV, the two require different approaches. CMV is largely concerned with shared understanding and reasoning about a given data set, rather than issues of identity, reputation, and emotionally nuanced expression. Moreover, CMV applies to the analysis of any type of data, rather than specifically social information. Nonetheless, because CMV will typically involve social activity on the part of users, some of the theory of social visualization is worth bringing to bear on the problem. In particular, as we discuss in the next section, the concept of social translucence (Erickson et al., 1999) is particularly relevant. IV) DESIGN PROPOSALS AND RESEARCH DIRECTIONS Sharing and communicating around visualizations raises interesting design considerations, and suggests new areas for investigation. As previously described in this paper, users typically share visualizations by distributing images via screen shots, printouts, etc. We call this kind of sharing shallow because it is limited to the duplication of pixels instead of data. Deep sharing, on the other hand, refers to sharing data as well as pixels. To date, deep sharing has taken place mostly in synchronous applications consider, for instance, Collaborative Visualization projects where every user has access to a fully interactive copy of the visualization whereas asynchronous scenarios have been relegated to shallow sharing. We believe that intelligently sharing visualizations asynchronously that is, with annotations and tailored playback capabilities poses an important challenge for developers. 7

8 Taking the time/place matrix as a framework for organizing the design proposals in this section, we offer suggestions for deep sharing whenever appropriate. 1) Same time / same place Visible inputs, animated transitions It is extremely common for a small group of people to analyze data together, hunched over a single computer screen. This can be awkward; watching someone else operate a computer can be irritating, much like watching someone else to use a remote control for a TV. One reason is that changes in view appear abruptly and unexpectedly, and it can be hard for a viewer to follow what the active user is doing. The classification of spectator interfaces by Reeves et al (Reeves et al., 2005) is helpful here: they suggest that for the most understandable spectator interface, both the actions taken by the active user and the effects they generate should be easily visible. As described in (Wattenberg, 2005), a natural hypothesis is that visualizations should have as expressive an interface as possible. For example, animated transitions might be nice to have for a single user, but may be critical for a viewer to maintain a sense of orientation. This was the hypothesis used in the design of PhotoMesa (Bederson, 2001). Similarly, changes to the widgets that control a visualization should be clearly visible, and keyboard shortcuts may need to be accompanied by visible redundant cues. Note that there may be limits to the desirability of expressiveness, especially as it relates to data rather than user actions. (Erickson et al, 1999) argues for social translucence, suggesting that total transparency is undesirable in some situations. In the case of visualization, there are several scenarios where it could be better to show less information rather than more. For instance, a user may wish to share a visualization of an inbox, but with the proviso that all names are anonymized. With a deep sharing approach, it may be possible to implement privacy filters that protect sensitive data. 2) Same time / different place Building common ground: pointing If two users are working synchronously but remotely, they also need an expressive interface. They face another critical issue as well: how to point. When two people are working at the same computer, it is common to see them pointing to different parts of the screen. Pointing is a problem for other kinds of synchronous remote work, but it can be especially acute for the unstructured displays of a visualization tool. With a spreadsheet it is easy to say, Look at cell E3, but with a typical graph layout tool it may be very difficult to verbally specify a particular node. One solution is to allow one person to move a cursor on the other s screen, or to allow drawing of annotations. A more sophisticated idea in line with deep sharing is to enable complex types of pointing that are data aware. For example, in working with a treemap it would be natural to want to point out a particular tree node and its set of descendants. One could imagine an interface where a user right-clicks on a node to get a menu of possible highlighting options: put focus on the node, its children, all descendants, etc. 3) Different time / different place More common ground to cover Asynchronous, remote communication suffers from an even greater lack of common ground than the first two scenarios in this section. Therefore, all considerations for building common ground discussed so far apply here as well. Expressive inputs, animated transitions, and pointing mechanisms should all be taken into consideration when designing CMV tools for asynchronous, remote collaborations. 8

9 Playback First, if a playback feature is available, we suggest it may be desirable to allow users to edit a session, picking out only a few key frames and discarding any false starts or superfluous navigation. This implies a capability to edit sequences of usage in a visualization. On a technical level, playing back a visualization implies the ability to completely reconstruct the state of the application from some sort of token sent from one user to another. Such a token could be a pointer to a central server where information is stored, or in simple cases could itself contain all the necessary information. An important issue here, related to the challenges defined by (Grudin, 1994), is that the communication capabilities are most likely to be used when they work well with existing systems. For example, if users are passing a token to represent state, it is helpful if this is a simple text string (much like a URL) that can be transferred via or instant messaging. In (Wattenberg, 2005) a simple example of such a scheme is discussed. Annotation Another important method of asynchronous communication is annotation. In many situations it may be helpful for users to be able to point to objects and add some sort of information. The added information may be anything from a single word to a long discussion. In non-visualization settings, simple annotations have proved powerful: consider the example of del.icio.us ( essentially an annotation service for the web. Annotations raise difficult questions. A particularly thorny one is how to handle data that changes. What should happen to an annotation, for example, when an annotated data point is deleted? As with many systems that involve group creation of meaning (software development, or the writing of Wikipedia) it may be helpful to have a versioning system. Another related design question for visualizations is whether the annotations themselves can become part of the visualization. 4) Different time / same place Getting physical The prototypical example of different-time / same-place communication is the discourse that occurs on a public display screen. All of the issues described above will likely be relevant, but there is an additional interesting design question. If the space is the same, then it makes sense to design the physical surroundings to augment the visualization. At a very simple level, it may make sense to place a printer, pens and tape at the public display, so that users can print out key frames, draw annotations, and stick them to the walls. An open question is whether there are deep sharing techniques that exploit physical space. V) PROPOSALS FOR EVALUATION It is of course important to validate the importance of the communication that surrounds visualizations. The case for CMV is promising but by no means proven. A frequent situation, as in the zooming transitions of (Bederson, 2001), is that a feature is posited to help groups yet never tested with a group. It would also be valuable to study existing deployments of visualizations such as DecisionSite Posters and CoMotion to discover exactly how often their special collaborative features are used. There has been arguably too little academic evaluation of real-world deployments of commercial systems, perhaps due to a "not invented here" syndrome on the part of researchers. Another lesson from the field of CSCW field may be that important insights can come from studying commercial products such as Microsoft Excel (Nardi, 1993). 9

10 The premise that the communicative aspect of data visualization is an important part of its value leads to broader questions about evaluation as well. One of the perennial problems in visualization research is the difficulty of evaluating designs. The most common paradigm for evaluation is a controlled lab study where a small number of volunteers perform carefully specified tasks. While such studies produce replicable, statistically significant numbers, there is a widespread feeling that they do not reliably test the true value of visualizations (see the recent NIH/NSF study: Johnson et al., 2006) named evaluation as one of ten grand challenges facing the field.) The CMV perspective suggests some possible approaches to this challenge. First, if the success or failure of a visualization system depends on how it lets groups collaborate and communicate, then it may make sense to perform tests on groups rather than individuals. This suggests a number of variations on current practice. Most obviously, one might simply test the performance of groups of two or more people using a visualization at once. A subtler change might be to test not only direct performance, but measures of how well a viewer follows along with a user. One might have one active user perform a series of actions on a visualization, and then test whether a viewer is able to repeat those actions. More subjective measures may be revealing as well. If a visualization has a magical or secretive interface in the classification of (Reeves et al., 2005), it may be possible that a viewer would feel that the active user is uncooperative or is hiding information. These ideas are speculative, but that is exactly the point: the CMV perspective points to a whole set of untried ideas for evaluation. It is also interesting to note that the field of CSCW has faced a similar problem: (Grudin, 1994) points to several obstacles to assessing the value of systems for collaborative work. The main culprit is the fact that the success of such a system is dependent on complex social and environmental factors. As a result, it is extremely difficult to perform a lab study that will predict performance in the wild. It is also, according to Grudin, hard to generalize from one deployment to another since so many factors may be different. Again, if a significant part of the value of visualization is its ability to catalyze discussion, then the parallel with CSCW research may not be a coincidence. It may be useful to look to CSCW for ideas on how to work around the difficulties in evaluation. Given the experience of CSCW researchers, we believe studies of visualization should include more studies of real-life deployments, with careful ethnographies to understand the surrounding environmental influences on success or failure. VI) CONCLUSION Although improvements in computing technology have caused information visualization to progress significantly with faster computers allowing for smoother graphic rendering and bigger hard drives permitting vast datasets to be stored little has been done to support the communication practices that stem from interacting with visualizations. Here we propose a new perspective to remedy this oversight: communication-minded visualization (CMV). This perspective recognizes the critical role played by asynchronous and synchronous conversations and social activity surrounding graphical data analysis. Our survey of existing techniques shows that there is a wide variety of ways that designers can encourage communication around visualizations and that there is a need for a unifying framework to understand and help focus these techniques. In several cases, such as the NameVoyager, affordances that led to social activity were inadvertent. In other cases, advanced ideas for CMV exist in commercial products and are neither widely known nor well-studied. One 10

11 of the goals of this paper is to point out the common themes that run through these disparate systems. One source of ideas for studying CMV comes from the area of computer-supported cooperative work. We have highlighted three theoretical constructs that we believe are especially relevant. Jonathan Grudin s work on problems in uptake of collaborative systems has natural applications to the uptake of communicative visualizations. The standard partitioning of the design space into synchronous/asynchronous and same-place/different-place proves to be helpful here as well. Finally, the ideas of Brown & Duguid on the benefits of informal social context surrounding work practices help provide justification for the value of visualizations that serve as catalysts for conversation. With these theoretical constructs in hand, we have suggested several research directions. First, in designing visualizations, we advocate a deep sharing approach, in which multiple users all have access to the full system. At the simplest level, this may mean designing expressive interfaces so that two people at the same computer can easily follow each other s actions. At a more complex level, it can mean designing systems that are bookmarkable, where the full state of the system may be specified by a URL-like token, allowing annotations and asynchronous conversations. Finally, we have offered suggests for new ways to assess visualizations. Evaluation has traditionally been difficult in this area in fact finding new ways to evaluate visualizations is listed by the NSF as a grand challenge. We believe that one reason traditional evaluation methods have been insufficient is that they do not take into account group usage, and therefore miss a significant portion of the value (and problems) present in a visualization system. ACKNOWLEDGMENTS Many people made critical suggestions in the development of the ideas in this paper. Jesse Kriss and Steve Rohall made many contributions, and conversations with John Patterson were influential as well. We also thank the many other members of CUE who have helped us polish our thoughts and who have suggested related work. BIBLIOGRAPHY 1. Anupam, V., Bajaj, C., Schikore, D., & Schikore, M. (1994). Distributed and collaborative visualization. Computer, vol. 27, no. 7, pp Bederson, B. B. (2001). PhotoMesa: A Zoomable Image Browser Using Quantum Treemaps and Bubblemaps. UIST Benko, H., Ishak, E.W., & Feiner, S. (2004). Collaborative mixed reality visualization of an archaeological excavation. The International Symposium on Mixed and Augmented Reality, ISMAR. 4. Brodlie, K. W., Duce, D. A., Gallop, J. R., Walton, J.P.R.B. & Wood, J. D. (2004). Distributed and Collaborative Visualization. Computer Graphics Forum, Volume 23, Number 2, pp

12 5. Brown, J. S., & Duguid, P. (2000). The Social Life of Information. Harvard Business School Press. 6. Chui, Y., & Heng, P. (2001). Enhancing View Consistency in Collaborative Medical Visualization Systems Using Predictive-Based Attitude Estimation. International Workshop on Medical Imaging and Augmented Reality, MIAR. 7. Donath, J. (1995). Visual Who. Proceedings of ACM Multimedia. 8. Donath, J., Karahalios, K., & Viégas, F. (1999) Visualizing conversations. Proceedings of HICSS Dourish, P., & Bly, S. (1992). Portholes: Supporting awareness in a distributed work group. Proceedings of CHI. 10. Erickson, E., Smith, D., Kellogg, K., Laff, M., Richards, J., & Bradner E. (1999). Socially Translucent Systems: Social Proxies, Persistent Conversation, and the Design of ``Babble''. Proceedings of CHI. 11. Greif, I. (1988). Computer-supported cooperative work: A book of readings. Morgan Kaufmann. 12. Grudin, J. (1988). Why CSCW applications fail: Problems in the design and evaluation of organizational interfaces. Proceedings of CSCW 88, Grudin, J. (1994). Eight challenges for developers. Communications of the ACM, 37, 1, Johansen, R. (1988). Groupware: Computer Support for Business Teams. The Free Press. 15. Johnson, E., Moorhead, R., Munzner, T., Pfister, H., Rheingans, P., & Yoo, T., S. (eds) (2006). NIH-NSF visualization research challenges report. U.S. National Institutes of Health, Bethesda, MD. 16. Nardi, B. (1993). A Small Matter of Programming: Perspectives on End User Computing. Cambridge. Cambridge: MIT Press. 17. Reeves, S., Benford, S., O'Malley, C., & Fraser, M. (2005). Designing the spectator experience. Proceedings of CHI. 18. Roth, S. (2004). Visualization as a Medium for Capturing and Sharing Thoughts. Capstone Address, in Proceedings of InfoVis. Retrieved on January 12th from Sproull, L., & Kiesler, S. (1991). Connections: New ways of working in the networked organization. MIT Press. 20. Viégas, F., & Donath, J. (1999). Chat Circle. Proceedings of CHI. 12

13 21. Viégas, F., boyd, d., Nguyen, D. H., Potter, J., & Donath, J. (2004). Digital Artifacts for Remembering and Storytelling: PostHistory and Social Network Fragments. Proceedings of HICSS. 22. Viégas, F., Golder, S., & Donath, J. (2006). Visualizing content: Portraying relationships from conversational histories. To appear in the proceedings of CHI. 23. Ware, C. (2000). Information Visualization: Perception for Design. Morgan Kaufman Publishers. 24. Wattenberg, M. (1999). Visualizing the Stock Market. Proceedings of CHI. 25. Wattenberg, M. (2005). Baby names, visualization, and social data analysis. Proceedings of InfoVis. 26. Wood, J., Wright, H., & Brodlie, K. (1997). Collaborative visualization. Proceedings of IEEE Visualization. 13

14 BIOGRAPHIES: Fernanda B. Viégas Research Staff Member Fernanda s research interests include visualizing social dynamics in open-source communities, exploring collaborative uses of visualization applications, and investigating online privacy as it applies to visualization. Before joining IBM, Fernanda was a graduate student at the MIT Media Lab where her research focused on visualizing the traces people leave as they interact online. Some of her projects explored archives, newsgroup conversations, chatroom interactions, and the editing history of wiki pages. She is also the creator of the award-winning Chat Circles program, an abstract graphical interface for communicating online. Fernanda holds an M.S. and Ph.D. degrees from MIT, and a BFA from the University of Kansas, where she studied Graphic Design and Art History. Martin Wattenberg Group Manager, Researcher Martin s research interests include information visualization and its application to collaborative computing. Before joining IBM, Martin was the Director of Research and Development at SmartMoney.com, where he designed internet-based financial software. His work at SmartMoney included the groundbreaking Map of the Market, which visualizes live data on hundreds of publicly traded companies. Martin has also worked with nonfinancial data ranging from archives to baby names. In addition he is well known for artistic data visualization, visualizing such disparate information sources as music, museum collections, and web searches. His artwork has been exhibited internationally, including at the Whitney Museum of American Art, the New Museum, and Ars Electronica. Martin holds a PhD in Mathematics from the University of California at Berkeley 14

15 Figures and tables: Figure 1: Above, screen shot of the Command Post of the Future tool, created by Maya Viz for the US military forces. On the left, a view of the tool being tested by multiple users in an non-military setting. Figure 2: On the right, a screen shot of SpotFire s DiscussionSite Posters tool. The tool allows users to share data analysis and comments about a given visualization asynchronously. On the left, a closeup view of the communication panel where users leave comments that can be anchored to specific states of the visualization by bookmarks. 15

16 Figure 3: Time/space matrix showing the range of CMV scenarios developers are likely to encounter. Figure 4: Johansen s matrix showing the distribution of projects amongst the four main time/space arrangements in CMV. Synchronous communication around visualization programs is the area most heavily populated. Asynchronous, remote CMV, on the other hand, is a practically empty area, without any academic research having been done in the topic. 16

Notes on The Sciences of the Artificial Adapted from a shorter document written for course (Deciding What to Design) 1

Notes on The Sciences of the Artificial Adapted from a shorter document written for course (Deciding What to Design) 1 Notes on The Sciences of the Artificial Adapted from a shorter document written for course 17-652 (Deciding What to Design) 1 Ali Almossawi December 29, 2005 1 Introduction The Sciences of the Artificial

More information

Using Blackboard.com Software to Reach Beyond the Classroom: Intermediate

Using Blackboard.com Software to Reach Beyond the Classroom: Intermediate Using Blackboard.com Software to Reach Beyond the Classroom: Intermediate NESA Conference 2007 Presenter: Barbara Dent Educational Technology Training Specialist Thomas Jefferson High School for Science

More information

Full text of O L O W Science As Inquiry conference. Science as Inquiry

Full text of O L O W Science As Inquiry conference. Science as Inquiry Page 1 of 5 Full text of O L O W Science As Inquiry conference Reception Meeting Room Resources Oceanside Unifying Concepts and Processes Science As Inquiry Physical Science Life Science Earth & Space

More information

Justin Raisner December 2010 EdTech 503

Justin Raisner December 2010 EdTech 503 Justin Raisner December 2010 EdTech 503 INSTRUCTIONAL DESIGN PROJECT: ADOBE INDESIGN LAYOUT SKILLS For teaching basic indesign skills to student journalists who will edit the school newspaper. TABLE OF

More information

Three Strategies for Open Source Deployment: Substitution, Innovation, and Knowledge Reuse

Three Strategies for Open Source Deployment: Substitution, Innovation, and Knowledge Reuse Three Strategies for Open Source Deployment: Substitution, Innovation, and Knowledge Reuse Jonathan P. Allen 1 1 University of San Francisco, 2130 Fulton St., CA 94117, USA, jpallen@usfca.edu Abstract.

More information

A Coding System for Dynamic Topic Analysis: A Computer-Mediated Discourse Analysis Technique

A Coding System for Dynamic Topic Analysis: A Computer-Mediated Discourse Analysis Technique A Coding System for Dynamic Topic Analysis: A Computer-Mediated Discourse Analysis Technique Hiromi Ishizaki 1, Susan C. Herring 2, Yasuhiro Takishima 1 1 KDDI R&D Laboratories, Inc. 2 Indiana University

More information

Introduction to Moodle

Introduction to Moodle Center for Excellence in Teaching and Learning Mr. Philip Daoud Introduction to Moodle Beginner s guide Center for Excellence in Teaching and Learning / Teaching Resource This manual is part of a serious

More information

Blackboard Communication Tools

Blackboard Communication Tools Blackboard Communication Tools Donna M. Dickinson E-Learning Center Borough of Manhattan Community College Workshop Overview Email from Communication Area and directly from the Grade Center Using Blackboard

More information

Requirements-Gathering Collaborative Networks in Distributed Software Projects

Requirements-Gathering Collaborative Networks in Distributed Software Projects Requirements-Gathering Collaborative Networks in Distributed Software Projects Paula Laurent and Jane Cleland-Huang Systems and Requirements Engineering Center DePaul University {plaurent, jhuang}@cs.depaul.edu

More information

Simulated Architecture and Programming Model for Social Proxy in Second Life

Simulated Architecture and Programming Model for Social Proxy in Second Life Simulated Architecture and Programming Model for Social Proxy in Second Life Cintia Caetano, Micheli Knechtel, Roger Resmini, Ana Cristina Garcia, Anselmo Montenegro Department of Computing, Fluminense

More information

EdX Learner s Guide. Release

EdX Learner s Guide. Release EdX Learner s Guide Release Nov 18, 2017 Contents 1 Welcome! 1 1.1 Learning in a MOOC........................................... 1 1.2 If You Have Questions As You Take a Course..............................

More information

Using Moodle in ESOL Writing Classes

Using Moodle in ESOL Writing Classes The Electronic Journal for English as a Second Language September 2010 Volume 13, Number 2 Title Moodle version 1.9.7 Using Moodle in ESOL Writing Classes Publisher Author Contact Information Type of product

More information

WiggleWorks Software Manual PDF0049 (PDF) Houghton Mifflin Harcourt Publishing Company

WiggleWorks Software Manual PDF0049 (PDF) Houghton Mifflin Harcourt Publishing Company WiggleWorks Software Manual PDF0049 (PDF) Houghton Mifflin Harcourt Publishing Company Table of Contents Welcome to WiggleWorks... 3 Program Materials... 3 WiggleWorks Teacher Software... 4 Logging In...

More information

STUDENT MOODLE ORIENTATION

STUDENT MOODLE ORIENTATION BAKER UNIVERSITY SCHOOL OF PROFESSIONAL AND GRADUATE STUDIES STUDENT MOODLE ORIENTATION TABLE OF CONTENTS Introduction to Moodle... 2 Online Aptitude Assessment... 2 Moodle Icons... 6 Logging In... 8 Page

More information

Outreach Connect User Manual

Outreach Connect User Manual Outreach Connect A Product of CAA Software, Inc. Outreach Connect User Manual Church Growth Strategies Through Sunday School, Care Groups, & Outreach Involving Members, Guests, & Prospects PREPARED FOR:

More information

Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses

Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses Designing a Rubric to Assess the Modelling Phase of Student Design Projects in Upper Year Engineering Courses Thomas F.C. Woodhall Masters Candidate in Civil Engineering Queen s University at Kingston,

More information

DIGITAL GAMING & INTERACTIVE MEDIA BACHELOR S DEGREE. Junior Year. Summer (Bridge Quarter) Fall Winter Spring GAME Credits.

DIGITAL GAMING & INTERACTIVE MEDIA BACHELOR S DEGREE. Junior Year. Summer (Bridge Quarter) Fall Winter Spring GAME Credits. DIGITAL GAMING & INTERACTIVE MEDIA BACHELOR S DEGREE Sample 2-Year Academic Plan DRAFT Junior Year Summer (Bridge Quarter) Fall Winter Spring MMDP/GAME 124 GAME 310 GAME 318 GAME 330 Introduction to Maya

More information

The Creation and Significance of Study Resources intheformofvideos

The Creation and Significance of Study Resources intheformofvideos The Creation and Significance of Study Resources intheformofvideos Jonathan Lewin Professor of Mathematics, Kennesaw State University, USA lewins@mindspring.com 2007 The purpose of this article is to describe

More information

Running Head: STUDENT CENTRIC INTEGRATED TECHNOLOGY

Running Head: STUDENT CENTRIC INTEGRATED TECHNOLOGY SCIT Model 1 Running Head: STUDENT CENTRIC INTEGRATED TECHNOLOGY Instructional Design Based on Student Centric Integrated Technology Model Robert Newbury, MS December, 2008 SCIT Model 2 Abstract The ADDIE

More information

Android App Development for Beginners

Android App Development for Beginners Description Android App Development for Beginners DEVELOP ANDROID APPLICATIONS Learning basics skills and all you need to know to make successful Android Apps. This course is designed for students who

More information

Science Olympiad Competition Model This! Event Guidelines

Science Olympiad Competition Model This! Event Guidelines Science Olympiad Competition Model This! Event Guidelines These guidelines should assist event supervisors in preparing for and setting up the Model This! competition for Divisions B and C. Questions should

More information

Unpacking a Standard: Making Dinner with Student Differences in Mind

Unpacking a Standard: Making Dinner with Student Differences in Mind Unpacking a Standard: Making Dinner with Student Differences in Mind Analyze how particular elements of a story or drama interact (e.g., how setting shapes the characters or plot). Grade 7 Reading Standards

More information

Using SAM Central With iread

Using SAM Central With iread Using SAM Central With iread January 1, 2016 For use with iread version 1.2 or later, SAM Central, and Student Achievement Manager version 2.4 or later PDF0868 (PDF) Houghton Mifflin Harcourt Publishing

More information

Online Marking of Essay-type Assignments

Online Marking of Essay-type Assignments Online Marking of Essay-type Assignments Eva Heinrich, Yuanzhi Wang Institute of Information Sciences and Technology Massey University Palmerston North, New Zealand E.Heinrich@massey.ac.nz, yuanzhi_wang@yahoo.com

More information

MULTIMEDIA Motion Graphics for Multimedia

MULTIMEDIA Motion Graphics for Multimedia MULTIMEDIA 210 - Motion Graphics for Multimedia INTRODUCTION Welcome to Digital Editing! The main purpose of this course is to introduce you to the basic principles of motion graphics editing for multimedia

More information

On Human Computer Interaction, HCI. Dr. Saif al Zahir Electrical and Computer Engineering Department UBC

On Human Computer Interaction, HCI. Dr. Saif al Zahir Electrical and Computer Engineering Department UBC On Human Computer Interaction, HCI Dr. Saif al Zahir Electrical and Computer Engineering Department UBC Human Computer Interaction HCI HCI is the study of people, computer technology, and the ways these

More information

Evaluation of Learning Management System software. Part II of LMS Evaluation

Evaluation of Learning Management System software. Part II of LMS Evaluation Version DRAFT 1.0 Evaluation of Learning Management System software Author: Richard Wyles Date: 1 August 2003 Part II of LMS Evaluation Open Source e-learning Environment and Community Platform Project

More information

EDIT 576 DL1 (2 credits) Mobile Learning and Applications Fall Semester 2014 August 25 October 12, 2014 Fully Online Course

EDIT 576 DL1 (2 credits) Mobile Learning and Applications Fall Semester 2014 August 25 October 12, 2014 Fully Online Course GEORGE MASON UNIVERSITY COLLEGE OF EDUCATION AND HUMAN DEVELOPMENT GRADUATE SCHOOL OF EDUCATION INSTRUCTIONAL DESIGN AND TECHNOLOGY PROGRAM EDIT 576 DL1 (2 credits) Mobile Learning and Applications Fall

More information

Virtual Seminar Courses: Issues from here to there

Virtual Seminar Courses: Issues from here to there 1 of 5 Virtual Seminar Courses: Issues from here to there by Sherry Markel, Ph.D. Northern Arizona University Abstract: This article is a brief examination of some of the benefits and concerns of virtual

More information

An Introduction to Simio for Beginners

An Introduction to Simio for Beginners An Introduction to Simio for Beginners C. Dennis Pegden, Ph.D. This white paper is intended to introduce Simio to a user new to simulation. It is intended for the manufacturing engineer, hospital quality

More information

An Industrial Technologist s Core Knowledge: Web-based Strategy for Defining Our Discipline

An Industrial Technologist s Core Knowledge: Web-based Strategy for Defining Our Discipline Volume 17, Number 2 - February 2001 to April 2001 An Industrial Technologist s Core Knowledge: Web-based Strategy for Defining Our Discipline By Dr. John Sinn & Mr. Darren Olson KEYWORD SEARCH Curriculum

More information

Entrepreneurial Discovery and the Demmert/Klein Experiment: Additional Evidence from Germany

Entrepreneurial Discovery and the Demmert/Klein Experiment: Additional Evidence from Germany Entrepreneurial Discovery and the Demmert/Klein Experiment: Additional Evidence from Germany Jana Kitzmann and Dirk Schiereck, Endowed Chair for Banking and Finance, EUROPEAN BUSINESS SCHOOL, International

More information

Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining

Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Dave Donnellan, School of Computer Applications Dublin City University Dublin 9 Ireland daviddonnellan@eircom.net Claus Pahl

More information

Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining

Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Evaluation of Usage Patterns for Web-based Educational Systems using Web Mining Dave Donnellan, School of Computer Applications Dublin City University Dublin 9 Ireland daviddonnellan@eircom.net Claus Pahl

More information

Using Virtual Manipulatives to Support Teaching and Learning Mathematics

Using Virtual Manipulatives to Support Teaching and Learning Mathematics Using Virtual Manipulatives to Support Teaching and Learning Mathematics Joel Duffin Abstract The National Library of Virtual Manipulatives (NLVM) is a free website containing over 110 interactive online

More information

Storytelling Made Simple

Storytelling Made Simple Storytelling Made Simple Storybird is a Web tool that allows adults and children to create stories online (independently or collaboratively) then share them with the world or select individuals. Teacher

More information

THE WEB 2.0 AS A PLATFORM FOR THE ACQUISITION OF SKILLS, IMPROVE ACADEMIC PERFORMANCE AND DESIGNER CAREER PROMOTION IN THE UNIVERSITY

THE WEB 2.0 AS A PLATFORM FOR THE ACQUISITION OF SKILLS, IMPROVE ACADEMIC PERFORMANCE AND DESIGNER CAREER PROMOTION IN THE UNIVERSITY THE WEB 2.0 AS A PLATFORM FOR THE ACQUISITION OF SKILLS, IMPROVE ACADEMIC PERFORMANCE AND DESIGNER CAREER PROMOTION IN THE UNIVERSITY F. Felip Miralles, S. Martín Martín, Mª L. García Martínez, J.L. Navarro

More information

Artifact awareness through screen sharing for distributed groups

Artifact awareness through screen sharing for distributed groups Artifact awareness through screen sharing for distributed groups Kimberly Tee a, Saul Greenberg a, Carl Gutwin b a University of Calgary 2500 University Dr NW Calgary, AB Canada T2N 1N4 {tee, saul}@cs.ucalgary.ca

More information

Classroom Assessment Techniques (CATs; Angelo & Cross, 1993)

Classroom Assessment Techniques (CATs; Angelo & Cross, 1993) Classroom Assessment Techniques (CATs; Angelo & Cross, 1993) From: http://warrington.ufl.edu/itsp/docs/instructor/assessmenttechniques.pdf Assessing Prior Knowledge, Recall, and Understanding 1. Background

More information

USER ADAPTATION IN E-LEARNING ENVIRONMENTS

USER ADAPTATION IN E-LEARNING ENVIRONMENTS USER ADAPTATION IN E-LEARNING ENVIRONMENTS Paraskevi Tzouveli Image, Video and Multimedia Systems Laboratory School of Electrical and Computer Engineering National Technical University of Athens tpar@image.

More information

EDIT 576 (2 credits) Mobile Learning and Applications Fall Semester 2015 August 31 October 18, 2015 Fully Online Course

EDIT 576 (2 credits) Mobile Learning and Applications Fall Semester 2015 August 31 October 18, 2015 Fully Online Course GEORGE MASON UNIVERSITY COLLEGE OF EDUCATION AND HUMAN DEVELOPMENT INSTRUCTIONAL DESIGN AND TECHNOLOGY PROGRAM EDIT 576 (2 credits) Mobile Learning and Applications Fall Semester 2015 August 31 October

More information

BPS Information and Digital Literacy Goals

BPS Information and Digital Literacy Goals BPS Literacy BPS Literacy Inspiration BPS Literacy goals should lead to Active, Infused, Collaborative, Authentic, Goal Directed, Transformative Learning Experiences Critical Thinking Problem Solving Students

More information

Metadiscourse in Knowledge Building: A question about written or verbal metadiscourse

Metadiscourse in Knowledge Building: A question about written or verbal metadiscourse Metadiscourse in Knowledge Building: A question about written or verbal metadiscourse Rolf K. Baltzersen Paper submitted to the Knowledge Building Summer Institute 2013 in Puebla, Mexico Author: Rolf K.

More information

Activities, Exercises, Assignments Copyright 2009 Cem Kaner 1

Activities, Exercises, Assignments Copyright 2009 Cem Kaner 1 Patterns of activities, iti exercises and assignments Workshop on Teaching Software Testing January 31, 2009 Cem Kaner, J.D., Ph.D. kaner@kaner.com Professor of Software Engineering Florida Institute of

More information

Book Review: Build Lean: Transforming construction using Lean Thinking by Adrian Terry & Stuart Smith

Book Review: Build Lean: Transforming construction using Lean Thinking by Adrian Terry & Stuart Smith Howell, Greg (2011) Book Review: Build Lean: Transforming construction using Lean Thinking by Adrian Terry & Stuart Smith. Lean Construction Journal 2011 pp 3-8 Book Review: Build Lean: Transforming construction

More information

A Context-Driven Use Case Creation Process for Specifying Automotive Driver Assistance Systems

A Context-Driven Use Case Creation Process for Specifying Automotive Driver Assistance Systems A Context-Driven Use Case Creation Process for Specifying Automotive Driver Assistance Systems Hannes Omasreiter, Eduard Metzker DaimlerChrysler AG Research Information and Communication Postfach 23 60

More information

TeacherPlus Gradebook HTML5 Guide LEARN OUR SOFTWARE STEP BY STEP

TeacherPlus Gradebook HTML5 Guide LEARN OUR SOFTWARE STEP BY STEP TeacherPlus Gradebook HTML5 Guide LEARN OUR SOFTWARE STEP BY STEP Copyright 2017 Rediker Software. All rights reserved. Information in this document is subject to change without notice. The software described

More information

Rover Races Grades: 3-5 Prep Time: ~45 Minutes Lesson Time: ~105 minutes

Rover Races Grades: 3-5 Prep Time: ~45 Minutes Lesson Time: ~105 minutes Rover Races Grades: 3-5 Prep Time: ~45 Minutes Lesson Time: ~105 minutes WHAT STUDENTS DO: Establishing Communication Procedures Following Curiosity on Mars often means roving to places with interesting

More information

Chamilo 2.0: A Second Generation Open Source E-learning and Collaboration Platform

Chamilo 2.0: A Second Generation Open Source E-learning and Collaboration Platform Chamilo 2.0: A Second Generation Open Source E-learning and Collaboration Platform doi:10.3991/ijac.v3i3.1364 Jean-Marie Maes University College Ghent, Ghent, Belgium Abstract Dokeos used to be one of

More information

Session Six: Software Evaluation Rubric Collaborators: Susan Ferdon and Steve Poast

Session Six: Software Evaluation Rubric Collaborators: Susan Ferdon and Steve Poast EDTECH 554 (FA10) Susan Ferdon Session Six: Software Evaluation Rubric Collaborators: Susan Ferdon and Steve Poast Task The principal at your building is aware you are in Boise State's Ed Tech Master's

More information

Introduction and Motivation

Introduction and Motivation 1 Introduction and Motivation Mathematical discoveries, small or great are never born of spontaneous generation. They always presuppose a soil seeded with preliminary knowledge and well prepared by labour,

More information

Practice Examination IREB

Practice Examination IREB IREB Examination Requirements Engineering Advanced Level Elicitation and Consolidation Practice Examination Questionnaire: Set_EN_2013_Public_1.2 Syllabus: Version 1.0 Passed Failed Total number of points

More information

K 1 2 K 1 2. Iron Mountain Public Schools Standards (modified METS) Checklist by Grade Level Page 1 of 11

K 1 2 K 1 2. Iron Mountain Public Schools Standards (modified METS) Checklist by Grade Level Page 1 of 11 Iron Mountain Public Schools Standards (modified METS) - K-8 Checklist by Grade Levels Grades K through 2 Technology Standards and Expectations (by the end of Grade 2) 1. Basic Operations and Concepts.

More information

INSTRUCTOR USER MANUAL/HELP SECTION

INSTRUCTOR USER MANUAL/HELP SECTION Criterion INSTRUCTOR USER MANUAL/HELP SECTION ngcriterion Criterion Online Writing Evaluation June 2013 Chrystal Anderson REVISED SEPTEMBER 2014 ANNA LITZ Criterion User Manual TABLE OF CONTENTS 1.0 INTRODUCTION...3

More information

PowerTeacher Gradebook User Guide PowerSchool Student Information System

PowerTeacher Gradebook User Guide PowerSchool Student Information System PowerSchool Student Information System Document Properties Copyright Owner Copyright 2007 Pearson Education, Inc. or its affiliates. All rights reserved. This document is the property of Pearson Education,

More information

BUILD-IT: Intuitive plant layout mediated by natural interaction

BUILD-IT: Intuitive plant layout mediated by natural interaction BUILD-IT: Intuitive plant layout mediated by natural interaction By Morten Fjeld, Martin Bichsel and Matthias Rauterberg Morten Fjeld holds a MSc in Applied Mathematics from Norwegian University of Science

More information

Thesis-Proposal Outline/Template

Thesis-Proposal Outline/Template Thesis-Proposal Outline/Template Kevin McGee 1 Overview This document provides a description of the parts of a thesis outline and an example of such an outline. It also indicates which parts should be

More information

Build on students informal understanding of sharing and proportionality to develop initial fraction concepts.

Build on students informal understanding of sharing and proportionality to develop initial fraction concepts. Recommendation 1 Build on students informal understanding of sharing and proportionality to develop initial fraction concepts. Students come to kindergarten with a rudimentary understanding of basic fraction

More information

AGENDA LEARNING THEORIES LEARNING THEORIES. Advanced Learning Theories 2/22/2016

AGENDA LEARNING THEORIES LEARNING THEORIES. Advanced Learning Theories 2/22/2016 AGENDA Advanced Learning Theories Alejandra J. Magana, Ph.D. admagana@purdue.edu Introduction to Learning Theories Role of Learning Theories and Frameworks Learning Design Research Design Dual Coding Theory

More information

Integration of ICT in Teaching and Learning

Integration of ICT in Teaching and Learning Integration of ICT in Teaching and Learning Dr. Pooja Malhotra Assistant Professor, Dept of Commerce, Dyal Singh College, Karnal, India Email: pkwatra@gmail.com. INTRODUCTION 2 st century is an era of

More information

Multimedia Courseware of Road Safety Education for Secondary School Students

Multimedia Courseware of Road Safety Education for Secondary School Students Multimedia Courseware of Road Safety Education for Secondary School Students Hanis Salwani, O 1 and Sobihatun ur, A.S 2 1 Universiti Utara Malaysia, Malaysia, hanisalwani89@hotmail.com 2 Universiti Utara

More information

Conversation Starters: Using Spatial Context to Initiate Dialogue in First Person Perspective Games

Conversation Starters: Using Spatial Context to Initiate Dialogue in First Person Perspective Games Conversation Starters: Using Spatial Context to Initiate Dialogue in First Person Perspective Games David B. Christian, Mark O. Riedl and R. Michael Young Liquid Narrative Group Computer Science Department

More information

Artifacts as Instant Messaging Buddies

Artifacts as Instant Messaging Buddies This paper was published in the Proceedings of the 43rd Annual Hawaii International Conference on System Sciences (HICSS-43, Persistent Conversation minitrack, pp. 1 10), Koloa, Hawaii, January 5 8, 2010.

More information

PROCESS USE CASES: USE CASES IDENTIFICATION

PROCESS USE CASES: USE CASES IDENTIFICATION International Conference on Enterprise Information Systems, ICEIS 2007, Volume EIS June 12-16, 2007, Funchal, Portugal. PROCESS USE CASES: USE CASES IDENTIFICATION Pedro Valente, Paulo N. M. Sampaio Distributed

More information

Justification Paper: Exploring Poetry Online. Jennifer Jones. Michigan State University CEP 820

Justification Paper: Exploring Poetry Online. Jennifer Jones. Michigan State University CEP 820 Running Head: JUSTIFICATION PAPER Justification Paper: Exploring Poetry Online Jennifer Jones Michigan State University CEP 820 Justification Paper 2 Overview of Online Unit Exploring Poetry Online is

More information

ecampus Basics Overview

ecampus Basics Overview ecampus Basics Overview 2016/2017 Table of Contents Managing DCCCD Accounts.... 2 DCCCD Resources... 2 econnect and ecampus... 2 Registration through econnect... 3 Fill out the form (3 steps)... 4 ecampus

More information

Writing Research Articles

Writing Research Articles Marek J. Druzdzel with minor additions from Peter Brusilovsky University of Pittsburgh School of Information Sciences and Intelligent Systems Program marek@sis.pitt.edu http://www.pitt.edu/~druzdzel Overview

More information

Office of Planning and Budgets. Provost Market for Fiscal Year Resource Guide

Office of Planning and Budgets. Provost Market for Fiscal Year Resource Guide Office of Planning and Budgets Provost Market for Fiscal Year 2017-18 Resource Guide This resource guide will show users how to operate the Cognos Planning application used to collect Provost Market raise

More information

Carolina Course Evaluation Item Bank Last Revised Fall 2009

Carolina Course Evaluation Item Bank Last Revised Fall 2009 Carolina Course Evaluation Item Bank Last Revised Fall 2009 Items Appearing on the Standard Carolina Course Evaluation Instrument Core Items Instructor and Course Characteristics Results are intended for

More information

LEt s GO! Workshop Creativity with Mockups of Locations

LEt s GO! Workshop Creativity with Mockups of Locations LEt s GO! Workshop Creativity with Mockups of Locations Tobias Buschmann Iversen 1,2, Andreas Dypvik Landmark 1,3 1 Norwegian University of Science and Technology, Department of Computer and Information

More information

GALICIAN TEACHERS PERCEPTIONS ON THE USABILITY AND USEFULNESS OF THE ODS PORTAL

GALICIAN TEACHERS PERCEPTIONS ON THE USABILITY AND USEFULNESS OF THE ODS PORTAL The Fifth International Conference on e-learning (elearning-2014), 22-23 September 2014, Belgrade, Serbia GALICIAN TEACHERS PERCEPTIONS ON THE USABILITY AND USEFULNESS OF THE ODS PORTAL SONIA VALLADARES-RODRIGUEZ

More information

Ruggiero, V. R. (2015). The art of thinking: A guide to critical and creative thought (11th ed.). New York, NY: Longman.

Ruggiero, V. R. (2015). The art of thinking: A guide to critical and creative thought (11th ed.). New York, NY: Longman. BSL 4080, Creative Thinking and Problem Solving Course Syllabus Course Description An in-depth study of creative thinking and problem solving techniques that are essential for organizational leaders. Causal,

More information

Usability Design Strategies for Children: Developing Children Learning and Knowledge in Decreasing Children Dental Anxiety

Usability Design Strategies for Children: Developing Children Learning and Knowledge in Decreasing Children Dental Anxiety Presentation Title Usability Design Strategies for Children: Developing Child in Primary School Learning and Knowledge in Decreasing Children Dental Anxiety Format Paper Session [ 2.07 ] Sub-theme Teaching

More information

The IDN Variant Issues Project: A Study of Issues Related to the Delegation of IDN Variant TLDs. 20 April 2011

The IDN Variant Issues Project: A Study of Issues Related to the Delegation of IDN Variant TLDs. 20 April 2011 The IDN Variant Issues Project: A Study of Issues Related to the Delegation of IDN Variant TLDs 20 April 2011 Project Proposal updated based on comments received during the Public Comment period held from

More information

Infrastructure Issues Related to Theory of Computing Research. Faith Fich, University of Toronto

Infrastructure Issues Related to Theory of Computing Research. Faith Fich, University of Toronto Infrastructure Issues Related to Theory of Computing Research Faith Fich, University of Toronto Theory of Computing is a eld of Computer Science that uses mathematical techniques to understand the nature

More information

Process improvement, The Agile Way! By Ben Linders Published in Methods and Tools, winter

Process improvement, The Agile Way! By Ben Linders Published in Methods and Tools, winter Process improvement, The Agile Way! By Ben Linders Published in Methods and Tools, winter 2010. http://www.methodsandtools.com/ Summary Business needs for process improvement projects are changing. Organizations

More information

WikiAtoms: Contributions to Wikis as Atomic Units

WikiAtoms: Contributions to Wikis as Atomic Units WikiAtoms: Contributions to Wikis as Atomic Units Hanrahan, Quintana-Castillo, Michael Stewart, A. Pérez-Quiñones Dept. of Computer Science, Virginia Tech. {bhanraha, rqc, tgm, perez}@vt.edu ABSTRACT Corporate

More information

Towards a Collaboration Framework for Selection of ICT Tools

Towards a Collaboration Framework for Selection of ICT Tools Towards a Collaboration Framework for Selection of ICT Tools Deepak Sahni, Jan Van den Bergh, and Karin Coninx Hasselt University - transnationale Universiteit Limburg Expertise Centre for Digital Media

More information

Innovating Toward a Vibrant Learning Ecosystem:

Innovating Toward a Vibrant Learning Ecosystem: KnowledgeWorks Forecast 3.0 Innovating Toward a Vibrant Learning Ecosystem: Ten Pathways for Transforming Learning Katherine Prince Senior Director, Strategic Foresight, KnowledgeWorks KnowledgeWorks Forecast

More information

What is beautiful is useful visual appeal and expected information quality

What is beautiful is useful visual appeal and expected information quality What is beautiful is useful visual appeal and expected information quality Thea van der Geest University of Twente T.m.vandergeest@utwente.nl Raymond van Dongelen Noordelijke Hogeschool Leeuwarden Dongelen@nhl.nl

More information

Abstractions and the Brain

Abstractions and the Brain Abstractions and the Brain Brian D. Josephson Department of Physics, University of Cambridge Cavendish Lab. Madingley Road Cambridge, UK. CB3 OHE bdj10@cam.ac.uk http://www.tcm.phy.cam.ac.uk/~bdj10 ABSTRACT

More information

Feature-oriented vs. Needs-oriented Product Access for Non-Expert Online Shoppers

Feature-oriented vs. Needs-oriented Product Access for Non-Expert Online Shoppers Feature-oriented vs. Needs-oriented Product Access for Non-Expert Online Shoppers Daniel Felix 1, Christoph Niederberger 1, Patrick Steiger 2 & Markus Stolze 3 1 ETH Zurich, Technoparkstrasse 1, CH-8005

More information

A Case Study: News Classification Based on Term Frequency

A Case Study: News Classification Based on Term Frequency A Case Study: News Classification Based on Term Frequency Petr Kroha Faculty of Computer Science University of Technology 09107 Chemnitz Germany kroha@informatik.tu-chemnitz.de Ricardo Baeza-Yates Center

More information

WORK OF LEADERS GROUP REPORT

WORK OF LEADERS GROUP REPORT WORK OF LEADERS GROUP REPORT ASSESSMENT TO ACTION. Sample Report (9 People) Thursday, February 0, 016 This report is provided by: Your Company 13 Main Street Smithtown, MN 531 www.yourcompany.com INTRODUCTION

More information

4. Long title: Emerging Technologies for Gaming, Animation, and Simulation

4. Long title: Emerging Technologies for Gaming, Animation, and Simulation CGS Agenda Item: 17 07 Eastern Illinois University Effective Fall 2018 New Course Proposal DGT 4913, Emerging Technologies for Gaming, Animation, Simulation Banner/Catalog Information (Coversheet) 1. _X_New

More information

Applying Information Technology in Education: Two Applications on the Web

Applying Information Technology in Education: Two Applications on the Web 1 Applying Information Technology in Education: Two Applications on the Web Spyros Argyropoulos and Euripides G.M. Petrakis Department of Electronic and Computer Engineering Technical University of Crete

More information

Implementing a tool to Support KAOS-Beta Process Model Using EPF

Implementing a tool to Support KAOS-Beta Process Model Using EPF Implementing a tool to Support KAOS-Beta Process Model Using EPF Malihe Tabatabaie Malihe.Tabatabaie@cs.york.ac.uk Department of Computer Science The University of York United Kingdom Eclipse Process Framework

More information

Specification of the Verity Learning Companion and Self-Assessment Tool

Specification of the Verity Learning Companion and Self-Assessment Tool Specification of the Verity Learning Companion and Self-Assessment Tool Sergiu Dascalu* Daniela Saru** Ryan Simpson* Justin Bradley* Eva Sarwar* Joohoon Oh* * Department of Computer Science ** Dept. of

More information

Geo Risk Scan Getting grips on geotechnical risks

Geo Risk Scan Getting grips on geotechnical risks Geo Risk Scan Getting grips on geotechnical risks T.J. Bles & M.Th. van Staveren Deltares, Delft, the Netherlands P.P.T. Litjens & P.M.C.B.M. Cools Rijkswaterstaat Competence Center for Infrastructure,

More information

Five Challenges for the Collaborative Classroom and How to Solve Them

Five Challenges for the Collaborative Classroom and How to Solve Them An white paper sponsored by ELMO Five Challenges for the Collaborative Classroom and How to Solve Them CONTENTS 2 Why Create a Collaborative Classroom? 3 Key Challenges to Digital Collaboration 5 How Huddle

More information

Calculators in a Middle School Mathematics Classroom: Helpful or Harmful?

Calculators in a Middle School Mathematics Classroom: Helpful or Harmful? University of Nebraska - Lincoln DigitalCommons@University of Nebraska - Lincoln Action Research Projects Math in the Middle Institute Partnership 7-2008 Calculators in a Middle School Mathematics Classroom:

More information

Houghton Mifflin Online Assessment System Walkthrough Guide

Houghton Mifflin Online Assessment System Walkthrough Guide Houghton Mifflin Online Assessment System Walkthrough Guide Page 1 Copyright 2007 by Houghton Mifflin Company. All Rights Reserved. No part of this document may be reproduced or transmitted in any form

More information

The open source development model has unique characteristics that make it in some

The open source development model has unique characteristics that make it in some Is the Development Model Right for Your Organization? A roadmap to open source adoption by Ibrahim Haddad The open source development model has unique characteristics that make it in some instances a superior

More information

Different Requirements Gathering Techniques and Issues. Javaria Mushtaq

Different Requirements Gathering Techniques and Issues. Javaria Mushtaq 835 Different Requirements Gathering Techniques and Issues Javaria Mushtaq Abstract- Project management is now becoming a very important part of our software industries. To handle projects with success

More information

Field Experience Management 2011 Training Guides

Field Experience Management 2011 Training Guides Field Experience Management 2011 Training Guides Page 1 of 40 Contents Introduction... 3 Helpful Resources Available on the LiveText Conference Visitors Pass... 3 Overview... 5 Development Model for FEM...

More information

TIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE. Pierre Foy

TIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE. Pierre Foy TIMSS ADVANCED 2015 USER GUIDE FOR THE INTERNATIONAL DATABASE Pierre Foy TIMSS Advanced 2015 orks User Guide for the International Database Pierre Foy Contributors: Victoria A.S. Centurino, Kerry E. Cotter,

More information

10.2. Behavior models

10.2. Behavior models User behavior research 10.2. Behavior models Overview Why do users seek information? How do they seek information? How do they search for information? How do they use libraries? These questions are addressed

More information

Mater Dei Institute of Education A College of Dublin City University

Mater Dei Institute of Education A College of Dublin City University MDI Response to Better Literacy and Numeracy: Page 1 of 12 Mater Dei Institute of Education A College of Dublin City University The Promotion of Literacy in the Institute s Initial Teacher Education Programme

More information

A Study of the Effectiveness of Using PER-Based Reforms in a Summer Setting

A Study of the Effectiveness of Using PER-Based Reforms in a Summer Setting A Study of the Effectiveness of Using PER-Based Reforms in a Summer Setting Turhan Carroll University of Colorado-Boulder REU Program Summer 2006 Introduction/Background Physics Education Research (PER)

More information

Chapter 5: TEST THE PAPER PROTOTYPE

Chapter 5: TEST THE PAPER PROTOTYPE Chapter 5: TEST THE PAPER PROTOTYPE Start with the Big Three: Authentic Subjects, Authentic Tasks, and Authentic Conditions The basic premise of prototype testing for usability is that you can discover

More information