<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Future Workspaces &#187; evaluation</title>
	<atom:link href="http://www.futureworkspaces.nl/tag/evaluation/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.futureworkspaces.nl</link>
	<description>Grip op Het Nieuwe Werken</description>
	<lastBuildDate>Fri, 09 Sep 2011 13:05:51 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9.2</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
			<item>
		<title>Evaluating Twitter in our expertise group</title>
		<link>http://www.futureworkspaces.nl/2009/04/09/evaluating-twitter-in-our-expertise-group/</link>
		<comments>http://www.futureworkspaces.nl/2009/04/09/evaluating-twitter-in-our-expertise-group/#comments</comments>
		<pubDate>Thu, 09 Apr 2009 17:10:15 +0000</pubDate>
		<dc:creator>Ruud Janssen</dc:creator>
				<category><![CDATA[EN]]></category>
		<category><![CDATA[Geleerde lessen]]></category>
		<category><![CDATA[knowledge base]]></category>
		<category><![CDATA[team blog]]></category>
		<category><![CDATA[evaluation]]></category>
		<category><![CDATA[experiment]]></category>
		<category><![CDATA[in sync]]></category>
		<category><![CDATA[in touch]]></category>
		<category><![CDATA[knowledge sharing]]></category>
		<category><![CDATA[social software]]></category>
		<category><![CDATA[twitter]]></category>

		<guid isPermaLink="false">http://www.futureworkspaces.nl/?p=1184</guid>
		<description><![CDATA[Exactly two months ago our expertise group started an experiment with Twitter to see how it could facilitate knowledge sharing in between the monthly group meetings, and to see how it could improve social cohesion in the group.
 
Some characteristics of the expertise group

14 researchers with a shared interest in how ICT affects work, life, and [...]]]></description>
			<content:encoded><![CDATA[<p>Exactly two months ago our expertise group <a title="experimenting with social media in our expertise group" href="http://www.futureworkspaces.nl/2009/02/10/experimenting-with-social-media-in-our-expertise-group/" target="_blank">started an experiment with Twitter</a> to see how it could facilitate knowledge sharing in between the monthly group meetings, and to see how it could improve social cohesion in the group.<br />
 <br />
<strong>Some characteristics of the expertise group</strong>
<ul>
<li>14 researchers with a shared interest in how ICT affects work, life, and society;</li>
<li>they are working in the same research institute, but located over various parts of the building;</li>
<li>they frequently work elsewhere, for instance during client visits, workshops, conferences;</li>
<li>they are all working on several different projects at a time;</li>
<li>they are well acquainted with one another, though not co-working on a daily basis;</li>
<li>they share a feeling that cohesion and knowledge sharing in the group could be improved. </li>
</ul>
<p><span id="more-1184"></span><br />
<strong>Twitter usage</strong>13 People in the group used Twitter during the experiment, of which 5 were already using it. Usage statistics (averaged over all participants, those new to Twitter, and those experienced with Twitter) are shown in the table below. The table clearly shows that the new Twitter users twittered less and were following far fewer people outside the group than the experienced Twitter users. During the experiment, 2 new Twitter users gave up on Twitter.</p>
<p> </p>
<table border="1" cellspacing="0" cellpadding="0">
<tbody>
<tr>
<td width="160">
<p align="center"> </p>
</td>
<td width="160">
<p align="center">all participants (13)</p>
</td>
<td width="160">
<p align="center">new to Twitter (8)</p>
</td>
<td width="160">
<p align="center">experienced (5)</p>
</td>
</tr>
<tr>
<td width="160">
<p align="center">following<br />
(per 09-apr-&#8217;09)</td>
<td width="160">
<p align="center">33 (10 within the group)</p>
</td>
<td width="160">
<p align="center">13 (9 within the group)</p>
</td>
<td width="160">
<p align="center">65 (12 within the group)</p>
</td>
</tr>
<tr>
<td width="160">
<p align="center">followers<br />
(per 09-apr-&#8217;09)</td>
<td width="160">
<p align="center">36 (10 within the group)</p>
</td>
<td width="160">
<p align="center">15 (10 within the group)</p>
</td>
<td width="160">
<p align="center">70 (11 within the group)</p>
</td>
</tr>
<tr>
<td width="160">
<p align="center">tweets<br />
(09-feb to 09-apr-&#8217;09)</td>
<td width="160">
<p align="center">74</p>
</td>
<td width="160">
<p align="center">34</p>
</td>
<td width="160">
<p align="center">137</p>
</td>
</tr>
<tr>
<td width="160">
<p align="center">still twittering<br />
(per 09-apr-&#8217;09)</td>
<td width="160">
<p align="center">11 (85%)</p>
</td>
<td width="160">
<p align="center">6 (75%)</p>
</td>
<td width="160">
<p align="center">5 (100%)</p>
</td>
</tr>
</tbody>
</table>
<p>  </p>
<h3>Twitter evaluation</h3>
<p>From the people who used Twitter, 11 completed the Twitter evaluation form. The form contained 10 statements, to be answered on a 5-point Likert scale (from -2 to 2 for “strongly disagree” to “strongly agree”). The spider graph below shows the results.<img class="aligncenter size-full wp-image-1221" title="twitter-spider-graph5" src="http://www.futureworkspaces.nl/wp-content/uploads/2009/04/twitter-spider-graph5.png" alt="twitter-spider-graph5" width="1202" height="1021" /></p>
<p>The graph shows that, overall, Twitter is evaluated quite positively. Twitter scores extremely high on the aspect of getting to know your colleagues more personally. Furthermore, Twitter scores very high on ease of use, and the benefits for work clearly seem to outweigh the costs of using it. However, Twitter scores poorly on the aspects of finding information on a certain topic or finding an expert on a certain topic.</p>
<p> </p>
<h3>Twitter experiences</h3>
<p>An individual brainstorm (reflecting on personal experiences with Twitter, and writing these down on post-its) was followed by a group discussion on four themes. 10 People participated in this brainstorm and discussion. Highlights are presented below.</p>
<h4>Likes &amp; Dislikes</h4>
<p>Likes:</p>
<ul>
<li>It’s nice to “follow” your colleagues: what have they been doing, what are they up to.</li>
<li>You don’t necessarily have to react to what others are twittering.</li>
<li>Twitter can be used like an RSS feed to follow developments on a topic or the lives of celebrities.</li>
<li>Twitter is easy to install and use, and it easily integrates into tools like Facebook and Blogger.</li>
</ul>
<p>Dislikes:</p>
<ul>
<li>Requests from unknown people who want to follow you; how did these people find me?</li>
<li>No option to tweet to different groups, for instance, just to colleagues or to friends.</li>
<li>It’s difficult to find a good balance of how many followers/following (Quitter!!!).</li>
<li>Some people twitter too much, they “bury” the tweets of others.</li>
<li>The “avalanche” of unread tweets if you didn’t log into Twitter for a while.</li>
<li>For “quality” information you should turn to weblogs, not to Twitter.</li>
</ul>
<h4>Staying in sync &amp; Staying in touch</h4>
<p>Staying in sync:</p>
<ul>
<li>You can get a better feeling about what’s going on in some projects.</li>
<li>Twitter can be used to get up to date on general news in your field.</li>
<li>It helped to stay in sync and in touch when colleagues were out of office.</li>
<li>Twitter doesn’t help you to stay in sync if you don’t have the time to check it frequently.</li>
<li>The mobile client does not support URLs, so tweets using URLs are difficult to interpret.</li>
</ul>
<p>Staying in touch:</p>
<ul>
<li>It provides a sense of being in touch, albeit fragmented (not always, and without an overview).</li>
<li>It’s difficult to get into an ongoing conversation.</li>
<li>It works really well to stay in touch with people who are far away.</li>
<li>It lowers the threshold to stay in touch with people as it is less intrusive than IM, email, phone.</li>
<li>Being aware of relatively small details (what are people doing, and where they are) gives a good sense of being in touch.</li>
</ul>
<h4>Success stories &amp; Disappointments</h4>
<p>Success stories:</p>
<ul>
<li>I didn’t realize how much I would appreciate to stay in touch with my colleagues.</li>
<li>Quickly got several responses on a request for input, ideas, or a translation.</li>
</ul>
<p>Disappointments:</p>
<ul>
<li>Being too busy to use Twitter, a nagging feeling “I should have twittered more”.</li>
<li>Time zone differences; too many tweets the next morning.</li>
<li>The Twitter site experienced some problems and some of my tweets went missing.</li>
<li>The Twitter client crashed and needed to be reinstalled.</li>
</ul>
<h4>Usability &amp; “Other”</h4>
<p>Usability:</p>
<ul>
<li>Some functionality is hidden or simply unknown, for instance the use of “#”.</li>
<li>Difficult to compare the lists of “followers” and “following”.</li>
<li>There are too many Twitter clients (PC and mobile) which is confusing.</li>
<li>Mobile clients to not offer the support that is actually needed (e.g., overview of new tweets, being able to follow links).</li>
</ul>
<p>“Other”:</p>
<ul>
<li>Reciprocity is a problem; some replies seem to be missing.</li>
<li>Still able to use it even though I don’t have much time.</li>
<li>Still don’t have the feeling that it integrated well into my work.</li>
</ul>
<h3>Conclusion</h3>
<p>It is clear that Twitter is a useful tool for maintaining a sense of being “in touch” with your colleagues, especially when they are often out of office or when you otherwise don’t see them often. A lack of time to frequently use Twitter is the main obstacle for staying “in touch”. But ease of use and the general opinion that it is fun to use, alleviate this and keep people motivated to use it.</p>
<p>Although Twitter allows one to send a request to followers, or to exchange information by sharing interesting URLs, for the people in this group it did not (yet) provide clear benefits with regard to more traditional aspects of knowledge sharing, like finding information on a topic or finding an expert on a topic.</p>
<p>Probably the best indicator for the success of this experiment is that, at the end of the evaluation workshop, all people who were still using Twitter indicated that they would continue to use the tool.</p>
]]></content:encoded>
			<wfw:commentRss>http://www.futureworkspaces.nl/2009/04/09/evaluating-twitter-in-our-expertise-group/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
	</channel>
</rss>

