An evaluation of the Law Commission of Ontario will begin this fall. (Since it has been full operating – working on projects – only since February 2008, this may seem premature or early. Early it is, premature it is not because it is tied to the funding renewal/renewal of mandate process that will begin in spring or thereabouts next year.) There are many questions about evaluation (who should do it? who should be part of the process? and so on), but I am bringing one to this group: whether anyone has had experience with evaluating an organization's use of technology.
Of course, one can count "hits" on the website. Are there other ways to assess the effectiveness of the technological processes used by the organization? What about the alignment of the function of the organization with technological processes? the appropriateness of the communication methods the organizaton employees? the appropriateness of the "sophistication" of the technology given the organization's target audience(s)? Does comparing with the websites and other technologies used by similar organizations elsewhere matter? Are any of these even reasonable/feasible/useful questions to ask and are they likely to attract useful responses (and from whom?). Who should do the evaluation? Should it be part of the overall evaluation? Are evaluation experts likely to understand measures of technology?
Should we just stay clear of the whole thing?
Respond: make a comment | read the 3 comments
Share:
Email
|
Save as PDF | Print
|
Bookmark & Share
|
|
More: in Technology | from Patricia Hughes
|
the count:
8230 posts | 11414 comments
recent comments  
Max Amsterdam once said: “Business is the art of extracting money from another man’s pocket without resorting to violence.” The purpose of having a written agreement between all … »»Practice There is good leagal content that doesn’t necessarily come in the neat packages that we usually look in. Though our commercial legal database subscriptions have linked, vetted, edited, and easily. […] »»Research When you need to collaborate on a document displayed on your screen, it’s great to have a colleague from down the hall come into your office and look over your … »»Technology
-
Available online today are four new chapters of the publication Women in Canada: A Gender-based Statistical Report, which explores the socio-demographic and economic circumstances of Canadian women in general.
-
The bill amends the Constitution Act, 1867 by readjusting the number of members and the representation of the provinces in the House of Commons.
-
-
Blueseed plans to buy a ship and turn it into a floating incubator anchored in international waters off the coast of California.
-
Under Prime Minister Stephen Harper, the flow of information out of Ottawa has slowed to a trickle.
-
-
"…the IPC has exclusive jurisdiction to decide whether a record is in the custody or control of a university in the context of an access request…"
-
-
John J.L. Hunter, Q.C. of Vancouver has been elected President for 2011-2012
-
Detailed results from 321 members.
These summaries of selected recent cases are provided each week to Slaw by Maritime Law Book.
More information.
-
Banks and Banking - Liability of banks to third parties - Negligence - General
The plaintiffs were the former shareholders of a company that failed. They sued the defendant bank alleging that it breached its contract with the company and the plaintiffs and breached a duty ...
-
Actions - Cause of action - General principles - New or extended cause of action - Opening of floodgates
The plaintiff and defendant worked at different branches of the same bank. The defendant’s common-law husband was the plaintiff’s ex-husband. Over a four year period, the defendant ...
-
Aliens - Definitions and general principles - Immigration consultants
The Canadian Society of Immigration Consultants (CSIC) had been designated as the sole regulatory body of immigration consultants in Canada from 2004 until June 2011. On June 30, 2011, Bill C-35 came into force, which significantly amended ...
-
Criminal Law - Sexual offences, public morals and disorderly conduct - Public morals - Obscenity - Possession of child pornography
The accused was convicted of making child pornography available and two counts of possession of child pornography (see [2010] Sask.R. Uned. 197). Subsequently, he was sentenced ...
-
Criminal Law - Procedure - Charge or directions - Jury or judge alone - Directions regarding pleas or evidence of witnesses, co-accused and accomplices
Rowe was convicted by a jury of five offences. He appealed.
The Ontario Court of Appeal allowed ...
-
Narcotic Control - Offences - Possession - General
The accused wished to access marijuana for medicinal purposes but did not have an authorization to possess marijuana issued under the Marihuana Medical Access Regulations. He was notified that a package of marihuana addressed to him had been ...
-
Narcotic Control - General - Legislation - Exemptions - Medicinal marijuana
McCrady, who had an application pending under the Marihuana Medical Access Regulations (MMAR) to possess and grow marijuana, was convicted of possession of marijuana (Controlled Drugs and Substances Act (CDSA), s. 4(1)). Hearn pleaded guilty ...
-
Criminal Law - Sentence - Trafficking in hashish or marijuana (incl. possession for purposes of trafficking)
The accused pleaded guilty to one count of possession of marijuana for the purpose of trafficking. He was sentenced to 30 days’ imprisonment to be served intermittently and 11 months’ ...
-
Municipal Law - Powers of municipalities - Particular powers - Imposition and collection of taxes or fees
Catalyst Paper Corp. operated a paper mill in the District of North Cowichan. Catalyst objected to the tax rate that it paid compared to residential ratepayers. In 2009, the ...
This is a listing of a few upcoming events in Canada of interest to lawyers, law students, legal librarians, and others involved in the practice of law.
Clicking on any event in the list below will give you access to more information and to links allowing you to see the full entry and to add the event to your own calendar.
Click this link for a fuller version of the TalkLaw/ParLoi calendar of events and for instructions as to how to add events and calendars to your own calendar.
|
Patricia, it seems to me that what you are describing is an information audit. There are lots of people out there who can come into your organization and find out how technology is used in your current business processes. The real value for money comes in the frank assessment of the processes – this will come from interviews with staff, direct observation (where possible). It might be interesting as well to see how a given process would work if it was totally manual, and compare that against the existing process with technological support.
As far as the "hits on the website" exercise goes, that sounds more like a usability assessment to me. This usually takes the form of expert evaluation of the design and layout of the site, as well as interviews/surveys/observation of users of the site. You can hire outsiders to do this work, but it's not hard to come up with a decent set of questions yourself.
I'm currently working on a project to redesign my library's website. The first thing I did was to invite some folks from my user community to come into the library to run some sample searches I'd created. I peeked over their shoulders and took notes as they recited to me the reasons for the choices they were making. It was interesting to see the spots where they got stuck – totally unexpected! What I learned will allow us to improve the layout of the site and has prompted us to review the language and clarity of the site's content. As we progress through the redesign, I'll be inviting different groups to come in to give us feedback on our ideas. It does add time to the process, but I think we'll wind up with a site that better anticipates how people use our information, and what they expect to see.
With websites the tendency is to evaluate number of "hits" or visits. However, inside an organization that measurement is not meaningful: just because a document or file is used only once does not mean it has not been valuable. It could have been the key file to work worth a million dollars to your organization.
So, other measures should be used. For example, how is the workflow: are people repeating the same work more than once? Are there bottlenecks slowing down the work? Are there pieces of the work that could be automated to speed things up?
Also, if people are looking for files, documents, or information, are they succeeding in finding? If you have a search engine running inside the organization, you can check to see where people are searching and not retrieving results. What are the terms they are using? Is there a way to tweak your metadata/indexing terms so that people can find what they are looking for? That is also something to ask if you are interviewing them during an information audit as Wendy suggests.
There are lots of different ways to evaluate technology inside the organization. It also helps to evaluate when you first implement something new to set an early benchmark.
I agree with Wendy that this sounds like a case for calling a business process analysis company. Of course, I may be biased, seeing as my husband works for one…