Search Task Repository: Development & Discussion

How to do a search report? The Search Logger 2.0 usability study

2011-12-14T12:39:00.002+02:00

Summary

The background

The aim of the Search Task Repository project is to let the users/Internet searchers publish their annotated search logs and make these logs searchable. In order to log ones search activity and behaviour, we have developed a special tool called The Search Logger 2.0. Here "2.0" means that a conceptually similar but technically very different logger existed before I started with this project and was developed by Hannu Kikkas. The current version is platform-independent and uses a proxy to modify every web page served so that it could be logged by our dedicated HTTP server. The Search Task Repository is currently in development and will be one of the main topics of my Master thesis.

The goal

We wanted to put ourselves in the end user's shoes and evaluate the usability of the current Search Logger 2.0. To do that I conducted a number of exploratory search tasks and used our software to log the web activity. In essence, I sought an answer to the question "How to do a search report?". The other goal was to find, document and fix bugs in the existing logging and reporting software and come up with ideas about new features.

The results

The existing solution was tested on six exploratory search tasks such as finding a foreign university on a budget where to study machine engineering, finding 5 clever Christmas present ideas for under 10 euros per item, finding a ballroom dance school in Tartu area, etc. These tasks and how they worked out on our current software in more detail can be found on my blog. What is more, I made a short screencast for presentation purposes which is also linked to. During the semester I made some small tweaks to the Search Logger 2.0 but they are mostly bug-fixes and I do not consider them significant in this context. Here is a list of things that I learnt from the experiment:

FIX: Amazon book preview does not work properly
FIX: Sidepane video image previews on YouTube are not displayed
FIX: Some random exceptions (documented) -> possibly related to the pre- and post-forms
TODO: Users might want to take notes while searching
TODO: onSubmit and onClick events should be also logged
TODO: The logger is lacking a database integration
TODO: Search logger and repository integration (work in progress)
IDEA: Copy-paste detection and bookmarking would be nice to have because this help us detect web pages with relevant information

Thank you for reading this blog and feel free to share your ideas!

Peeter

Finding a ballroom dance school in Tartu area

2011-12-14T11:10:00.002+02:00

And here is the second search task conducted. What makes it special is its locality. Search tasks often get a different meaning when the physical location comes into play. And this is one key aspect to bear in mind for developing the repository of search tasks. A user who is searching for a dance school in Tartu might have little use of search logs describing the same thing for Stockholm. However, general search patterns (for instance some non-location key words typed in Google which lead to good results) might still be discovered from the logs.

Pre-form:

Post-form:

Technical logs:
http://www.mediafire.com/?86v2dlqhp0qlvl9

In the next post I will wrap up why the things I did were useful for the project in general.

Peeter

P.S. This is not an advertisement but the best school quality/price-wise that I found was Revalia Tantsukool, appr. 4-5 EUR per hour. :D

Electronic books search case study

2011-12-14T10:59:00.000+02:00

Hi!

In the meantime I have came up with two new exploratory search tasks. The first one will be covered in this post

Objective:

Result:

Answers:

Teach Yourself Electricity and Electronics [Paperback]

Make: Electronics (Learning by Discovery) [Paperback]

Tab Electronics Guide to Understanding Electricity and Electronics [Paperback]

Electronics Demystified [Paperback]

Electronics For Dummies [Paperback]

All New Electronics Self-Teaching Guide (Wiley Self Teaching Guides) [Paperback]

Search logger logs and crash logs:

http://www.mediafire.com/?yzcyt02hqn9u5n6

There is more to come...

Peeter

Two new search tasks

2011-11-30T16:20:00.001+02:00

Hello all,

I have two new exploratory search tasks with complete search logger data to report.

The first one is seasonal: finding 5 clever Christmas present ideas for under 10 euros per item. Target is unfixed but you can assume it is a lady.

The second: listing 10 most common requirements for a data analyst job application, i.e. must have skills, personality traits, education, etc.

First case
Second case

Search Logger 2.0 DEMO video

2011-10-23T23:23:00.000+03:00

Here you will find a video of somewhat superior quality. Enjoy!

Aspects of the software covered in this video:

filling in pre- and post-forms by the user
automatic logging of the user search behaviour
different log formats
searching itself using Google

Aspects NOT covered in the screencast:

setting up the whole logger system
source code of the search logger 2.0

If you have questions or ideas, please post them here. Thanks!

Initial screencast of the interface

2011-10-18T22:21:00.000+03:00

Hi!

I carried out another search task and recorded a screencast presenting the whole process.

Task:

Compile a list of the five best universities (worldwide) to achieve a
master's in machine engineering (or closely related field) under the
condition that you have 1500 EUR per month available to cover all
involved costs.

Happy watching! Note: what you will see is edited video material. However, as PiTiVi seems to have no support for adding text labels, there are none at the moment. Sorry for the relatively poor quality. I hope make available a better version soon. :-)

More information regarding this task coming soon... Please comment on what you would like to change in the first place to make this tool better.

User testing + bugfixes + further development

2011-10-01T11:59:00.001+03:00

Hi!

These are the main keywords for the coming weeks: I am trying to put myself into the end user's perspective by testing the logging capabilities of the existing search task logger system. Each week I come up with a new expoloratory search task, carry out the testing and report crashes, bugs, new development ideas, etc. What is more, I try and fix more urgent bugs as well. This part (but mainly inventing new exploratory search tasks and generating usage data) serves as the DS Seminar work for this semester. In parallel, I am also trying to pursue new ideas regarding the Search Task Repository and make them a reality.

So, THIS IS THE FIRST CASE STUDY!!!
Learning how to become an investor in a stock exchange.

The data entered explicitly by the user (read: by myself)

I think that the post-search form needs some more questions such as: "How much did your search objectives change while you did the searching?". Even better would be making the pre-form modifiable during the search process which can be achieved quite easily. I would just have to store every submission not just the very last one.

Automatically logged data
(Note: here are not the entire logs because they are quite long to be publiched here. However, if you are interested, I can upload them elsewhere.)

LOG FOR HUMANS

At 2011-09-29 15:38:40 a user opened http://www.best-stock-trading-systems.com/best-forex-trading-software-charting-platform-top-online-market-reviews.html. The user IP was 127.0.0.1.
The user came from http://www.best-stock-trading-systems.com/.
It was 2011-09-29 15:38:40 when the user from 127.0.0.1 moved away from http://www.best-stock-trading-systems.com/best-forex-trading-software-charting-platform-top-online-market-reviews.html.
At 2011-09-29 15:38:40 a user opened http://www.best-stock-trading-systems.com/. The user IP was 127.0.0.1.
The user came from http://www.google.ee/url?sa=t&rct=j&q=most%20lucrative%20stock%20markets&source=web&cd=9&ved=0CG4QFjAI&url=http%3A%2F%2Fwww.best-stock-trading-systems.com%2F&ei=EY-EToWIJIjn-gakpeEk&usg=AFQjCNHo86JNs_Jjgl6zjD21g4kdR6_56A.
It was 2011-09-29 15:38:40 when the user from 127.0.0.1 moved away from http://www.best-stock-trading-systems.com/.
It was 2011-09-29 15:39:58 when the user from 127.0.0.1 moved away from http://www.google.ee/.
At 2011-09-29 15:39:58 a user opened http://www.ilikeinvesting.com/. The user IP was 127.0.0.1.
The user came from http://www.google.ee/url?sa=t&rct=j&q=investing%20money&source=web&cd=3&sqi=2&ved=0CGAQFjAC&url=http%3A%2F%2Fwww.ilikeinvesting.com%2F&ei=SZGETrieHNOxhQe4je3iDA&usg=AFQjCNHYONogtAxVQYM93O_STU6jPGiyEQ.
It was 2011-09-29 15:40:14 when the user from 127.0.0.1 moved away from http://www.ilikeinvesting.com/.
It was 2011-09-29 15:40:19 when the user from 127.0.0.1 moved away from http://www.google.ee/.
At 2011-09-29 15:40:23 a user opened http://financialtools.money.msn.irsws.com/money/widgets/w3mtg.aspx. The user IP was 127.0.0.1.
The user came from http://money.msn.com/.
At 2011-09-29 15:40:23 a user opened http://money.msn.com/. The user IP was 127.0.0.1.
The user came from http://www.google.ee/url?sa=t&rct=j&q=investing%20money&source=web&cd=5&sqi=2&ved=0CHEQFjAE&url=http%3A%2F%2Fmoney.msn.com%2F&ei=SZGETrieHNOxhQe4je3iDA&usg=AFQjCNFU0kudSqfNkt3s1c8pmLPc-NE-Ug.
It was 2011-09-29 15:40:31 when the user from 127.0.0.1 moved away from http://money.msn.com/.
It was 2011-09-29 15:40:31 when the user from 127.0.0.1 moved away from http://financialtools.money.msn.irsws.com/money/widgets/w3mtg.aspx.
At 2011-09-29 15:40:33 a user opened http://www.coveritlive.com/index2.php/option=com_altcaster/task=viewaltcast/altcast_code=5aebdbf3cd/height=385/width=300. The user IP was 127.0.0.1.
The user came from http://money.msn.com/saving-money/10-lessons-to-steal-from-con-men-thestreet.aspx?cp-documentid=6857175.
It was 2011-09-29 15:40:36 when the user from 127.0.0.1 moved away from http://money.msn.com/saving-money/10-lessons-to-steal-from-con-men-thestreet.aspx?cp-documentid=6857175.
It was 2011-09-29 15:40:36 when the user from 127.0.0.1 moved away from http://www.coveritlive.com/index2.php/option=com_altcaster/task=viewaltcast/altcast_code=5aebdbf3cd/height=385/width=300.
It was 2011-09-29 15:40:36 when the user from 127.0.0.1 moved away from http://financialtools.money.msn.irsws.com/money/widgets/w2.aspx.
At 2011-09-29 15:40:37 a user opened http://financialtools.money.msn.irsws.com/money/widgets/w3mtg.aspx. The user IP was 127.0.0.1.
The user came from http://money.msn.com/.
It was 2011-09-29 15:40:37 when the user from 127.0.0.1 moved away from http://financialtools.money.msn.irsws.com/money/widgets/w3mtg.aspx.
It was 2011-09-29 15:40:37 when the user from 127.0.0.1 moved away from http://money.msn.com/.
It was 2011-09-29 15:40:45 when the user from 127.0.0.1 moved away from http://www.google.ee/.
At 2011-09-29 15:40:47 a user opened http://www.facebook.com/plugins/like.php?app_id=178412055558267&href=http://www.guardian.co.uk/money/2010/may/29/where-invest-money&send=false&layout=button_count&width=140&show_faces=false&action=recommend&colorscheme=light&font=arial&height=21. The user IP was 127.0.0.1.
The user came from http://www.guardian.co.uk/money/2010/may/29/where-invest-money.
At 2011-09-29 15:40:47 a user opened http://www.dianomioffers.co.uk/smartads.epl?id=609. The user IP was 127.0.0.1.
The user came from http://www.guardian.co.uk/money/2010/may/29/where-invest-money.
At 2011-09-29 15:40:47 a user opened http://www.simplifydigital.co.uk/tools/guardian/articlepages.aspx. The user IP was 127.0.0.1.
The user came from http://www.guardian.co.uk/money/2010/may/29/where-invest-money.
At 2011-09-29 15:40:47 a user opened http://www.guardian.co.uk/money/2010/may/29/where-invest-money. The user IP was 127.0.0.1.
The user came from http://www.google.ee/url?sa=t&rct=j&q=investing%20money&source=web&cd=9&sqi=2&ved=0CJwBEBYwCA&url=http%3A%2F%2Fwww.guardian.co.uk%2Fmoney%2F2010%2Fmay%2F29%2Fwhere-invest-money&ei=SZGETrieHNOxhQe4je3iDA&usg=AFQjCNGfMdQp0ti0ZNTwa3epNN3NuzeioA.

LOG FOR GEEKS

['2011-09-29 15:19:19', '127.0.0.1', 'pageload', 'http://platform.twitter.com/widgets/tweet_button.html']
['2011-09-29 15:19:20', '127.0.0.1', 'pageload', 'http://static.ak.fbcdn.net/connect/xd_proxy.php?version=3']
['2011-09-29 15:19:36', '127.0.0.1', 'pageunload', 'http://www.ehow.com/how_5135_become-stockbroker.html', 'http://www.google.ee/url?sa=t&rct=j&q=stock%20broker%20training&source=web&cd=1&sqi=2&ved=0CC0QFjAA&url=http%3A%2F%2Fwww.ehow.com%2Fhow_5135_become-stockbroker.html&ei=cIyETtj2DsrpOer7kNUB&usg=AFQjCNEE5ujqoRu7jgqdhMxdrivtI2JkGA']
['2011-09-29 15:19:36', '127.0.0.1', 'pageunload', 'http://www.ehow.com/media/ad.html?divId=DartAd_374977&w=990&ad=http%3A//ad.doubleclick.net/adj/dmd.ehow/careers%3Bcat%3Dcareerswork%3Bscat%3Dcareers%3Bsscat%3Dfinancejobs%3Bart%3D5135%3Bvid%3D0%3Bctype%3Darticles%3Bugc%3D0%3Blvl%3D4%3Bsz%3D990x90%2C728x90%3Bdx%3D10446%3Bdx%3D10406%3Bu%3Dcat-careerswork_scat-careers_sscat-financejobs_art-5135_dmd-05BA5153-4DDE-451A-A2C4-714BD0CA0244%3Btile%3D2%3Bord%3D2362071231035%3F', 'http://www.ehow.com/how_5135_become-stockbroker.html']
['2011-09-29 15:19:36', '127.0.0.1', 'pageunload', 'http://www.ehow.com/media/ad.html?divId=DartAd_7421339&w=300&ad=http%3A//ad.doubleclick.net/adj/dmd.ehow/careers%3Bcat%3Dcareerswork%3Bscat%3Dcareers%3Bsscat%3Dfinancejobs%3Bart%3D5135%3Bvid%3D0%3Bctype%3Darticles%3Bugc%3D0%3Blvl%3D4%3Bsz%3D300x250%2C300x600%3Bdx%3D10446%3Bdx%3D10406%3Bu%3Dcat-careerswork_scat-careers_sscat-financejobs_art-5135_dmd-05BA5153-4DDE-451A-A2C4-714BD0CA0244%3Btile%3D2%3Bord%3D2362071231035%3F', 'http://www.ehow.com/how_5135_become-stockbroker.html']
['2011-09-29 15:19:36', '127.0.0.1', 'pageunload', 'http://platform.twitter.com/widgets/tweet_button.html']
['2011-09-29 15:19:36', '127.0.0.1', 'pageunload', 'http://fast.dm.demdex.net/DSD-gz/dm-dest.html?', 'http://www.ehow.com/how_5135_become-stockbroker.html']
['2011-09-29 15:19:36', '127.0.0.1', 'pageunload', 'http://www.facebook.com/plugins/like.php?api_key=63203377906&channel_url=http%3A%2F%2Fstatic.ak.fbcdn.net%2Fconnect%2Fxd_proxy.php%3Fversion%3D3%23cb%3Df30eefd2d6ffc42%26origin%3Dhttp%253A%252F%252Fwww.ehow.com%252Ff1efccd69b660c%26relation%3Dparent.parent%26transport%3Dpostmessage&extended_social_context=false&font=arial&href=http%3A%2F%2Fwww.ehow.com%2Fhow_5135_become-stockbroker.html&layout=button_count&locale=en_US&node_type=link&ref=like&sdk=joey&send=true&show_faces=false&width=150', 'http://www.ehow.com/how_5135_become-stockbroker.html']
['2011-09-29 15:19:36', '127.0.0.1', 'pageunload', 'http://www.facebook.com/plugins/likebox.php?api_key=63203377906&channel=http%3A%2F%2Fstatic.ak.fbcdn.net%2Fconnect%2Fxd_proxy.php%3Fversion%3D3%23cb%3Dfd7c12c9714096%26origin%3Dhttp%253A%252F%252Fwww.ehow.com%252Ff1efccd69b660c%26relation%3Dparent.parent%26transport%3Dpostmessage&colorscheme=light&header=true&height=62&href=http%3A%2F%2Fwww.facebook.com%2Fehow&locale=en_US&sdk=joey&show_faces=false&stream=false&width=265', 'http://www.ehow.com/how_5135_become-stockbroker.html']
['2011-09-29 15:19:36', '127.0.0.1', 'pageunload', 'http://www.facebook.com/plugins/like.php?api_key=63203377906&channel_url=http%3A%2F%2Fstatic.ak.fbcdn.net%2Fconnect%2Fxd_proxy.php%3Fversion%3D3%23cb%3Df10a684606003ea%26origin%3Dhttp%253A%252F%252Fwww.ehow.com%252Ff1efccd69b660c%26relation%3Dparent.parent%26transport%3Dpostmessage&extended_social_context=false&font=arial&href=http%3A%2F%2Fwww.ehow.com%2Fhow_5135_become-stockbroker.html&layout=button_count&locale=en_US&node_type=link&ref=like&sdk=joey&send=true&show_faces=false&width=150', 'http://www.ehow.com/how_5135_become-stockbroker.html']
['2011-09-29 15:19:36', '127.0.0.1', 'pageunload', 'http://platform.twitter.com/widgets/tweet_button.html']
['2011-09-29 15:19:37', '127.0.0.1', 'pageload', 'http://www.google.ee/']
['2011-09-29 15:19:58', '127.0.0.1', 'pageunload', 'http://www.google.ee/']
['2011-09-29 15:19:59', '127.0.0.1', 'pageload', 'http://www.amazon.com/Investing-Dummies-Eric-Tyson/dp/047090545X', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=1&sqi=2&ved=0CDgQFjAA&url=http%3A%2F%2Fwww.amazon.com%2FInvesting-Dummies-Eric-Tyson%2Fdp%2F047090545X&ei=moyETtXRDYK2hQeR-4DxDA&usg=AFQjCNE87PjWkbsRWMjLIRLdGKtORH1kQg']
['2011-09-29 15:20:06', '127.0.0.1', 'pageunload', 'http://www.amazon.com/Investing-Dummies-Eric-Tyson/dp/047090545X', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=1&sqi=2&ved=0CDgQFjAA&url=http%3A%2F%2Fwww.amazon.com%2FInvesting-Dummies-Eric-Tyson%2Fdp%2F047090545X&ei=moyETtXRDYK2hQeR-4DxDA&usg=AFQjCNE87PjWkbsRWMjLIRLdGKtORH1kQg']
['2011-09-29 15:20:07', '127.0.0.1', 'pageload', 'http://www.amazon.com/gp/reader/047090545X/ref=sib_dp_pt']
['2011-09-29 15:22:29', '127.0.0.1', 'pageunload', 'http://www.amazon.com/gp/reader/047090545X/ref=sib_dp_pt']
['2011-09-29 15:22:29', '127.0.0.1', 'pageload', 'http://www.amazon.com/Investing-Dummies-Eric-Tyson/dp/047090545X', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=1&sqi=2&ved=0CDgQFjAA&url=http%3A%2F%2Fwww.amazon.com%2FInvesting-Dummies-Eric-Tyson%2Fdp%2F047090545X&ei=moyETtXRDYK2hQeR-4DxDA&usg=AFQjCNE87PjWkbsRWMjLIRLdGKtORH1kQg']
['2011-09-29 15:22:30', '127.0.0.1', 'pageunload', 'http://www.amazon.com/Investing-Dummies-Eric-Tyson/dp/047090545X', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=1&sqi=2&ved=0CDgQFjAA&url=http%3A%2F%2Fwww.amazon.com%2FInvesting-Dummies-Eric-Tyson%2Fdp%2F047090545X&ei=moyETtXRDYK2hQeR-4DxDA&usg=AFQjCNE87PjWkbsRWMjLIRLdGKtORH1kQg']
['2011-09-29 15:22:30', '127.0.0.1', 'pageload', 'http://www.google.ee/']
['2011-09-29 15:22:33', '127.0.0.1', 'pageunload', 'http://www.google.ee/']
['2011-09-29 15:22:35', '127.0.0.1', 'pageload', 'http://www.dummies.com/how-to/personal-finance/investing.html', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=2&ved=0CEAQFjAB&url=http%3A%2F%2Fwww.dummies.com%2Fhow-to%2Fpersonal-finance%2Finvesting.html&ei=No2ETpPTLsnAhAf1nbH2DA&usg=AFQjCNEm-bwJsHaVqBB4luxHQW7q2XTtfQ']
['2011-09-29 15:22:38', '127.0.0.1', 'pageunload', 'http://www.dummies.com/how-to/personal-finance/investing.html', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=2&ved=0CEAQFjAB&url=http%3A%2F%2Fwww.dummies.com%2Fhow-to%2Fpersonal-finance%2Finvesting.html&ei=No2ETpPTLsnAhAf1nbH2DA&usg=AFQjCNEm-bwJsHaVqBB4luxHQW7q2XTtfQ']
['2011-09-29 15:22:38', '127.0.0.1', 'pageload', 'http://www.google.ee/']
['2011-09-29 15:22:49', '127.0.0.1', 'pageunload', 'http://www.google.ee/']
['2011-09-29 15:22:51', '127.0.0.1', 'pageload', 'http://www.dummies.com/store/Business-Investing-Careers/Personal-Finance-Investments/Investing.html', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=3&ved=0CEgQFjAC&url=http%3A%2F%2Fwww.dummies.com%2Fstore%2FBusiness-Investing-Careers%2FPersonal-Finance-Investments%2FInvesting.html&ei=No2ETpPTLsnAhAf1nbH2DA&usg=AFQjCNHRENPT-DgbHNL_ZjvMLJizByLZiw']
['2011-09-29 15:22:55', '127.0.0.1', 'pageunload', 'http://www.dummies.com/store/Business-Investing-Careers/Personal-Finance-Investments/Investing.html', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=3&ved=0CEgQFjAC&url=http%3A%2F%2Fwww.dummies.com%2Fstore%2FBusiness-Investing-Careers%2FPersonal-Finance-Investments%2FInvesting.html&ei=No2ETpPTLsnAhAf1nbH2DA&usg=AFQjCNHRENPT-DgbHNL_ZjvMLJizByLZiw']
['2011-09-29 15:22:55', '127.0.0.1', 'pageload', 'http://s7.addthis.com/static/r07/sh56.html']
['2011-09-29 15:22:56', '127.0.0.1', 'pageload', 'http://www.dummies.com/store/product/Candlestick-Charting-For-Dummies.productCd-0470178086.html', 'http://www.dummies.com/store/Business-Investing-Careers/Personal-Finance-Investments/Investing.html']
['2011-09-29 15:23:00', '127.0.0.1', 'pageunload', 'http://www.dummies.com/store/product/Candlestick-Charting-For-Dummies.productCd-0470178086.html', 'http://www.dummies.com/store/Business-Investing-Careers/Personal-Finance-Investments/Investing.html']
['2011-09-29 15:23:00', '127.0.0.1', 'pageunload', 'http://s7.addthis.com/static/r07/sh56.html']
['2011-09-29 15:23:01', '127.0.0.1', 'pageload', 'http://www.dummies.com/store/Business-Investing-Careers/Personal-Finance-Investments/Investing.html', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=3&ved=0CEgQFjAC&url=http%3A%2F%2Fwww.dummies.com%2Fstore%2FBusiness-Investing-Careers%2FPersonal-Finance-Investments%2FInvesting.html&ei=No2ETpPTLsnAhAf1nbH2DA&usg=AFQjCNHRENPT-DgbHNL_ZjvMLJizByLZiw']
['2011-09-29 15:23:02', '127.0.0.1', 'pageunload', 'http://www.dummies.com/store/Business-Investing-Careers/Personal-Finance-Investments/Investing.html', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=3&ved=0CEgQFjAC&url=http%3A%2F%2Fwww.dummies.com%2Fstore%2FBusiness-Investing-Careers%2FPersonal-Finance-Investments%2FInvesting.html&ei=No2ETpPTLsnAhAf1nbH2DA&usg=AFQjCNHRENPT-DgbHNL_ZjvMLJizByLZiw']
['2011-09-29 15:23:02', '127.0.0.1', 'pageload', 'http://www.google.ee/']
['2011-09-29 15:23:06', '127.0.0.1', 'pageunload', 'http://www.google.ee/']
['2011-09-29 15:23:07', '127.0.0.1', 'pageload', 'http://www.buzzle.com/articles/beginner-stock-market-investing-dummies.html', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=6&ved=0CGUQFjAF&url=http%3A%2F%2Fwww.buzzle.com%2Farticles%2Fbeginner-stock-market-investing-dummies.html&ei=No2ETpPTLsnAhAf1nbH2DA&usg=AFQjCNEhwdO6agnvekEFRxxHVGHuE2nRlQ']
['2011-09-29 15:24:02', '127.0.0.1', 'pageunload', 'http://www.buzzle.com/articles/beginner-stock-market-investing-dummies.html', 'http://www.google.ee/url?sa=t&rct=j&q=investing%20for%20dummies&source=web&cd=6&ved=0CGUQFjAF&url=http%3A%2F%2Fwww.buzzle.com%2Farticles%2Fbeginner-stock-market-investing-dummies.html&ei=No2ETpPTLsnAhAf1nbH2DA&usg=AFQjCNEhwdO6agnvekEFRxxHVGHuE2nRlQ']
['2011-09-29 15:24:02', '127.0.0.1', 'pageload', 'http://www.google.ee/']
['2011-09-29 15:24:23', '127.0.0.1', 'pageunload', 'http://www.google.ee/']
['2011-09-29 15:24:25', '127.0.0.1', 'pageload', 'http://www.investopedia.com/controls/top_nav/HeaderFreeNewsletters.aspx', 'http://www.investopedia.com/ask/answers/08/minimum-amounts-of-money-to-start-trading.asp']
['2011-09-29 15:24:25', '127.0.0.1', 'pageload', 'http://www.investopedia.com/controls/top_nav/login_header_nd.aspx', 'http://www.investopedia.com/ask/answers/08/minimum-amounts-of-money-to-start-trading.asp']
['2011-09-29 15:24:25', '127.0.0.1', 'pageload', 'http://www.investopedia.com/ask/answers/08/minimum-amounts-of-money-to-start-trading.asp']
['2011-09-29 15:24:25', '127.0.0.1', 'pageload', 'http://www.facebook.com/plugins/like.php?href=http://www.investopedia.com/ask/answers/08/minimum-amounts-of-money-to-start-trading.asp?partner=facebook&layout=button_count&show_faces=false&width=90&action=like&font=arial&colorscheme=light&height=21', 'http://www.investopedia.com/ask/answers/08/minimum-amounts-of-money-to-start-trading.asp']
['2011-09-29 15:25:55', '127.0.0.1', 'pageunload', 'http://www.investopedia.com/controls/top_nav/login_header_nd.aspx', 'http://www.investopedia.com/ask/answers/08/minimum-amounts-of-money-to-start-trading.asp']
['2011-09-29 15:25:55', '127.0.0.1', 'pageunload', 'http://www.investopedia.com/controls/top_nav/HeaderFreeNewsletters.aspx', 'http://www.investopedia.com/ask/answers/08/minimum-amounts-of-money-to-start-trading.asp']
['2011-09-29 15:25:55', '127.0.0.1', 'pageunload', 'http://www.investopedia.com/ask/answers/08/minimum-amounts-of-money-to-start-trading.asp']
['2011-09-29 15:25:55', '127.0.0.1', 'pageunload', 'http://www.facebook.com/plugins/like.php?href=http://www.investopedia.com/ask/answers/08/minimum-amounts-of-money-to-start-trading.asp?partner=facebook&layout=button_count&show_faces=false&width=90&action=like&font=arial&colorscheme=light&height=21', 'http://www.investopedia.com/ask/answers/08/minimum-amounts-of-money-to-start-trading.asp']
['2011-09-29 15:25:55', '127.0.0.1', 'pageload', 'http://www.google.ee/']
['2011-09-29 15:25:58', '127.0.0.1', 'pageunload', 'http://www.google.ee/']
['2011-09-29 15:25:59', '127.0.0.1', 'pageload', 'http://www.youtube.com/watch?v=6-BJG5pXAHM', 'http://www.google.ee/url?sa=t&rct=j&q=how%20much%20money%20for%20trading&source=web&cd=2&sqi=2&ved=0CEQQtwIwAQ&url=http%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D6-BJG5pXAHM&ei=oY2ETr7OLZCh-QbC6oUk&usg=AFQjCNFt5dmd-qkp6C996gc6hVSlO8NnGw']
['2011-09-29 15:26:01', '127.0.0.1', 'pageunload', 'http://www.youtube.com/watch?v=6-BJG5pXAHM', 'http://www.google.ee/url?sa=t&rct=j&q=how%20much%20money%20for%20trading&source=web&cd=2&sqi=2&ved=0CEQQtwIwAQ&url=http%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D6-BJG5pXAHM&ei=oY2ETr7OLZCh-QbC6oUk&usg=AFQjCNFt5dmd-qkp6C996gc6hVSlO8NnGw']
['2011-09-29 15:26:01', '127.0.0.1', 'pageload', 'http://www.youtube.com/watch?hl=et&v=6-BJG5pXAHM', 'http://www.youtube.com/watch?v=6-BJG5pXAHM']
['2011-09-29 15:26:19', '127.0.0.1', 'pageunload', 'http://www.youtube.com/watch?hl=et&v=6-BJG5pXAHM', 'http://www.youtube.com/watch?v=6-BJG5pXAHM']
['2011-09-29 15:26:20', '127.0.0.1', 'pageload', 'http://www.youtube.com/watch?v=QRZ3KuNjNn0&feature=related', 'http://www.youtube.com/watch?hl=et&v=6-BJG5pXAHM']
['2011-09-29 15:27:00', '127.0.0.1', 'pageunload', 'http://www.youtube.com/watch?v=QRZ3KuNjNn0&feature=related', 'http://www.youtube.com/watch?hl=et&v=6-BJG5pXAHM']
['2011-09-29 15:27:00', '127.0.0.1', 'pageload', 'http://www.youtube.com/watch?hl=et&v=6-BJG5pXAHM', 'http://www.youtube.com/watch?v=6-BJG5pXAHM']
['2011-09-29 15:27:02', '127.0.0.1', 'pageunload', 'http://www.youtube.com/watch?hl=et&v=6-BJG5pXAHM', 'http://www.youtube.com/watch?v=6-BJG5pXAHM']
['2011-09-29 15:27:02', '127.0.0.1', 'pageload', 'http://www.youtube.com/watch?v=6-BJG5pXAHM', 'http://www.google.ee/url?sa=t&rct=j&q=how%20much%20money%20for%20trading&source=web&cd=2&sqi=2&ved=0CEQQtwIwAQ&url=http%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D6-BJG5pXAHM&ei=oY2ETr7OLZCh-QbC6oUk&usg=AFQjCNFt5dmd-qkp6C996gc6hVSlO8NnGw']
['2011-09-29 15:27:03', '127.0.0.1', 'pageunload', 'http://www.youtube.com/watch?v=6-BJG5pXAHM', 'http://www.google.ee/url?sa=t&rct=j&q=how%20much%20money%20for%20trading&source=web&cd=2&sqi=2&ved=0CEQQtwIwAQ&url=http%3A%2F%2Fwww.youtube.com%2Fwatch%3Fv%3D6-BJG5pXAHM&ei=oY2ETr7OLZCh-QbC6oUk&usg=AFQjCNFt5dmd-qkp6C996gc6hVSlO8NnGw']
['2011-09-29 15:27:04', '127.0.0.1', 'pageload', 'http://www.google.ee/']
['2011-09-29 15:27:09', '127.0.0.1', 'pageunload', 'http://www.google.ee/']
['2011-09-29 15:27:11', '127.0.0.1', 'pageload', 'http://www.babypips.com/school/capitalization.html', 'http://www.google.ee/url?sa=t&rct=j&q=how%20much%20money%20for%20trading&source=web&cd=4&sqi=2&ved=0CFUQFjAD&url=http%3A%2F%2Fwww.babypips.com%2Fschool%2Fcapitalization.html&ei=oY2ETr7OLZCh-QbC6oUk&usg=AFQjCNFCKHv6Ts4lxfZAOGDn_TFgetUhrQ']
['2011-09-29 15:27:18', '127.0.0.1', 'pageunload', 'http://www.babypips.com/school/capitalization.html', 'http://www.google.ee/url?sa=t&rct=j&q=how%20much%20money%20for%20trading&source=web&cd=4&sqi=2&ved=0CFUQFjAD&url=http%3A%2F%2Fwww.babypips.com%2Fschool%2Fcapitalization.html&ei=oY2ETr7OLZCh-QbC6oUk&usg=AFQjCNFCKHv6Ts4lxfZAOGDn_TFgetUhrQ']
['2011-09-29 15:27:18', '127.0.0.1', 'pageload', 'http://www.google.ee/']
['2011-09-29 15:27:36', '127.0.0.1', 'pageunload', 'http://www.google.ee/']

Problems encountered:

* Logger crashed (log included)!
* User cannot write down the answer in the post-task form -> solution: add a textarea.
* Amazon "Look Inside" feature does not work!
* Side-videos on Youtube do not show up.
* Copy-paste detection would be nice because this can point to relevant information on web pages.
* Bookmarking would also help to detect relevant stuff for the same reason.
* Black list ads in Privoxy!
* onSubmit, onClick should be also logged.

All for now, thank you for reading.

I'm making some progress! [configuration-wise]

2011-03-16T11:15:00.000+02:00

My main efforts have gone to getting the SearchLogger server side working. It never worked on Windows but now it works perfectly on Linux. I also reverted from XAMPP back to traditional PHP 5 + Apache 2 + MySQL 5. The setup script worked just fine and no problems persists on the server side.

Client side, the logger itself, is another story. I managed to successfully compile both the single-session and multi-session versions (./compile.sh searchLogger) but there by luck ended. Firefox will not accept the .xpi because something is missing. Has anyone had anything similar?

This post was rather technical and configuration-related. I've also studied Drupal and Wordpress capabilities for the task ahead but this takes a few more hours to complete.

SearchLogger server installation and 'stealing' user authentication for the repository from some CMS

2011-03-09T13:27:00.001+02:00

Hi again!

I have been trying to get the searchlogger server working properly on Windows. So far, no luck. I have tested running the setup file on WAMPServer as well as on EasyPHP bundles and it looks ugly. Will try on Linux as well (now that I have Ubuntu 10.10 finally installed ;-)).

Elsewhere, I have also been trying Drupal 7.0, Wordpress 3.1, Joomla 1.6 and Spip 2.1.8 as EasyPHP modules. Drupal and Wordpress can certainly provide authentication capabilities for the website. Not sure about Joomla ad Spip at this stage yet.

Some interesting findings:
1) A guy integrates his ZenPhoto with Wordpress in a way that if you are logged into WordPress, you are also logged into ZenPhoto. See how! This is rather out-of-date though.
2) Drupal authentication is not clear to me yet even though it exists. I did not stumble upon good tutorials on this but I will keep searching.

Welcome! Opening post

2011-02-16T10:18:00.001+02:00

Hello and welcome to my blog! I am Peeter Jürviste and over the coming weeks I will be posting about the progress made and problems encountered in developing a search task repository. It is a case study in collaborative search and an interesting challenge for me and hopefully the working solution will make your complex search tasks much easier and less time consuming.

Please also visit the Distributed Systems Group site from University of Tartu.

My next post will be about tasks to be solved and technologies used in the project.

Bye!