TRIP in the FT

Spotted by Sir Iain Chalmers, who generously sent me a copy. It was included in the article Under pressure.

TRIP Evidence Reviews

We like to experiment with new formats for the information we come across. Due to our involvement with post-graduate CME work, we've happened across a format we quite like! As part of our work we've been asked to produce a number of 'evidence reviews' around specific topic areas. If you view the examples below you'll see what we mean. I think we will be producing a significant number of these...

• Osteoporosis
• Migraine

As well as our manual uploading of new material there are a number of dynamic (and pseudo-dynamic elements):

• The latest articles in Medline is powered by an RSS feed.
• The news is powered by Google news.
• At the foot of the page is the ability to do, easy, live searches of relevant material.

Feel free to comment....

TRIP around the world

I was reviewing a number of e-mails we'd received recently. Shortly afterwards Google announced their Google Maps venture. This allows users to easily create custom maps. Putting two and two together I got TRIP around the world, which is simply a list of contacts we've received since March 2007. Click here to view the map.

If you want to feature then contact us via this form. As well as saying hello and where you're from feel free to let us know your thoughts about TRIP. For instance how you use it, what you use it for, any improvements you'd like to see. Also, let us know if you're happy to use your name or simply post it anonymously.

PubMed reaches 17 million

On April 20, 2007, the number of citations in PubMed surpassed 17 million (see NLM technical bulletin.)

Interestingly, the TRIP paper "Using the Turning Research Into Practice (TRIP) database: how do clinicians really search?" was added on the 20th April. So there is a chance (albeit remote) that the TRIP paper was the 17 millionth!

Interesting sites

A few sites that have caught my eye recently:

• Open Medicine, for more information read the stimulating editorial Why Open Medicine?
• Who is Sick? View the site, you'll get the idea.
• VideoLectures.net, not much on health but has potential.

TRIP in print

A while ago I worked with the Centre of Evidence-Based Medicine (Oxford) on an evaluation of TRIP**. The review was extremely helpful and TRIP benefitted greatly from it.

Anyway, the evaluation has been published in April's Journal of the Medical Library Association (JMLA) - Using the Turning Research Into Practice (TRIP) database: how do clinicians really search?

In the same edition of the JMLA, in their Electronic Resources Reviews, was a review of TRIP. This was very positive and the concluding paragraph reports:

"The TRIP database has come a long way from its conception. The reader may wish to consult a 2002 review of the database . The thought put into the design and improvements made to this resource prove that it is truly dedicated to the practice of evidence-based medicine."

** Thinking about it, the actual evaluation was around two years ago and since then we've had one major upgrade and another one due - perhaps we need to think about having another one!

Presentations

It's always nice to be asked to give presentations, to talk about TRIP, Q&A and related topics. A recent invite came with many apologies as they weren't sure who to contact, if it was appropriate to ask etc. I like to think of myself and TRIP as being very approachable! So, if you have an event and want me to present, just let me know via the Contact Us form on TRIP.

The development process

In the post of last Thursday I highlighted the new 'conclusions' feature. I thought I would share more on the development process!

The development process starts with ideas. We tend to have a number of in-house ideas for where we want to go. These can come from our own experience of using TRIP, developments in other areas of search, or by reading research papers. A good example of the latter being my desire to have snippets on TRIP after reading a research article produced by Microsoft (click here for details). As it happens I don't like the snippets, hence insisting on the ability to switch snippets on and off. These in-house ideas are supplemented by a number of ideas suggested by users. We don't get a great deal (which may be a good sign) but enough to make us stop and think.

The next step is to decide the available budget and go and see the excellent Sequence, who have been the web-developers of TRIP for around 5 years (ever since I stopped producing it myself). I go and see them with a wish list. I tend to understand the way they work and have a rough idea of costs before I see them! Once we've agreed costs and scope, a project plan is drawn up. This typically has a delivery time of 6-12 weeks, depending on the size and complexity of the changes. I then leave Sequence to get on with things, occasionally nagging them, occasionally altering the plans - I think they've come to expect it.

What they deliver first is a development version for me to look at and test. Frequently grim to look at but nonetheless useful for me to see if things 'feel' right. They also can send me designs to check out. At the foot of this post are two examples. The first is a screenshot of the latest development site. Messy, but you can see the alteration to the Google Ads (two versions for some reason, there will be only one in the live version), you've got the snippets (and the toggle snippets on and off button), an RSS feed button, an 'i' button (which reveals the conclusions), a symbol highlighting PDFs. Below that is a design, the layout is good, but I'm not a big fan of lilac/pink. So Sequence will alter the colour scheme and then merge that look and feel with the functionality of the development site.

Easy really.

Conclusions on TRIP

We've just got to review the implementation of the 'conclusions' feature on TRIP. This allows users to view the conclusions from various documents that have conclusions (so not all). Click on the image below to see how it'll look. I think this will be a very popular and powerful new feature!

Update on various bits and bobs (2)

A week ago I posted on changes to TRIP - guess what? Some last minute changes!

It relates to the integration of TRIP with Gwagle! We've decided to postpone the newsletter idea for now and use the resource to gently integrate Gwagle.

From a user perspective this will involve the ability to comment on articles in TRIP. So, on the results page, each article will have a button to make comments and view exisiting comments (if they exist). Clicking on either button will take users to a co-branded TRIP and Gwagle area (not that we've got a strong brand for Gwagle!) which will allow users to comment on articles. These comments will appear in TRIP but will also be added to Gwagle - so populating Gwagle. In addition users will be encouraged/enticed to explore Gwagle.

We're really excited by this development but it will postpone the rollout of changes for another 4 weeks(ish) - so looks like early/mid May!

Search fixes

We've fixed the various search bugs!

It's been apparent for a while now that various search functions have stopped working! They didn't affect the basic search function but revolved around the use of boolean and brackets.

It has been a long process (too long) for us to fix them. But the fixes were rolled out today.

Draft Blogger's Code of Conduct

View here.

Synonyms and TRIP

An early review of TRIP (click here) was interesting to read, at the time. Probably being biased, I felt it was a lazy review, although the concluding comments were good:

"TRIP offers a friendly interface and quick access to the evidence (particularly if the search is limited to titles) with user friendly organisation of search results. We recommend this resource for those seeking pre-appraised evidence, reviews, and guidelines."

One issue they highlighted was the lack of a synonyms function. So, we set about creating one! To do this we took a list of the top 8,000 search terms used in TRIP (covering around 70% of all search terms) and manually produced a list of synonyms. This was time consuming and hard work. However, when produced it worked pretty well.

Probably 3 years ago we started to use the metathesaurus function of the UMLS system produced by the American National Library for Health. This was an automated project facilitated by the MMTx program (a java-based, public, approximation to the full-blown MetaMap system). This complimented the manual synonym function. Unfortunately, this was too slow, so we had to abandoned it. However, we've recently had some interesting news from those behind MMTx. The full program is likely to be released and will be considerably quicker than MMTx. So we're hoping to re-introduce this as soon as it's available. This should add an extra layer of synonym functionality

Anyway, why am I blogging this? Well I've just finished the latest edit of the manual synonym look-up table. It's taken an awful lot of man-hours spread out over two months. We've weeded out ambiguity, added new synonyms - all to make recall better!

This will be rolled out with the current round of updates.

Update on various bits and bobs

It's been exceptionally busy for us, although I doubt we've worked as hard as our servers. Due to this workload I've been a bit slack in updating on our various projects, so here goes.

TRIP Update
For a number of reasons, mainly me changing my mind half way through, the update is delayed and will hopefully be released mid/late April. It seems to be dragging on but we've had to make some changes. So, the final list of changes are:

• RSS feed. Each search can now be outputted as an RSS feed
• Mark PDF records. Some people really don't like PDFs - we'll now mark them for you on the results page.
• Conclusions. A number of documents have conclusions and our system has been programmed to grab them. Users, if they wish, will be able to view the conclusion by placing their mouse over the 'Conclusions' button
• Snippets. Most search engines generate snippets of text to help improve the context of the results. These have shown to improve search recall significantly, hence us adopting them. From a personal perspective I'm not convinced, so I'm trying to make these 'switch offable'. It seems the pragmatic decision to me.
• Advanced search. This has been significantly improved in terms of both functionality and accuracy (we've been experiencing a few problems on that front).
• Redesign. As I've mentioned previously our revenue from Google Ads has been woeful. We've been communicating with Google to improve thing. The first stage of which is to move the adverts to a more prominent position. It's a shame, but we need money to further improve! Coupled with that is the inclusion of snippets. The net effect of this is to take up more space on the screen (apparently it's called screen 'real estate'). So we're going to redesign the screens to free up more space.

In addition to these immediate changes we'll be producing a e-newsletter for the 2,000+ registered users on TRIP sometime in the near future. There are some great examples which help keep communication going between organisations and users. The blog is one way, and is read by a small number of people (around 250 per week), but an e-newsletter gives us other options.

Gwagle

The alpha is going very slowly. We're not 100% sure why although we believe that the alpha-testers are too busy to go to a site, add stuff and get relatively little in return. For Gwagle to be useful we need to have an active community. We've decided this route isn't the most useful. Part of our re-think is to integrate the site, much earlier than initially anticipated, with TRIP. TRIP gets large amounts of traffic (nearly 150,000 searches last week) and so if we can make using Gwagle meaningful to TRIP users we're sure things will develop more meaningfully. We'll keep you posted on those developments. But, if you fancy giving Gwagle a go, let us know via 'Contact us'.

Research on Q&A

Nothing major to report except that we've started some question analysis. We've been wanting to for ages. With around 5,000 genuine clinical questions from NLH Q&A and 2,000+ from ATTRACT that's a large pool of data. The big downside is that writing is not hugely motivational for me, that goes for writing articles, writing up my PhD (never finished, so in good company there) and writing research grants. As my supervisor said - the only way to write a PhD is to write a PhD. His obvious 'flair' for motivation missed me ;-)

The Impending Social Search Inflection Point

"As articulated by Chris Sherman, social search is information retrieval, way finding tools informed by human judgment. Social search is people helping people find stuff, including allowing users to ask plain English questions and get plain English answers. It's collaborative content harvesting, directory building, voting and ranking, sharing, tagging, commenting on bookmarks, web pages, news, images, videos and podcasts. Social search reflects the wisdom of crowds."

Read more here.

Hurrah

This is not an April Fool, but TRIP has broken the half a million searches per month. In fact, for March, we were searched 515,191 times (that's 3,873,391 page views). We were helped in breaking this mark by a significant upswing in searches towards the end of the month, most over 20,000 searches per day, and two over 25,000.

The 515, 191 gives an average daily search of 16,619. So, if we maintain seach figures for 20,000+ searches, we'll be having another, predictable, post on 1st May!