Search

Trip Database Blog

Liberating the literature

Category

Uncategorized

What is Trip’s Community Q&A (Beta)

In a nutshell it’s a system to support Trip users to obtain answers to their clinical questions. It’s not designed to replace Trip, more like compliment it. You may not have been able to fuller answer your question, be stuck on the meaning of a passage, the nuance of a paper or the meaning of a statistical test.  We’ve developed this powerful solution to harness the wonderfulness of the Trip Community (over 100,000 registered users).

The steps are as follows:

  • If you can’t find the answer in Trip you record your question via the ‘Ask a question’ link.
  • We send it to members of the Trip community who we feel are best placed to answer it. For instance, you may have a question on heart failure – we’d email it to users with an interest in heart failure and/or cardiology.
  • It is anticipated/hoped that at least one of those emailed will answer your question.
  • Quality is important and users will be able to upvote an answer (if they like it) or downvote it if they don’t! People answering the questions will be encouraged to reference their answers.

By contributing to this service as a member of the Trip community you’ll be sharing your knowledge to support healthcare around the globe and creating a system that you too may use if you find yourself struggling for an answer.

The Q&A system falls within our new Trip Learning Environment (Triple) a concept whereby users share and learn – in a non-critical manner – from each other. The Q&A is the first system we’re introducing but others will follow afterwards.

The system is a beta as we’re wanting people to test it to see that it works well and highlight any problems (a beta signifies a non-finished, test version of a feature). This should not be onerous, we simply want you to join up to the system and have an explore. It would be great if you asked a question or responded to a question should you know the answer. The test will be over a month or so and we are not anticipating lots of activity – just enough for people to get a feel for it.

Email me via jon.brassey@tripdatabase.com if you’re wanting to help test it.

Trip’s community Q&A service – request for volunteers to test the system!

Trip’s main focus is on answering the clinical questions of health professionals. Searching Trip is great – but not perfect. Our community Q&A is there if you can’t find the answer you want/need.

The concept is simple, a user posts a question and we send it to the health professionals – registered on Trip – who we feel are best placed to be able to answer them.  Hopefully one or more will respond.

We’ve previously asked our users about this idea and the vast majority were highly supportive and gave us excellent feedback – which we’ve incorporated into the design of the service.  So, the next step is to test the system we’ve built.

Please let us know if you’re interested in testing the system. Time commitments is up to you and should be minimal. You can ask questions, answer questions or simply observe the system working. Testing should start within a week or two.

If you’re interested please email me jon.brassey@tripdatabase.com

Eight new publications added to Trip

Trip is loved because it’s easy to use and allows users to quickly identify high-quality evidence. A clear prerequisite is to have lots of high-quality evidence! As such we’re always on the look out for such content and this month has been a bumper month – with the inclusion of eight new publishers. Many of these were identified by reviewing the latest CADTH Grey Matters tool.

And, one request for you, if you know of any sites which should be included in Trip, please let us know (via comments or email jon.brassey@tripdatabase.com)

Below is the list of newly added content:

  1. Palliative Care Evidence Review Service (Rapid reviews)
  2. EUnetHTA (HTA)
  3. SickKids Reports (Reviews)
  4. SickKids Supportive Care Guidelines (Guidelines)
  5. Washington Health Care Authority (HTA)
  6. Health Information and Quality Authority (HTA)
  7. European Society of Endocrinology (Guidelines)
  8. Pediatric Endocrine Society (Guidelines)

NOTE: These have only just been uploaded and will take up to 72 hours to be indexed and searchable!

Answering clinical questions – positioning survey

Last week I highlighted our plans for a Q&A system to harness the combined intelligence of the Trip community.  In that, I identified two main challenges:

  • Technology – to make the system work
  • User acceptance – how can we explain the system in a way that users can relate to and make sense of (and ultimately use)?

The latter challenge seems much harder and to help us we’ve created a brief survey which we’re hoping as many of you as possible will complete. It should take around 2 minutes – so hopefully time is not a barrier to use.  To undertake the survey please CLICK HERE.

To repeat, please take the survey (CLICK HERE) – your opinion really does count.

Answering clinical questions

Trip started as a service to support clinical question answering. Since then the site has changed dramatically but we still see clinical question answering as the main drive and focus.

But what happens if Trip lets a user down? In other words the user has a question, uses Trip and can’t find an answer! In the last two days we’ve received two questions from users:

  • EBM causation of intervertebral disc herniation?
  • Dexmedetomidine and brain protection: fact or fiction?

Now, I dare say the answer is somewhere in Trip and I imagine that terms like ‘brain protection’ may need clarifying. But, at the heart of it – for whatever reason – the users are struggling.

So, we return to the notion of using Trip’s community to help answer them. There is no doubt that there are people, who are registered on Trip, who will know about disc herniation and dexmedetomidine. They may well be able to easily answer these questions. So, why not send the Qs to those most likely to know the answer?

Well, you may have guessed it, but that’s the plan, to create a community Q&A system. There are a number of challenges, for instance:

  • Technology: linking the Q to those most likely to be able to answer them. We’ve engaged with an external company to work on this problem and we’re feeling very confident that good progress will be made.
  • User engagement: we know many people love Trip and we know we have many registered users (over 100,000) but will a large enough proportion be willing to help their fellow users? We’re thinking yes! But we need to communicate really well to explain what we’re doing and reduce any barriers to community involvement.

No timeline, but now we’re committed I’m hoping we can motor!

 

New search, new server

We’ve just upgraded to a new and more powerful server system – lots of extra memory and speed.

As part of the new system we’ve also improved two other things:

  • Upgraded the version of our search engine technology to the latest version. This has improved many things including my own bugbear – duplicate terms in the title boosting the result. In the old version if a document had the search term(s) mentioned twice in the title it would get a large boost. It didn’t happen often but it was annoying! But it appears that’s been fixed.
  • Improved our indexing of PubMed.  Previously we’d been grabbing all the content from PubMed via eUtilities and we only realised recently that this included all the additional meta-data including things like related articles and cited articles data.  This created false positive results.  Our new indexing will now only grab content from the abstract.  This means results counts are both reduced and more accurate (less noise).

We’ve tested it extensively but if you spot anything strange please let us know.

 

NOTE: I can see the new server but it might take 24 hours for the internet’s address book to point at the new version. If the ‘Evidence Maps’ link at the top of the page is highlighted yellow, you’re still pointing at the old version!

Include all of PubMed in Trip?

Currently Trip includes a sub-set of PubMed. This includes all RCTs and systematic reviews and the content of around 500 ‘core’ journals. In total this represents around 10-15% of all the PubMed content. Putting it another way we have around 3-4 million PubMed records out of around 28 million.

But, to be clear not all records are equal.  Some will be to do with veterinary medicine (e.g. Serum amyloid A and plasma fibrinogen concentrations in horses following emergency exploratory celiotomy)  and others might be very specialised technical articles (e.g. Phase-matched virtual coil reconstruction for highly accelerated diffusion echo-planar imaging). So, we’ll be potentially including extra noise. We can mitigate against that – to a point.

In summary, searching all of PubMed is potentially very useful but there may be downsides. So with that in mind what do you think?

What’s happening?

Currently we are migrating to a new super-duper-shiney new server. This is a fairly large task – hence us being a bit quite recently. We’re hoping to have finished that in the next couple of weeks.

At the same time we’re working on the Trip community feature/service. This is experimental, so no timeline except for my usual impatience to get it delivered!

I’ve just uploaded the latest monthly – manual – batch of content. Most content to Trip gets added automatically but every month (as I have done each month for the last twenty years) I go to a number of sites and manually grab any new content.  At times this manual approach can feel like a bit of a chore, but generally I marvel at the breadth of new content being delivered.  This month I’ve found myself refreshing/boosting our links to Patient Decision Aids.

Finally, our annual accounts have been finalised and our subscription income has reached a key milestone – Trip feels more secure than ever. But I have no plans to allow this to make me feel comfortable. The moment we stop trying to improve is the moment we start to fail. Onwards and upwards.

RCTs in Trip – much improved thanks to RobotReviewer

RCTs are a crucial element of EBM and we’ve had a ‘filter’ for them for years. This allows a user to search and click the ‘Controlled trials’ filter and the results will only show clinical trials.  It’s one of our most used filters.

In the earliest iteration we used our own search filter to identify trials in PubMed and added them to Trip. This was ok, but lots of false negatives (missed trials) and false positives (identified papers as trials which weren’t).  A few years ago we started using the RCTs identified by the wonderful RobotReviewer team.  This used machine learning and made the results dramatically better.

Over the weekend we’ve used the latest version of the RobotReviewer code to make the identification of trials the most accurate yet!  Previously we had identified 479,197 trials but now it’s up to 532,479.  We had thousands of trials labelled as trials which no longer are and thousands we had previously missed. There were also a load of new trials that weren’t in Trip.

This is a brilliant piece of work and we’re indebted to RobotReviewer – thank you.

Summary: We have an easy to search collection of over half a million clinical trials!

Blog at WordPress.com.

Up ↑