Performance Data Now Available

Find performance data by following the Performance Data menu item at the left on a tool/resource summary page.

View Example of Performance Data

Providing Performance Information about Tools and Resources

Since its inception, NITRC has provided answers to basic questions to help with the selection of neuroimaging software: What does this tool do? What platforms does it run on? What license is it released under? NITRC now takes a step further by providing performance information about tools: How long does it take to run? How well does it perform a given function? Exposing this information before software is downloaded and installed, let alone run, will save time when selecting a tool for a given analysis and will provide insights on the best tool for a task.

NITRC now reports performance data for image segmentation. For segmentation tools, we report run time, accuracy compared to Internet Brain Segmentation Repository data, and test-retest stability using Brain Segmentation Testing Protocol data. Sample images of segmentation results are also provided for qualitative analysis of results.

While much of this data can be used to compare tools, care should be taken not to jump from narrowly defined metrics to broad judgements of quality. Indeed, most metrics, even if they can be expressed quantitatively, do not map simply to quality. By the same token, these metrics express nuanced functional performance that can help distinguish tools and select the best option for a given analysis.

Find performance data by following the Performance Data menu item at the left on a tool's main page. (See, for example, FreeSurfer.) Stay tuned as we expand performance data to other functions in the future and send any feedback you have to

— Christian Haselgrove, NITRC Co-PI

FreeSurfer Comparison Details Image 1
FreeSurfer Comparison Details Image 2

Register a New Tool/Resource with its RRID

Adding your tool/resource to NITRC has never been easier! By using its RRID, you can pre-populate many fields withing the registration process (you must be logged in to register a tool/resource. Register Your Tool/Resource Here >


Use NITRC-CE for Your Data Analysis

Planning to do any big data crunching, or even moderate data crunching? Look into the NITRC Computational Environment (NITRC-CE). NITRC-CE Makes it easy to run your favorite tools on Amazon Web Services just like you do on your own computer. This is a great alternative to tying up your own computer for a long period and is probably more affordable than you think. For example, you can do cortical parcellation using KWYK in just seconds for less than the cost of a cup of coffee...! Visit NITRC-CE >

Copyright (C) 2022 NeuroImaging Tools and Resources Collaboratory. All rights reserved.

Update Preferences | Unsubscribe