Otra vez los índices de impacto y su significado

En este blog he insistido en el hecho de que ya no se evalúa la ciencia por lo que se publica, si no dónde se publica y nos limitamos a «sumar» o «promediar» índices de impacto (Impact Factor, IF) de las revistas en las que se publica en vez de valorar el artículo individualmente. También he insistido en que los IFs se usan «alegremente», muchas veces sin conocer su significado real.

Hoy traigo a esta página un ejemplo espectacular que nos tiene que hacer reflexionar sobre el valor que puede tener el IF de las publicaciones científicas.

Se acaba de publicar el IF correspondiente a los artículos publicados en 2008. Y hay un cambio espectacular. La revista Acta Crystallographica Section A (Foundations of Crystallography) ha aumentado su IF en casi 25 veces, pasado de un digno 2’05  a un espectacular 49’93. ¿Por qué ha sido esto? ¿Ha aumentado la calidad de los artículos publicado? ¿Ha aumentado la exigencia del editor?

NO. La razón es que se ha publicado un artículo excelente y que toda la comunidad cristalográfica llevaba años esperando: A short history of SHELX por George M. Sheldrick, el «inventor» del programa SHELX, que es la herramienta computacional fundamental para refinar estructuras cristalográficas. Este artículo ha sido citado 6653 veces (a 25 de junio de 2010), con casi 6000 citas entre 2008 y 2009.

El segundo artículo más citado de Acta Crystallographica Section A ha sido citado 31 veces, el 10º más citado, 11 veces; hay 17 artículos que han sido citado 2 o una vez y hay 19 artículos que no han sido citados (de un total de 72 artículos publicados en 2008).

Como ya he pedido en este blog, leamos las publicaciones y veamos cuanto se ha citado cada artículo individualmente; especialmente, cuando tengamo que evaluar CVs para plazas, contratos, etc. Si seguimos teniendo en cuenta solo el índice de impacto de las revista, cometeremos injusticias. Si no cambiamos el sistema, solo me queda felicitar a los que hayan publicado en 2008 en Acta Crystallographica Section A, pues tendrán artículos con un IF de casi 50, aunque nunca haya sido citado.

P. D.: Por cierto, os habréis fijado que, sin cambiar prácticamente, la revista ha pasado de ser casi despreciada por los que solo publican por índice de impacto a ser una revista «excelente».

Bernardo Herradón

IQOG-CSIC

herradon@iqog.csic.es

Compartir:

244 comentarios

  1. Started thinking about my own writing differently after reading, and a look at focussetsdirection continued that reflective effect, content that influences how I work rather than just informing what I know is content with the highest kind of impact and this site has triggered some of that reflective influence today on me.

  2. Reading this back to back with a similar piece elsewhere made the quality difference obvious, and a stop at ideasgainvelocity only widened the gap, comparing content side by side is a useful exercise and the gap between this site and average competitors in the space is large enough to be noticeable from the first paragraph.

  3. Quietly the writers approach to the topic differs from the dominant takes I have been encountering, and a stop at focusguidesgrowth extended that distinctive approach, content that maintains a different perspective without explicitly arguing against the dominant ones is content with confident editorial identity and this site has that confidence throughout pieces.

  4. Reading this felt easy in the best way, no friction and no confusion at any point, and a stop at signalshapesdirection carried that same comfort across more pages, the kind of editorial flow that lets you absorb information without fighting the format which is increasingly hard to find on the open web today across topics.

  5. Now setting up a small reminder to revisit the site on a slow day, and a stop at ideasbecomeresults confirmed the reminder was a good idea, planning return visits is a small organisational act that signals trust in ongoing quality and this site has earned that planned return through consistent performance across the pieces I have read so far.

  6. Reading this gave me a small framework I expect to use going forward, and a stop at growthflowswithfocus extended that framework, content that produces transferable mental models rather than just specific facts is content with multiplicative value and this site is providing those models at a rate that justifies extra attention from me regularly.

  7. Decided I would read the archives over the weekend, and a stop at actionfuelsmomentum confirmed that the archives would be worth the time, very few sites have archives I would actively read through but this one has earned that level of interest based on the consistent quality across what I have sampled so far.

  8. Bookmark folder created specifically for this site, and a look at directionunlocksgrowth confirmed the dedicated folder was the right call, dedicated folders for individual sites are a level of organisation I rarely deploy and this site has earned that level of dedicated tracking based on the consistency I have seen so far across sessions.

  9. Started taking notes about halfway through because the points were stacking up, and a look at ideascreatealignment added enough material that my notes file grew further, content that demands note taking from a passive reader is content with substance and the writers here are clearly producing that kind of work consistently across topics.

  10. Speaking as someone who reads a lot on this topic this site has earned a high position in my source rankings, and a stop at growthunlockedforward reinforced that ranking, the informal ranking of sources for a topic is something I maintain mentally and this site has moved into the upper portion of those rankings clearly.

  11. Now leaving a small mental note to recommend this when the topic comes up in conversation, and a look at actioncreatesvelocity extended that recommend ready feeling, content that arms me with shareable references for likely future conversations is content with social value and this site is providing that conversational ammunition consistently for me lately.

  12. Reading this gave me a quiet moment of intellectual pleasure that I had not been expecting, and a stop at directionfeedsmomentum extended that pleasure across more pages, the unexpected reward of stumbling into careful writing is one of the small ongoing pleasures of reading the open web and this site is delivering it reliably.

  13. Now I want to find more sites like this but I suspect they are rare, and a look at clarityopenspathways extended that thought, the few sites that meet this quality bar are precious specifically because they are rare and finding others like them is one of the ongoing projects of careful internet curation across the years.

  14. Reading this brought back an idea I had set aside months ago, and a stop at deltadash added more substance to that idea, content that revives dormant projects in my own thinking is content with serious creative value and this site is contributing to my own work in ways I had not expected when first clicking through.

  15. Generally I do not leave comments but this post merits a small note, and a stop at blog44full extended that comment worthy quality, the urge to actively contribute to a sites community rather than passively consume from it is something specific content provokes and this site has provoked that engagement urge from me today.

  16. Just enjoyed the experience without needing to think about why, and a look at forwardtractionformed kept that effortless feeling going, sometimes the best content is invisible in the sense that you forget you are reading until you reach the end and realise time has passed without you noticing it pass naturally.

  17. Better than the average post on this subject by some distance, and a look at directionbuildsflow reinforced that, you can tell within the first paragraph that the writer here actually cares about the topic rather than just covering it for the sake of having something to publish that week or that day.

  18. Halfway through reading I knew this would be one to bookmark, and a look at clarityguidesprogress confirmed that early intuition, when bookmark intent forms before finishing a post you know the writing has cleared a quality bar that most content fails to clear and this site has cleared it on multiple visits already.

  19. Felt this in a way I cannot quite explain, the topic just hit different here, and a stop at claritycreatesmomentum continued in that vein, sometimes you find a site whose perspective lines up with how you have been thinking and reading their work feels like a small relief which I appreciated more than I expected.

  20. Found a couple of useful angles in here I had not considered before reading carefully, and a quick stop at clarityturnsprogress added more, this is one of those sites where the value compounds the more you read rather than peaking at one viral post and then offering nothing else of substance afterwards which is common.

  21. Will be back, that is the simplest way to say it, and a quick visit to momentumfindsclarity reinforced the decision, this site has earned a spot in my regular rotation alongside a few other reliable places I check when I want something genuinely informative without all the usual modern web noise getting in the way.

  22. A piece that did exactly what it promised in the headline without overshooting or underdelivering, and a look at actionsetsclarity continued that calibration, alignment between promise and delivery is a basic editorial virtue that many sites fail at and this site has clearly mastered the matching of expectation and substance throughout pieces.

  23. Reading this gave me a small framework I expect to use going forward, and a stop at ideasgainmomentum extended that framework, content that produces transferable mental models rather than just specific facts is content with multiplicative value and this site is providing those models at a rate that justifies extra attention from me regularly.

  24. Probably the kind of site that should be more widely read than it appears to be, and a look at directionsetsprogress reinforced that quiet wish, the gap between a sites quality and its apparent reach is sometimes large and that gap exists for this site in a way that makes me want to mention it more.

  25. Reading this in a moment of low energy still kept my attention, and a stop at growthflowsforward continued that engagement under suboptimal conditions, content that survives the reader being tired is content with extra reserves of pull and this site has the kind of writing that holds up even when I am not at my reading best.

  26. Found something quietly useful here that I expect to return to, and a stop at blog33page added more of the same, content with quiet utility ages well in a way that flashy hot takes do not and I have learned to weight quiet utility much higher when deciding what to bookmark for later use.

  27. Well crafted post, the structure flows naturally from one point to the next without forcing transitions, and a stop at actionmovesforward kept the same flow going, you can tell when a writer has thought about how their content reads rather than just what it contains and this is one of those examples.

  28. Felt the post was written for someone like me without explicitly addressing me, and a look at actionguidesmovement produced the same fit, when content lands on its target without pandering you know the writer has done careful audience thinking rather than relying on demographic targeting or interest signals to do the work of editorial decisions.

  29. Worth saying that the writing carries a particular kind of authority without making any explicit claims to it, and a stop at signalcreatesprogress extended that earned authority feeling, sites that demonstrate expertise through the quality of their explanations rather than by stating credentials are sites I trust most and this site has it.

  30. Reading this back to back with a similar piece elsewhere made the quality difference obvious, and a stop at signalturnsideas only widened the gap, comparing content side by side is a useful exercise and the gap between this site and average competitors in the space is large enough to be noticeable from the first paragraph.

  31. Took the time to read every paragraph rather than skimming for the punchline, and a quick visit to focusdrivenforward earned the same careful attention from me, that is the highest signal I can give about content quality because my default mode is rapid scanning rather than deliberate reading on most pages.

  32. Taking the time to read carefully here has been worthwhile for the past hour, and a look at focusactivatesgrowth extended the worthwhile reading, the calculation of return on reading time spent is something I do informally and this site has been producing positive returns across multiple sessions during the last week of regular visits and reads.

  33. Will be sharing this with a couple of people who care about the topic, and a stop at forwardmotionclarified added more material worth passing along, the kind of site that is generous with quality content and does not make you jump through hoops to access it which is appreciated more than the team probably realises.

  34. Really like the way the post resists reaching for cliches that would have made it feel generic, and a quick visit to focusdrivenmovement kept that fresh feel going, original phrasing and unexpected metaphors are signs that the writer is actually thinking rather than just stitching together familiar phrases into the appearance of content.

  35. If you scroll past this site without looking carefully you will miss something, and a stop at directionanchorsaction extended that mild warning, the surface of the site does not advertise its quality loudly which means careful attention is required to recognise what is being offered here which is itself a kind of editorial signal.

  36. Now wishing more sites covered topics with this level of care, and a look at focusdrivesthepath extended that wish across more subjects, the rarity of careful coverage on most topics is a problem and this site is one of the small antidotes to that broader pattern of casual or surface treatment of complex subjects.

  37. Picked a single sentence from this post to remember, and a look at progressfollowsclarity gave me another to keep, content that produces memorable lines is doing more than just transferring information and the small selection of sentences I keep from each reading session is one of the actual returns I get from reading carefully.

  38. Decided to set aside time later to read more carefully, and a stop at clarityanchorsaction reinforced that decision, content that earns a calendar entry rather than just a passing read is in a different tier altogether and this site is clearly working at that elevated level which I really do appreciate as a reader today.

  39. Now wishing more sites covered topics with this level of care, and a look at ideasfinddirection extended that wish across more subjects, the rarity of careful coverage on most topics is a problem and this site is one of the small antidotes to that broader pattern of casual or surface treatment of complex subjects.

  40. Reading this triggered a small but real correction in something I had assumed, and a stop at ideasbecomemomentum extended that corrective effect, content that updates my beliefs through evidence rather than rhetoric is content with intellectual integrity and this site has earned that label consistently across the pieces I have read so far today.

  41. Took me back a step or two on an assumption I had been making, and a stop at actionfeedsforwardmotion pushed that reconsideration further, writing that gently corrects the reader without being aggressive about it is a rare diplomatic skill and the team here clearly knows how to land critical points without turning readers off.

  42. Bookmark earned and the bookmark feels like a permanent addition rather than a maybe, and a look at signalclarifiesgrowth confirmed that permanent status, the difference between durable bookmarks and ephemeral ones is something I have learned to feel quickly and this site triggered the durable feeling almost immediately during my first read here.

  43. My usual pattern is to skim and bounce but this site has reset that pattern temporarily, and a stop at forwardmotionconstructed maintained the slower reading mode, content that changes how I read is content with structural influence and this site has clearly nudged my reading behaviour toward something better at least for the duration of these visits.

  44. Bookmarked the page and the homepage too because clearly there is more to explore here, and a quick stop at blog44force only made that more obvious, this is the kind of place I want to dig through over a weekend rather than rushing through during a coffee break tomorrow morning before getting back to work.

Deja un comentario