Otra vez los índices de impacto y su significado

En este blog he insistido en el hecho de que ya no se evalúa la ciencia por lo que se publica, si no dónde se publica y nos limitamos a «sumar» o «promediar» índices de impacto (Impact Factor, IF) de las revistas en las que se publica en vez de valorar el artículo individualmente. También he insistido en que los IFs se usan «alegremente», muchas veces sin conocer su significado real.

Hoy traigo a esta página un ejemplo espectacular que nos tiene que hacer reflexionar sobre el valor que puede tener el IF de las publicaciones científicas.

Se acaba de publicar el IF correspondiente a los artículos publicados en 2008. Y hay un cambio espectacular. La revista Acta Crystallographica Section A (Foundations of Crystallography) ha aumentado su IF en casi 25 veces, pasado de un digno 2’05  a un espectacular 49’93. ¿Por qué ha sido esto? ¿Ha aumentado la calidad de los artículos publicado? ¿Ha aumentado la exigencia del editor?

NO. La razón es que se ha publicado un artículo excelente y que toda la comunidad cristalográfica llevaba años esperando: A short history of SHELX por George M. Sheldrick, el «inventor» del programa SHELX, que es la herramienta computacional fundamental para refinar estructuras cristalográficas. Este artículo ha sido citado 6653 veces (a 25 de junio de 2010), con casi 6000 citas entre 2008 y 2009.

El segundo artículo más citado de Acta Crystallographica Section A ha sido citado 31 veces, el 10º más citado, 11 veces; hay 17 artículos que han sido citado 2 o una vez y hay 19 artículos que no han sido citados (de un total de 72 artículos publicados en 2008).

Como ya he pedido en este blog, leamos las publicaciones y veamos cuanto se ha citado cada artículo individualmente; especialmente, cuando tengamo que evaluar CVs para plazas, contratos, etc. Si seguimos teniendo en cuenta solo el índice de impacto de las revista, cometeremos injusticias. Si no cambiamos el sistema, solo me queda felicitar a los que hayan publicado en 2008 en Acta Crystallographica Section A, pues tendrán artículos con un IF de casi 50, aunque nunca haya sido citado.

P. D.: Por cierto, os habréis fijado que, sin cambiar prácticamente, la revista ha pasado de ser casi despreciada por los que solo publican por índice de impacto a ser una revista «excelente».

Bernardo Herradón

IQOG-CSIC

herradon@iqog.csic.es

Compartir:

732 comentarios

  1. Coming back to this one, definitely, and a quick visit to progressneedsfocus only made me more sure of that, the kind of writing that makes you want to set aside time later rather than rushing through it now while distracted by everything else competing for attention on the screen today across so many tabs.

  2. Strong recommendation, anyone interested in this topic owes themselves a visit, and a stop at bondedtrustpath extends that recommendation across more of the site, this is the kind of resource that makes me more optimistic about the state of the open web than I usually am these days actually for once which is genuinely refreshing.

  3. Closed several other tabs to focus on this one as I read, and a stop at focusleadsdirection held my undivided attention the same way, content that earns full focus in an attention environment full of competing pulls is content doing something genuinely well and the team behind it deserves recognition for that achievement consistently.

  4. Felt the post handled a sensitive angle of the topic with appropriate care, and a look at progressmovespurposefully extended that careful handling across related material, sites that can navigate delicate territory without causing damage are rare and require a level of judgement that comes from experience rather than from following any clear playbook.

  5. Came in tired from a long day and the writing held my attention anyway, and a stop at globalunitygroup kept that going, content that can engage a fatigued reader is doing something right because most online reading happens in suboptimal conditions like that one and quality content adapts to it without complaint.

  6. Reading this with a notebook open turned out to be the right move, and a stop at focusanchorsmovement added more material to the notes, content that justifies active note taking from a passive reader is content with real informational density and this site is producing notes worthy material at a high rate consistently.

  7. Found the section structure particularly thoughtful, and a stop at focusmapping suggested the same care across the broader site, structural choices guide the reader through the material in ways most people do not consciously notice but feel the absence of when those choices are made carelessly or not at all.

  8. Reading this brought back an idea I had set aside months ago, and a stop at bondedprinciples added more substance to that idea, content that revives dormant projects in my own thinking is content with serious creative value and this site is contributing to my own work in ways I had not expected when first clicking through.

  9. Refreshing to find writing that does not try to manipulate the reader into clicking onto the next page through cliffhangers and forced engagement, and a stop at forwardmotionactivatednow continued in the same respectful way, this is what reader first design actually looks like in practice rather than just in marketing copy that sounds nice.

  10. Found this via a link from another piece I was reading and the click was worth it, and a stop at focuspowersprogress extended the value across more material, the open web still rewards clicking through citations when the underlying writers care about each other work and this site clearly belongs to that network.

  11. Came away feeling slightly smarter than I was when I started, that is a real win, and a stop at ideaconversion added a bit more to that, the rare site that actually transfers some of its knowledge to the reader in a way that sticks rather than just creating an illusion of learning briefly.

  12. I really like how the writer keeps the tone friendly without sounding fake or overly polished, and after a stop at forwardmotionstructure the same calm pace was there, no rushing to make a point and no padding either, just clean honest writing that I can respect and come back to later again.

  13. I came here looking for a quick answer and ended up reading the whole post because it was actually interesting, and after actionorchestration I had a much fuller picture, no stress and no confusion just a clear walk through the topic that made everything fall into place without much effort.

  14. If you scroll past this site without looking carefully you will miss something, and a stop at unitedsuccesscircle extended that mild warning, the surface of the site does not advertise its quality loudly which means careful attention is required to recognise what is being offered here which is itself a kind of editorial signal.

  15. Now organising my browser bookmarks to give this site easier access, and a look at claritysystem earned the same organisational priority, the small acts of digital housekeeping I do for sites I expect to use often are themselves a measure of trust and this site has triggered the trust based housekeeping behaviour from me clearly.

  16. Glad to have another data point on a question I am still thinking through, and a look at clarityexecution added two more, content that acknowledges its place in a wider conversation rather than pretending to settle the question alone is intellectually honest in a way that I wish was more common across the open web.

  17. Just enjoyed the experience without needing to think about why, and a look at growthtrustcircle kept that effortless feeling going, sometimes the best content is invisible in the sense that you forget you are reading until you reach the end and realise time has passed without you noticing it pass naturally.

  18. Considered alongside other sources I have been reading this one consistently rises to the top, and a stop at longviewalliance maintained that top ranking, the informal ongoing comparison between sources is something I do whenever reading on a topic and this site keeps coming out near the top of those comparisons over many sessions.

  19. Now understanding why someone recommended this site to me a while back, and a stop at growthvector explained the recommendation, sometimes recommendations make sense only after experience and this site has finally clicked into place as the kind of resource I now understand was being recommended for sound editorial reasons by my friend.

  20. Quietly enthusiastic about this site after the past few hours of reading, and a stop at directionactivatesmotion extended that enthusiasm, the calibration of enthusiasm to evidence is something I try to maintain and this site has earned a calibrated quiet enthusiasm rather than the loud excitement that usually fades within a day or two of finding something.

  21. Now placing this in the small category of sites whose updates I would actually want to know about, and a stop at solidbondgroup confirmed that placement, the difference between sites I want to follow and sites I just consume from is real and this one has crossed into the active follow category from the casual consumption side.

  22. A quiet piece that did not try to compete on volume, and a look at actiondrivesmomentum maintained that selective approach, sites that publish less but better are increasingly rare in an environment that rewards volume and this one has clearly chosen quality cadence over quantity which is a brave editorial decision in current conditions.

  23. A genuinely unexpected highlight of my reading week, and a look at claritycompanion extended that pattern, the surprise of finding excellent content rather than the predictable mediocre is one of the few real pleasures of casual web browsing and this site delivered that surprise cleanly today which I really do appreciate.

  24. Worth flagging this site to a few specific friends who would appreciate the editorial sensibility, and a look at ideasunlockmotion added more pages I will mention to them, recommending sites to specific people requires understanding both the site and the person and this site is making those personalised recommendations easy and natural for me.

  25. Liked that the post acknowledged complications rather than pretending they did not exist, and a stop at nextstepnavigator continued that honest framing, sites that handle complexity with care rather than papering it over with simplifying claims are doing real intellectual work and this one is clearly in that category based on what I have read.

  26. Worth bookmarking and sharing with anyone interested in the topic, that is my honest take, and a stop at ideasdrivevelocity reinforces that, the kind of generous resource that makes the open web feel worth defending against the constant pressure to retreat into walled gardens and curated feeds today everywhere I look across all my devices.

  27. Felt the post had been written without looking over its shoulder, and a look at heritagecapitalbond continued that confident posture, content written for its own sake rather than against imagined critics has a different quality and this site reads as written from a place of confidence rather than defensive justification of every claim.

  28. Liked that the post resisted a sales pitch ending, and a stop at ideasunlockgrowth maintained the no pitch approach, content that ends without trying to convert me into a customer or subscriber is content that has confidence in its own value and this site is clearly playing the long game on reader trust.

  29. Worth saying that the writing carries a particular kind of authority without making any explicit claims to it, and a stop at strategyplanner extended that earned authority feeling, sites that demonstrate expertise through the quality of their explanations rather than by stating credentials are sites I trust most and this site has it.

  30. Reading this with a notebook open turned out to be the right move, and a stop at progressmomentum added more material to the notes, content that justifies active note taking from a passive reader is content with real informational density and this site is producing notes worthy material at a high rate consistently.

  31. Closed the laptop after this and let the ideas settle for a few hours, and a stop at clarityanchorsmotion similarly rewarded reflective time, content that benefits from sitting with rather than racing past is the kind I want more of and the kind that this site appears to consistently produce week after week here.

  32. Reading this slowly in the morning before opening email, and a stop at signaldrivesclarity extended that protected attention, content that earns the prime morning reading slot before the daily distractions begin is content with elevated status and this site has earned that prime slot consistently in my recent reading habits clearly.

  33. Just one of those reads that left me feeling slightly more capable rather than overwhelmed, and a look at strategicalliancelink kept that empowering feel going, the difference between content that builds the reader up and content that intimidates them is huge and this site clearly knows which side of that line to stand.

  34. Without overstating it this is a quietly excellent post, and a look at progressmovesintelligently extended that quiet excellence, content that earns superlatives without demanding them through marketing language is content that has truly earned them through the substance and this site has clearly produced work in that earned excellence category today.

  35. Approaching this with the usual skepticism I bring to new sites and being slowly persuaded, and a stop at momentumbuildsforward continued that gradual persuasion, the careful path from skeptical reader to genuine fan is the only one I trust and this site has walked me along that path through patient consistent quality across pieces.

  36. Felt a small spark of recognition when the post named something I had been struggling to articulate, and a look at forwardmomentumhub produced more such moments, the rare service of giving readers language for fuzzy intuitions is one of the higher values that good writing can provide and this site offered several today instances.

  37. Found something new in here that I had not seen explained this way before, and a quick stop at forwardprogression expanded the idea even further, the kind of writing that nudges your thinking forward a bit without forcing the issue is exactly what I look for online today and rarely actually find anywhere.

  38. Honestly this was the highlight of my reading queue today, and a look at progressmoveswithsignal extended that across more pages I will return to, ranking what I read against what else I read each day is something I do informally and this site keeps moving up in those rankings the more I explore it.

  39. Honestly this kind of writing is why I still bother to read independent sites, and a look at strongbusinessalliance extended that broader reflection, the few sites that justify continued attention to non algorithmic content are sites like this one and finding them periodically is enough to keep my reading habits oriented toward independent rather than aggregated content.

  40. Worth recognising the absence of the usual blog tropes here, and a look at actionmapping continued that fresh quality, sites that avoid the standard moves of the medium read as more original even when the content is on familiar topics and this one has clearly chosen its own path through the conventional terrain skilfully.

  41. If you asked me to point to a recent positive sign for the open web this site would be near the top, and a stop at globalpartnerbond reinforced that designation, the few sites that serve as evidence the web can still produce quality independent content are precious and this one has clearly become one for me.

  42. Reading the writers other posts after this one suggests the quality is consistent rather than peak, and a stop at bondedpathway confirmed the consistent quality reading, sites that hold the same level across many pieces rather than peaking on a few are sites with sustainable editorial discipline and this one has clearly developed that.

  43. Now feeling the rare pleasure of trusting a source completely on first encounter, and a look at foundationalliancebond extended that initial trust into something more durable, the calibration of trust to evidence is something I do informally and this site has earned high trust through the cumulative weight of multiple consistently good posts already.

  44. Reading this in the gap between work projects was a small but meaningful break, and a stop at forwardmotionclarity extended that gentle reset, content that provides genuine refreshment rather than just distraction during work breaks is content with a particular kind of utility and this site fits that role for me reliably during work days.

  45. Genuinely useful read, the points are practical and easy to apply right away, and a quick look at ideasintomotion confirmed that this site is consistent in that approach, looking forward to digging through the rest of it when I get the chance to sit down properly later in the week or this weekend.

  46. Quietly impressive in a way that does not announce itself, and a stop at legacytrustgroup extended that quiet impressiveness, the kind of quality that emerges through sustained attention rather than first impressions is the kind I trust more deeply and this site has been earning that deeper trust across multiple sessions over time consistently.

  47. Easy to recommend, the content speaks for itself without needing additional praise from me, and a stop at actionmatrix only adds more reasons to send people this way, the kind of generous resource that benefits its readers without demanding anything in return is increasingly rare and worth recognising clearly today across the broader open internet.

  48. If I had to defend the time I spend reading independent blogs this site would feature in the defence, and a look at focusvector reinforced that defensive utility, the ongoing case for non algorithmic reading is one I make to myself periodically and sites like this one provide the actual evidence that supports the case clearly.

  49. Thanks for the breakdown, it gave me a clearer picture of something I had been confused about for a while now, and a stop at intentionalmomentum closed the remaining gaps in my understanding nicely, no need to hunt around twenty other articles to put the pieces together which is a real time saver.

  50. Worth saying this site reads better than most paid newsletters I have tried, and a stop at progressmovesnaturally confirmed that comparison, the bar for free content is often lower than for paid but this site clears the paid bar consistently and that says something about the editorial approach behind the work being published here regularly.

Deja un comentario