Digital Libraries
See recent articles
Showing new listings for Tuesday, 17 November 2026
- [1] arXiv:2611.20319 (cross-list from cs.IR) [pdf, html, other]
-
Title: How did data sharing evolve in the decade since the FAIR Principles?Subjects: Information Retrieval (cs.IR); Digital Libraries (cs.DL)
A decade after the publication of the FAIR Guiding Principles, what have we learned about data sharing, and what do data availability statements (DAS) and other materials accrued over that period tell us about how data-sharing practices, attitudes, and infrastructures evolved? Here, we present a large-scale longitudinal analysis of over 6.8 million biomedical articles from the PMC Open Access Subset, spanning 2011 to 2025. Using an automated pipeline, we extracted and classified DAS, repository links, accession numbers, and supplementary materials, assigning each article a data-sharing score and independently FAIR-assessing a subset of cited dataset URLs. We find that explicit DAS adoption rose from ~2% in 2011 to 68% in 2025, while "available on request" statements grew in parallel from near zero to over 19%. The corpus growth amplifies both patterns: articles with a DAS containing an explicit repository mention rose from 132 in 2011 to 94,697 in 2025, while "available on request" articles rose from 77 to 173,474 over this span. Structural biology and genomics consistently achieved the highest data-sharing scores, while clinical research and public health ranked lowest. Gold Open Access journals showed a small advantage over subscription journals, while Diamond Open Access journals outperformed both. Internationally collaborative articles scored higher than domestic ones. A gender gap emerged: female first-authored articles' scores declined more than male first-authored ones. The analysis further covered additional dimensions, from compliance with funder/journal mandates and JATS XML tagging standards to computational reproducibility signals and the co-occurrence of DAS with ethics statements. A decade on, the gap between declaring data availability and actually sharing machine-readable, reusable data persists across fields, infrastructures and demographics.
- [2] arXiv:2611.20608 (cross-list from cs.CL) [pdf, html, other]
-
Title: Same Papers, Different Verdicts: Tracing Version Drift in LLM Peer ReviewComments: 19 pages, 5 figures. Results of the registered tests that need the ICLR 2027 decisions will be added after 16 December 2026Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Digital Libraries (cs.DL); Physics and Society (physics.soc-ph)
Venues and benchmarks read LLM review scores as measurements of a paper, while providers replace their models within months. We audit twenty frontier models from OpenAI, Google and Anthropic on ICLR 2027 submissions while they were under review, with tests registered before the decisions. Between an earlier and a later version of Claude Opus and of Gemini, the share of papers placed on the accept side falls by 52 and 53 percentage points on 183 and 60 randomly drawn submissions, and by 43 to 79 points in six further paired comparisons, with no paper moving up in any of them. Stating a 30% acceptance rate in the prompt leaves a gap of 79 points between the two Opus versions. When score-stripped critiques are swapped between versions, the later critiques alone lower the accept share by 35 points for Opus and 51 for Gemini; for Opus the drop is 35 points under a third-party scorer and 24 after a rewrite that keeps each technical point and removes evaluative wording. On 57 papers, the percentiles of Opus 4.6 and 5.5 correlate at 0.73 while their accept shares differ by 44 points. On 99 to 119 submissions, the self-estimated percentiles of three models correlate with two human reviewers more strongly than a third reviewer does (point estimates 0.17 to 0.21, 95% intervals between -0.04 and +0.42). All twenty models give a 2 or a 3 in 473 of their 475 reviews, against 60 of 72 human reviews. Retrospective tests on decided papers can draw on memory. Claude Opus 5.5 names the true first author of 27 decided ICLR 2026 papers from their titles alone, with no wrong name, and Claude Opus 4.6 accepted all 11 decided papers it said it recognized, against 5 expected. Thresholds on LLM-reviewer scores therefore have to be validated against human decisions for each model version; our tests against the ICLR 2027 decisions follow on 16 December 2026.
- [3] arXiv:2611.21408 (cross-list from cs.LG) [pdf, html, other]
-
Title: Do Embedding-Map Distances Guide LLM Ideation? Four Tests Against What Came NextComments: 48 pages, 5 figures. Code, data pointers and pre-registrations: this https URLSubjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Digital Libraries (cs.DL)
A popular ideation recipe treats an embedding map of existing work as a guide: pick points far from everything and decode them into ideas. I test four ways such distances could guide ideation against what appeared later. (1) Far random directions are not text: no later item reaches a raw cosine above about 0.10 with one (after centring or whitening, 22 of 24 cells stay out of reach), and an LLM decoder shown a target's neighbours, with score-only feedback, writes those neighbours in all six target sets. A neighbour-free search writes coherent text at median cosine 0.57 and 0.47 to interior gaps, beating the nearest existing item on 15 and 14 of 20, but only 0.07 and 0.06 to far points. (2) On k-means cells of a past-only map, the registered hole score mostly tracks cell size and position; three density-based gap scores forecast which cells grow fastest at or below chance (AUC 0.30 to 0.66) and add nothing to momentum in Steam and arXiv, with patents inconclusive; more isolated new Steam games are slightly better reviewed. (3) LLM continuations of arXiv papers stay closer to the source than papers that cite it, under three user prompts and against proposal rewrites (gpt-4o) and April-December 2023 papers (OLMo). Critique lengthens this step beyond content-free revision, replicated on 150 new papers. Revealing a real follow-up's title turns the ideas by 0.032 along a follow-up-specific direction beyond revision; reviewer, oracle and distance feedback add 0.13, 0.08 and 0.34 of that turn (upper bounds 0.46, 0.46, 0.70), and their turn is not separable from revision or their longer step. (4) For inspiration material graded by distance, no inverted U was detected, on an anticipation margin that tracks format more than content. Original tests were registered before running, follow-ups (thirteen requested in two AI-agent reviews) after the main results; all are dated only by local git commits.
Cross submissions (showing 3 of 3 entries)
- [4] arXiv:2103.16025 (replaced) [pdf, html, other]
-
Title: Percentile in Percentile: Evaluating Scholars Across Career StagesComments: 32 pages, 9 figures, 10 tables. Complete rewrite and expansion of earlier working paper, introducing the Percentile in Percentile (PiP) indicator with formal proofs and a full-scale reconstruction across 226M Semantic Scholar papers and 11.1M authors. Replication package: this https URLSubjects: Digital Libraries (cs.DL)
Scholars are often evaluated early in their careers, before papers accumulate citations. Standard metrics such as citation counts and the $h$-index fit these comparisons poorly: they grow with seniority, vary across fields and inflate over time. Although citation counts take years to build, a paper's citation percentile within its publication year settles quickly, correlating at 0.91 between ages 3 and 10. We introduce Percentile in Percentile (PiP), a score rating scholars against their career cohort. At each impact threshold above a cutoff, PiP counts a scholar's papers reaching that citation percentile, ranks that count against peers who started in the same year, and averages these standings. Across 11.1 million Semantic Scholar authors, PiP's distribution stays stable across 1960 to 2015 cohorts, whereas the average $h$-index at career age 10 rose about 40%. In every setting and across all 15 fields, PiP outperforms the $h$-index at predicting a scholar's record in the next decade, including future top papers, exceptional papers and overall citation impact, and reaches its age-10 accuracy in identifying future high performers 1.6 to 1.8 years earlier. Among all eligible authors, PiP also better anticipates later academy memberships, fellowships and prizes.
- [5] arXiv:2602.03864 (replaced) [pdf, other]
-
Title: Have Large Language Models Enhanced the Way Civil & Environmental Engineers Write? A Quantitative Analysis of Scholarly Communication over 25 YearsSubjects: Digital Libraries (cs.DL)
Large language models (LLMs) have rapidly emerged in civil and environmental engineering (CEE) research, education, and practice as tools for project ideation, execution, and communication. However, a gap remains in understanding how prevalent LLM adoption is across CEE scholarship and whether it measurably alters research prose. This study applies a vocabulary-based frequency-shift methodology to 149,452 abstracts published by the American Society of Civil Engineers between 2000 and 2025. Deviations from long-term vocabulary trends suggest that 15.3% and 26.9% of 2024 and 2025 abstracts, respectively, are likely LLM-influenced. Prior to the introduction of LLMs in 2022, CEE publications exhibit long-term trends toward longer abstracts, greater use of segmenting punctuation, higher required reading levels, and use of active, first-person verb constructions. Beginning around 2023, however, the frequencies of many stylistic marker words (e.g., enhance) sharply depart from their historical trajectories, a shift consistent with the emergence of LLMs. Abstracts classified as likely LLM-influenced also depart from historical semantic trends, exhibiting increased lexical diversity, comma use, and complexity, with reduced passive voice and hedging language, producing prose that is more segmented, complex, and confident. The artificial intelligence contribution of this study is the use of natural language processing to detect population-level linguistic signals of LLM-generated text, estimating the prevalence of LLM use and its influence on CEE writing. Together, these novel findings provide the first large-scale, data-driven assessment of how CEE scholarly communication is changing alongside LLM adoption.
- [6] arXiv:2605.01337 (replaced) [pdf, other]
-
Title: Comparison of OpenAlex and Scopus coverage of German institutions' publications in top-tier journalsComments: revised and expanded. earlier version was presented at STI 2026 and published in: De Parade, I., Vandewalle, E., & Engels, T. C. E. (2026, August 10). STI-ENID 2026 Conference Proceedings. 30th Annual International Conference on Science and Technology Indicators (STI-ENID 2026), University of Antwerp, Antwerp, BelgiumSubjects: Digital Libraries (cs.DL)
OpenAlex has recently emerged as a leading alternative to proprietary bibliometric sources. However, concerns remain regarding the quality of its metadata, especially the institutional profiles which are crucial for evaluating organizations. This study assesses the quality of affiliation data in OpenAlex using German research institutions. Publications from top-tier journals were analyzed and institutional publication counts in OpenAlex were systematically compared with counts in Scopus. The results show that OpenAlex generally contains more publications at the journal level, reflecting its broader coverage. However, institutional publication counts in OpenAlex are consistently lower; it contained 6.8% fewer institution-paper links in the analyzed sample. Aggregate institutional counts nevertheless showed very high rank correlation and concordance with Scopus. Discrepancies varied substantially across fields, publishers and journals. Detailed investigation identified missing affiliation information, differences in institutional boundaries, and divergent year and journal assignments, while errors present in both databases. These findings suggest that OpenAlex is suitable for comparative institutional analyses in academic research but requires further improvement in affiliation metadata before it can be used for evaluation contexts that rely on absolute publication counts.
- [7] arXiv:2607.22701 (replaced) [pdf, other]
-
Title: Nonlinear Journal Prestige Normalized Productivity: Defining and Measuring ItComments: 33 pages, 14 figures, including 7 pages of Electronic Supplementary MaterialSubjects: Digital Libraries (cs.DL)
This article introduces Journal Prestige Normalized Productivity (JPNP), a nonlinear, percentile-normalized, and authorship-fractionalized indicator of research productivity. The indicator can be aggregated to the level of disciplines, institutions, and countries. Traditional measures based on publication counts and not normalized by journal prestige do not seem to capture the current hierarchical structure of the global scientific publishing system. JPNP combines: (a) percentile normalization of journal prestige; (b) a convex transformation that strengthens the upper tail of the journal distribution; and (c) authorship fractionalization. JPNP produces a skewed but realistic distribution of productivity, identifies top performers in science more accurately than linear measures, and reduces the noise generated by low-prestige publications. The indicator improves cross-field comparability of productivity and reflects current stratification in science. JPNP is a conceptually coherent and empirically robust measurement tool, useful at the aggregated levels of research evaluation, institutional benchmarking, and science policy.
- [8] arXiv:2601.12306 (replaced) [pdf, html, other]
-
Title: Logarithmic dispersion at marginal stability in collective attentionComments: Main Text: 5 pages (1 figure); Supplemental Material: 12 pages (5 figures, 5 tables)Journal-ref: Phys. Rev. E 114 (2026) L052302Subjects: Physics and Society (physics.soc-ph); Statistical Mechanics (cond-mat.stat-mech); Digital Libraries (cs.DL); Social and Information Networks (cs.SI); Data Analysis, Statistics and Probability (physics.data-an)
How cross-sectional heterogeneity evolves in nonequilibrium populations of competing, ageing units is a collective question that cannot be resolved from a representative trajectory or the ensemble mean alone. Analysis of more than two million age-aligned English Wikipedia page-view trajectories from six yearly cohorts spanning 2015-2020 shows that the variance of logarithmic attention grows linearly with $\ln t$, while the ensemble mean relaxes on the same logarithmic clock. This dispersion law recurs across all six cohorts and is systematically favoured over the tested power-law alternative; temporal increments also exhibit consistent antipersistent scaling. A complementary trajectory-level analysis reveals broad, non-Gaussian variation in effective relaxation rates, showing that this collective regularity coexists with heterogeneous observed trajectories. A minimal scale-free stochastic model combines mean relaxation with self-affine temporal fluctuations of age-dependent amplitude. Within this model class, logarithmic spreading emerges when fluctuation accumulation balances ageing attenuation, defining the marginal boundary between algebraic broadening and saturation. Together, age-resolved cross-sectional dispersion and temporal-increment scaling provide a transferable ensemble-level criterion for distinguishing amplification, marginal spreading, and saturation in other populations of competing, ageing units.