Independent AI systems researchOperated by NeuralArc
How to read this index

A citation is not a transferable result.

Reviewed identifies the part of the source used. Supports states the bounded proposition we draw from it. Retrieved records when time-sensitive material was checked.

Vendor documentation establishes vendor claims and product behavior as documented, not independent performance. Papers establish results only for their stated methods and tested scope. AccessAllGPT recommendations remain labeled analysis.

Read the full methodology →
Source ledger

Evidence by decision guide

Ordered by the latest publication or material update date. Follow a source to inspect the original material.

Buyer guides

RAG vs Fine-Tuning: Choose the Right Adaptation Path

AccessAllGPT desk review of the original RAG paper, NIST AI 600-1 and current OpenAI implementation guidance, retrieved 2026-08-06. Paper findings, vendor guidance and AccessAllGPT recommendations are labeled separately. This is not an original benchmark, cost study or product comparison.

4 sources · 4 retrieval dates · 4 scoped claim notes
  1. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (version 4)

    arXiv (authors from Facebook AI Research, University College London and New York University) · Retrieved

    Reviewed: Abstract, introduction, methods, experiments, results, discussion and limitations of the paper's experimental scope

    Supports: The authors define and evaluate a specific RAG architecture that combines parametric sequence-to-sequence memory with retrieved non-parametric Wikipedia passages; this supports the architectural distinction, not a universal claim that retrieval improves every application.

  2. NIST AI RMF: Generative Artificial Intelligence Profile (NIST AI 600-1)

    National Institute of Standards and Technology · Retrieved

    Reviewed: Publication abstract, scope, citation and report metadata

    Supports: NIST describes the profile as a voluntary, cross-sector companion to AI RMF 1.0 for incorporating trustworthiness considerations into design, development, use and evaluation.

  3. Optimizing LLM Accuracy

    OpenAI Developer Documentation · Retrieved

    Reviewed: LLM optimization context, prompt engineering, retrieval-augmented generation, fine-tuning and production accuracy sections

    Supports: Vendor-authored guidance distinguishes context optimization for missing, stale or proprietary knowledge from model optimization for inconsistent format, style or behavior, and recommends an evaluate–hypothesize–change–evaluate cycle.

  4. Supervised fine-tuning

    OpenAI Developer Documentation · Retrieved

    Reviewed: Overview, stated use cases, evaluation prerequisite, dataset construction and data-format guidance

    Supports: Vendor-authored product guidance describes supervised fine-tuning with prompt-and-response examples for classification, translation, specific output formats and instruction-following behavior, and says to establish evaluations before investing in fine-tuning.

Models

Choose a Model Without Chasing the Leaderboard

AccessAllGPT desk review of NIST AI 600-1, the HELM v2 paper, the original Chatbot Arena paper and OpenAI evaluation guidance, reverified 2026-08-06. Historical study findings, vendor guidance and AccessAllGPT recommendations are separated below. This is not an original benchmark, product test or vendor ranking.

4 sources · 4 retrieval dates · 4 scoped claim notes
  1. NIST AI RMF: Generative Artificial Intelligence Profile (NIST AI 600-1)

    National Institute of Standards and Technology · Retrieved

    Reviewed: Publication abstract, scope, citation and report metadata

    Supports: NIST describes the profile as a voluntary, cross-sector companion to AI RMF 1.0 for incorporating trustworthiness considerations into design, development, use and evaluation.

  2. Holistic Evaluation of Language Models (version 2)

    Transactions on Machine Learning Research / arXiv · Retrieved

    Reviewed: Abstract, methodology summary and reported evaluation scope

    Supports: The authors define scenario coverage and multi-metric evaluation as distinct parts of model evaluation, and report standardized evaluation across accuracy, calibration, robustness, fairness, bias, toxicity and efficiency.

  3. Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference

    arXiv (authors from LMSYS Org and UC Berkeley) · Retrieved

    Reviewed: Abstract, methodology description and stated validation claims

    Supports: The authors describe Chatbot Arena as pairwise, crowdsourced human-preference evaluation and report agreement checks against expert raters; this establishes what the published ranking measures, not workload-specific production fitness.

  4. Evaluation best practices

    OpenAI Developer Documentation · Retrieved

    Reviewed: What are evals, design your eval process, evaluator types and edge cases

    Supports: Vendor guidance to define an evaluation objective, collect representative and edge-case data, combine evaluator types and continuously evaluate; used as implementation guidance rather than independent evidence of an OpenAI product claim.

Agents

Before You Give a Coding Agent Repository Access

AccessAllGPT synthesis of primary standards, security guidance, platform controls and benchmark methodology. This is not an original benchmark and does not score any vendor.

5 sources · 1 retrieval dates · 1 scoped claim notes
  1. NIST AI RMF: Generative Artificial Intelligence Profile (NIST AI 600-1)

    National Institute of Standards and Technology · Retrieved

    Reviewed: Publication abstract, scope, citation and report metadata

    Supports: NIST describes the profile as a voluntary, cross-sector companion to AI RMF 1.0 for incorporating trustworthiness considerations into design, development, use and evaluation.

  2. OWASP Top 10 for Large Language Model Applications

    OWASP GenAI Security Project

    This earlier source record links the primary material but does not yet carry a section-level claim note. Consult the article’s methodology and limitations before transferring a claim.

  3. About rulesets

    GitHub Docs

    This earlier source record links the primary material but does not yet carry a section-level claim note. Consult the article’s methodology and limitations before transferring a claim.

  4. SWE-bench

    SWE-bench

    This earlier source record links the primary material but does not yet carry a section-level claim note. Consult the article’s methodology and limitations before transferring a claim.

  5. SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

    arXiv

    This earlier source record links the primary material but does not yet carry a section-level claim note. Consult the article’s methodology and limitations before transferring a claim.

Benchmarks

Design an Agent Benchmark That Predicts Production

Evergreen benchmark-design guidance.

2 sources · 0 retrieval dates · 0 scoped claim notes
  1. SWE-bench

    SWE-bench

    This earlier source record links the primary material but does not yet carry a section-level claim note. Consult the article’s methodology and limitations before transferring a claim.

  2. SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

    arXiv

    This earlier source record links the primary material but does not yet carry a section-level claim note. Consult the article’s methodology and limitations before transferring a claim.

Buyer guides

The AI Tooling Procurement Scorecard

A vendor-neutral procurement framework. Commercial relationships should be disclosed in any applied comparison.

2 sources · 1 retrieval dates · 1 scoped claim notes
  1. NIST AI RMF: Generative Artificial Intelligence Profile (NIST AI 600-1)

    National Institute of Standards and Technology · Retrieved

    Reviewed: Publication abstract, scope, citation and report metadata

    Supports: NIST describes the profile as a voluntary, cross-sector companion to AI RMF 1.0 for incorporating trustworthiness considerations into design, development, use and evaluation.

  2. OWASP Top 10 for Large Language Model Applications

    OWASP GenAI Security Project

    This earlier source record links the primary material but does not yet carry a section-level claim note. Consult the article’s methodology and limitations before transferring a claim.