GitHub

erikbern/ann-benchmarks

806 forks

5k stars

Description

Benchmarks of approximate nearest neighbor libraries in Python

Homepage

https://github.com/erikbern/ann-benchmarks

Project metadata as of June 8, 2025.

OpenSSF scorecard

The Open Source Security Foundation is a cross-industry collaboration to improve the security of open source software (OSS). The Scorecard provides security health metrics for open source projects.

View information about checks and how to fix failures.

Score

4.8/10

Scorecard as of June 2, 2025.

Maintained

6/10

Determines if the project is "actively maintained".

Reasoning

6 commit(s) and 2 issue activity found in the last 90 days -- score normalized to 6

Code-Review

8/10

Determines if the project requires human code review before pull requests (aka merge requests) are merged.

Reasoning

Found 17/21 approved changesets -- score normalized to 8

Dangerous-Workflow

10/10

Determines if the project's GitHub Action workflows avoid dangerous patterns.

Reasoning

no dangerous workflow patterns detected

Token-Permissions

0/10

Determines if the project's workflows follow the principle of least privilege.

Reasoning

detected GitHub workflow tokens with excessive permissions

CII-Best-Practices

0/10

Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.

Reasoning

no effort to earn an OpenSSF best practices badge detected

Binary-Artifacts

10/10

Determines if the project has generated executable (binary) artifacts in the source repository.

Reasoning

no binaries found in the repo

Security-Policy

0/10

Determines if the project has published a security policy.

Reasoning

security policy file not detected

Fuzzing

0/10

Determines if the project uses fuzzing.

Reasoning

project is not fuzzed

License

10/10

Determines if the project has defined a license.

Reasoning

license file detected

Branch-Protection

0/10

Determines if the default and release branches are protected with GitHub's branch protection settings.

Reasoning

branch protection not enabled on development/release branches

SAST

0/10

Determines if the project uses static code analysis.

Reasoning

SAST tool is not run on all commits -- score normalized to 0

Pinned-Dependencies

0/10

Determines if the project has declared and pinned the dependencies of its build process.

Reasoning

dependency not pinned by hash detected -- score normalized to 0

This site uses cookies from Google to deliver its services and to analyze traffic.

Pinned-Dependencies

Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/benchmarks.yml:19: update your workflow using https://app.stepsecurity.io/secureworkflow/erikbern/ann-benchmarks/benchmarks.yml/main?enable=pin

Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/benchmarks.yml:91: update your workflow using https://app.stepsecurity.io/secureworkflow/erikbern/ann-benchmarks/benchmarks.yml/main?enable=pin

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/annoy/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/balltree/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/base/Dockerfile:1: pin your Docker image by updating ubuntu:22.04 to ubuntu:22.04@sha256:01a3ee0b5e413cefaaffc6abe68c9c37879ae3cced56a8e088b1649e5b269eee

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/bruteforce/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/ckdtree/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/datasketch/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/descartes/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/diskann/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/dolphinnpy/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/dummy_algo/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/elasticsearch/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/elasticsearch/Dockerfile:18

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/elastiknn/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/expann/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/faiss/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/faiss_gpu/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/faiss_hnsw/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/flann/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/glass/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/hnswlib/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/kdtree/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/kgn/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/kgraph/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/luceneknn/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/milvus/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/mrpt/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/n2/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/nearpy/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/nmslib/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/nndescent/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/onng_ngt/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/opensearchknn/Dockerfile:4

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/opensearchknn/Dockerfile:27

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/panng_ngt/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/parlayann/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/pg_embedding/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/pgvecto_rs/Dockerfile:1: pin your Docker image by updating tensorchord/pgvecto-rs:pg16-v0.3.0-alpha.1 to tensorchord/pgvecto-rs:pg16-v0.3.0-alpha.1@sha256:b24e070ba11d35c1fdd048687f05b00244e2d969c8c883d6852b8399ab218d8d

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/pgvector/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/pgvectorscale/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/puffinn/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/pynndescent/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/qdrant/Dockerfile:3

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/qg_ngt/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/qsg_ngt/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/redisearch/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/redisearch/Dockerfile:2

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/rpforest/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/scann/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/sptag/Dockerfile:3

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/tinyknn/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/vald/Dockerfile:2

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/vald/Dockerfile:4

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/vearch/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/vespa/Dockerfile:1: pin your Docker image by updating almalinux:8 to almalinux:8@sha256:86b0e1745d34c8577ae658aa0c8d57fb2cbdb21ee7ca9c19ab309c7cc510ac51

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/voyager/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/vsag/Dockerfile:1

Warn: containerImage not pinned by hash: ann_benchmarks/algorithms/weaviate/Dockerfile:1

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/balltree/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/base/Dockerfile:9

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/bruteforce/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/ckdtree/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/datasketch/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/descartes/Dockerfile:5

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/diskann/Dockerfile:5

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/diskann/Dockerfile:28

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/dummy_algo/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/elasticsearch/Dockerfile:65

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/elastiknn/Dockerfile:69

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/expann/Dockerfile:12

Warn: downloadThenRun not pinned by hash: ann_benchmarks/algorithms/faiss/Dockerfile:5

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/faiss/Dockerfile:9

Warn: downloadThenRun not pinned by hash: ann_benchmarks/algorithms/faiss_gpu/Dockerfile:5

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/faiss_gpu/Dockerfile:9

Warn: downloadThenRun not pinned by hash: ann_benchmarks/algorithms/faiss_hnsw/Dockerfile:5

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/faiss_hnsw/Dockerfile:9

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/glass/Dockerfile:4

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/hnswlib/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/kdtree/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/kgn/Dockerfile:5

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/kgraph/Dockerfile:5

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/milvus/Dockerfile:19

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/mrpt/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/mrpt/Dockerfile:4

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/n2/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/n2/Dockerfile:4

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/nearpy/Dockerfile:4

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/nmslib/Dockerfile:7

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/nndescent/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/onng_ngt/Dockerfile:5

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/opensearchknn/Dockerfile:38

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/panng_ngt/Dockerfile:5

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/parlayann/Dockerfile:11

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/pg_embedding/Dockerfile:25

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/pgvecto_rs/Dockerfile:11

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/pgvecto_rs/Dockerfile:12

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/pgvector/Dockerfile:39

Warn: downloadThenRun not pinned by hash: ann_benchmarks/algorithms/pgvectorscale/Dockerfile:34

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/pgvectorscale/Dockerfile:59

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/puffinn/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/pynndescent/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/qdrant/Dockerfile:9-13

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/qdrant/Dockerfile:9-13

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/qdrant/Dockerfile:9-13

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/qg_ngt/Dockerfile:5

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/qsg_ngt/Dockerfile:5

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/redisearch/Dockerfile:13

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/scann/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/scann/Dockerfile:4

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/tinyknn/Dockerfile:4

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/vald/Dockerfile:8

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/vearch/Dockerfile:3

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/vearch/Dockerfile:4

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/voyager/Dockerfile:4

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/vsag/Dockerfile:9

Warn: pipCommand not pinned by hash: ann_benchmarks/algorithms/weaviate/Dockerfile:2

Warn: pipCommand not pinned by hash: .github/workflows/benchmarks.yml:98

Warn: pipCommand not pinned by hash: .github/workflows/benchmarks.yml:22

Info: 0 out of 2 GitHub-owned GitHubAction dependencies pinned

Info: 0 out of 57 containerImage dependencies pinned

Info: 6 out of 62 pipCommand dependencies pinned

Info: 0 out of 4 downloadThenRun dependencies pinned