Box 2026-10-27: resolved facts of the wiki_dpr 10M session
What this records: versions and checksums of the machine of REPORT-wikidpr-10m.md (configs/local_10m.yaml), so it can be rebuilt from bench/vector/box/. No Pinecone: no key file was copied. Region and zone only: no account id, instance id, address or key. Machine-read facts: settings-2026-10-27-10m.json.
Machine
| Region / zone | us-east-1 / us-east-1a |
| Instance type | r6id.4xlarge: 16 vCPU Intel® Xeon® Platinum 8375C CPU @ 2.90GHz, 123.8 GiB visible, 950 GB NVMe instance store at /data |
| AMI | ami-0fa5967347d08d2df (pinned in box/provision.sh) |
| OS | Ubuntu 24.04.5 LTS, kernel 7.0.0-1014-aws |
| Launched / terminated | 2026-10-27 20:00:11 UTC / 2026-10-28 01:49 UTC |
Software
| PostgreSQL 17 | 17.11 from PGDG (postgresql-17=17.11-1.pgdg24.04+2), pg_debug_assertions off |
| pgvector | 0.8.7 (postgresql-17-pgvector=0.8.7-1.pgdg24.04+1) |
| pg_pinecone | 0.11.0 release tarball, pg17 sha256 2d0834297085303f66de3bdc3f41c2e5f68d9a60c35e0ad18bc84f717bf6bf86 (installed pg_pinecone.so a838fad2826574c26043911b5c4f165508aec15b39f383ae28dfd3d8f9abe45a) |
| Python | 3.12.3; numpy 2.5.4, psycopg 3.3.6, pgvector 0.5.1, PyYAML 6.0.3, h5py 3.16.0 |
| Harness | bench/vector at c2d093c0baa86143e71f7fd9525a7300150001e4 (stamped in the result, not dirty, not changed mid-run) |
| Postgres settings | pg/tuned.linux-aws.conf (effective_cache_size 96 GB, jit off, max_parallel_maintenance_workers 8); the config overrides shared_buffers 16 GB, maintenance_work_mem 8 GB, min_wal_size 2 GB, max_wal_size 16 GB. The live values match those overrides |
Data
wiki_dpr shards wiki_passages_0..wiki_passages_24 (10,507,650 vectors). The base is the first 10,000,000. prefix_1m_sha dd93ee85811b7494 (the 1M base). base_content_sha cc84ae1aae00e538. Dataset key real_bb037a694f880840. settings.py reads data-sha256.txt; this phase wrote data-wikidpr10m-sha256.txt.
| File | sha256 |
|---|---|
wikidpr_768d_10m.vectors.npy |
1dd399a29de1b3b697a899fb812e1c7289a405be0b7006db56d615e3afd6a7fe |
wikidpr_768d_10m.npz |
819e1952b983f638d18c3c409793afea4de1f36e8fa54879514b2015fd37b3f6 |
Runs
One detached step, phase.sh data_wikidpr10m local_10m_prep local_10m, 20:04:25 to 00:31:08 UTC, rc 0. Nothing else ran beside it.
| Phase | Marked done (UTC) |
|---|---|
data_wikidpr10m |
2026-10-27 20:32 |
local_10m_prep |
2026-10-27 20:38 |
local_10m |
2026-10-28 00:31, wall 13,936 s, 110 / 110 points valid |
/var/bench (/data/raw, /data/logs, /data/state) was copied off and checked before teardown.sh: 11 files, sha256 of each file matched the box.