unearth doesn't seem to be finding all links on a pytorch page

[vvuk]

I'm not quite sure what to make of this. I'm on a mac, with pdm 2.19.3; I've got a dependency on e.g. torchvision==0.20.1. In my pyproject, I've got:

[project]
requires-python = "==3.12.*"

[tool.pdm.resolution]
respect-source-order = true

[[tool.pdm.source]]
name = "pytorch-cu124"
url = "https://download.pytorch.org/whl/cu124"

[[tool.pdm.source]]
name = "pytorch-cpu"
url = "https://download.pytorch.org/whl/cpu"

[[tool.pdm.source]]
name = "pypi"
url = "https://pypi.org/simple"

Inside pytorch-cpu above, in https://download.pytorch.org/whl/cpu/torchvision/ there is a torchvision-0.20.1-cp312-cp312-macosx_11_0_arm64.whl

However, grepping this log file for torchvision-0.20.1-cp312-cp312-macosx_11_0_arm64.whl doesn't show it being seen as a link at all. But other things from inside cpu/torchvision are, e.g.:

unearth.evaluator: Skipping link <Link https://download.pytorch.org/whl/cpu/torchvision-0.20.1-cp312-cp312-linux_aarch64.whl (from https://download.pytorch.org/whl/cpu/torchvision/)>: The wheel file torchvision-0.20.1-cp312-cp312-linux_aarch64.whl is not compatible with the target environment (==3.12.6, macos_15_0_arm64, cpython).

broken.log

[vvuk]

command line unearth finds it, at least:

> unearth --index-url https://download.pytorch.org/whl/cpu 'torchvision>=0.20.1' --python-version 3.12.3                 10/30/2024 03:20:09 PM
{
  "name": "torchvision",
  "version": "0.20.1",
  "link": {
    "url": "https://download.pytorch.org/whl/cpu/torchvision-0.20.1-cp312-cp312-macosx_11_0_arm64.whl",
    "comes_from": "https://download.pytorch.org/whl/cpu/torchvision/",
    "yank_reason": null,
    "requires_python": null,
    "metadata": null
  }
}

but maybe it's being rejected for some other reason that's just not in the log file?

[frostming]

It seems this log is installation log(which you didn't clarify), and the package had already been locked in lockfile.
In this case the lockfile is the golden source of packages, and indexes won't be queried again.

Make sure you generate correct lock for the current environment.