Two ends of one wire
Fetch and push performance depends on negotiation efficiency, transfer size, and server-side computation. Each has levers, and the right ones differ by repo size.
Protocol v2
Protocol v2 (default in Git 2.26+) reduces the upfront ref advertisement, dramatically helping repos with thousands of refs. Verify it is in use:
GIT_TRACE_PACKET=1 git ls-remote origin 2>&1 | head -2
git config protocol.version 2
See "Protocol v2 for efficient fetch negotiation".