networkx / networkx/nx-parallel

Choice of Parameter values for benchmarks

Open
#136 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

discussion
Dominant language
Python
Stars
71
Forks
37
PR merge metrics
No merged PRs in 30d

Description

The recent algorithms that show improvement with parallel over sequential makes me start to rethink our benchmark parameters. We are timing for density values: 0.2, 0.4, 0.6, 0.8, 1.0 which spreads out equally among density values 0 and 1. But networks are almost always sparse (otherwise we wouldn't call them networks -- we would just track everyone to everyone contact). Also, it seems that our heatmaps use relatively small graphs in terms of numbers of nodes (<= 1600).

Perhaps we should be looking at larger graphs in terms of nodes and smaller graphs in terms of density. How can we decide what values to use for numbers of nodes and density?

Perhaps we should be using logarithmic spacing, something like: p in [1e-6, 1e-4, 1e-2, 1e-1, 0.2, 0.4] And for number of nodes, what do people think of making the values depend on the density we are testing. Something like: we have n^2*density = m, so choose n = sqrt(m / p) for m = [1e1, 1e2, 1e4, 1e6].

Thoughts?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or entry points. Start by locating the benchmark parameter definitions and existing heatmap or benchmark runs; done means the project has an agreed set of node-count and density values, with the selection rationale recorded.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.