Throughput test - only send and not receiving results are being archived

Open
#39 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
2/5
Estimated time
1-3 hours
Newbie friendliness
48/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Stale
Tech stack
shell
Domain
observability

Research direction

Start with /usr/lib/perfsonar/archive/perfsonar-scripts/psconfig_archive.sh and compare its generated configuration with /etc/perfsonar/psconfig/archives.d/http_logstash.json. Verify that the local archive URL uses {% scheduled_by_address %} rather than localhost, then confirm that both send and receive throughput results are archived.

Written by the indexing model from the issue text.

Description

Hi perfSONAR team,

I wasn't too sure this issue should be logged at toolkit repo or archive repo.
It is related to the archive function. I don't know what part of the perfSONAR code caused the problem but I found the workaround - confirmed working.

Information

Item Info
Installation can be either Rocky or Ubuntu
Installation bundle perfsonar toolkit
Installation method can be either apt or automated script
Affected test throughput
Workaround confirmed working

The problem

  • Only send result is being archived
  • It does NOT matter if you set send test separately from receiving test
  • Dashboard then will only show one way traffic on all throughput tests
  • Same problem on both Rocky and Ubuntu installation

Workaround

This is the original archiving psconfig json file after the installation

# /etc/perfsonar/psconfig/archives.d/http_logstash.json
{
    "archiver": "http",
    "data": {
        "schema": 2,
        "_url": "https://localhost/logstash",
        "op": "put",
        "_headers": {
            "x-ps-observer": "{% scheduled_by_address %}",
            "content-type": "application/json",
            "Authorization":"Basic REMOVED_PARAMS"
        }
    }
}

With this archive configuration, only send result is being archived.
Based on perfsonar docs relating to archiving. A local archive should have the configuration like this instead
REF docs link: https://docs.perfsonar.net/multi_ma_install.html

# /etc/perfsonar/psconfig/archives.d/http_logstash.json
{
    "archiver": "http",
    "data": {
        "schema": 2,
        "_url": "https://{% scheduled_by_address %}/logstash",
        "op": "put",
        "_headers": {
            "x-ps-observer": "{% scheduled_by_address %}",
            "content-type": "application/json",
            "Authorization":"Basic REMOVED_PARAMS"
        }
    }
}

The difference here is the localhost and {% scheduled_by_address %} in the _url item.
Infact, if I run /usr/lib/perfsonar/archive/perfsonar-scripts/psconfig_archive.sh, it will output the correct archive json config for the local archive.

I made the change and can confirm it's working archiving both send and receive results of the throughput tests.

Please let me know if I need to resubmit this issue to the correct repo.

Thank you for your great work 🙏

Dominant language
Shell
Stars
0
Forks
1
PR merge metrics
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from perfsonar/archive

All issues in perfsonar/archive

Similar issues

More Shell/Bash issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.