TheAgentCompany / TheAgentCompany/experiments

Release TheAgentCompany benchmark on Hugging Face

Open
#3 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
24
Forks
15
PR merge metrics
No merged PRs in 30d

Description

Hi @li-boxuan 🤗

I'm Niels and work as part of the open-source team at Hugging Face. I discovered your work through Hugging Face's daily papers,
the paper page is here: https://huggingface.co/papers/2412.14161.
The paper page lets people discuss about your paper and lets them find artifacts about it (your benchmark for instance),
you can also claim the paper as yours which will show up on your public profile at HF, add Github and project page URLs.

It'd be great to also host the benchmark itself on the 🤗 hub, to improve their discoverability/visibility.
We can add tags so that people find them when filtering https://huggingface.co/datasets.

Would be awesome to make the dataset available on 🤗 , so that people can do:

from datasets import load_dataset

dataset = load_dataset("your-hf-org-or-username/your-dataset")

See here for a guide: https://huggingface.co/docs/datasets/loading.

Besides that, there's the dataset viewer which allows people to quickly explore the first few rows of the data in the browser.

Let me know if you're interested/need any help regarding this!

Kind regards,

Niels
ML Engineer @ HF 🤗

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the benchmark artifacts referenced by the repository and review Hugging Face's datasets loading guide and dataset viewer documentation. Publish the benchmark on the Hugging Face Hub so it can be loaded with datasets.load_dataset and browsed in the dataset viewer, with appropriate discoverability tags.

Written by the indexing model from the issue text.

Assessment

Tech stack
huggingface, python
Domain
data, machine-learning, release
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.