facebookexperimental / facebookexperimental/Robyn

Not all cores are utilized during training

Open
#1,272 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
1.5k
Forks
433
PR merge metrics
No merged PRs in 30d

Description

Hi folks!

We are observing a behavior where passing `cores` to `robyn.train_models` doesn't seem to have any effect in the Python version of the library.

Here are a couple of examples to reproduce - we are using `tutorial1` from `python/src/robyn/tutorials`.
Here we use a default number of cores, which on my machine is 12:
Image

While here, if I pass `cores` of 1, we can see that the time it takes to fit the models is almost identical:
Image

This is somewhat backed by low CPU utilization in contrast to the R version, where the difference in CPU utilization and run times is pretty significant (12 cores vs 1 core).

Running the notebook locally on the following machine:
```
Hardware Overview:

Model Name: MacBook Pro
Model Identifier: Mac14,10
Model Number: MNW93LL/A
Chip: Apple M2 Pro
Total Number of Cores: 12 (8 performance and 4 efficiency)
Memory: 16 GB
System Firmware Version: 11881.121.1
OS Loader Version: 11881.121.1
Serial Number (system): RY9GD262F6
Hardware UUID: ACDCFF34-EB7A-546E-9497-5866B0F8C12F
Provisioning UDID: 00006020-00144889026B401E
Activation Lock Status: Disabled
```
and
```
ProductName: macOS
ProductVersion: 15.5
BuildVersion: 24F74
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.